WO2015021928A1 - 一种多屏交互方法、终端及系统 - Google Patents

一种多屏交互方法、终端及系统 Download PDF

Info

Publication number
WO2015021928A1
WO2015021928A1 PCT/CN2014/084321 CN2014084321W WO2015021928A1 WO 2015021928 A1 WO2015021928 A1 WO 2015021928A1 CN 2014084321 W CN2014084321 W CN 2014084321W WO 2015021928 A1 WO2015021928 A1 WO 2015021928A1
Authority
WO
WIPO (PCT)
Prior art keywords
touch
screen
mobile terminal
digital television
event message
Prior art date
Application number
PCT/CN2014/084321
Other languages
English (en)
French (fr)
Inventor
侯芷仪
Original Assignee
深圳市同洲电子股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市同洲电子股份有限公司 filed Critical 深圳市同洲电子股份有限公司
Publication of WO2015021928A1 publication Critical patent/WO2015021928A1/zh

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4126—The peripheral being portable, e.g. PDAs or mobile phones
    • H04N21/41265—The peripheral being portable, e.g. PDAs or mobile phones having a remote control device for bidirectional communication between the remote control device and client device
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/42208—Display device provided on the remote control
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/42224—Touch pad or touch panel provided on the remote control

Definitions

  • Multi-screen interaction method, terminal and system The present application claims to be Chinese patent application filed on August 14, 2013, with the application number of 201310353715.0, and the invention titled "a multi-screen interaction method, terminal and system" Priority is hereby incorporated by reference in its entirety.
  • the present invention relates to the field of digital television technologies, and in particular, to a multi-screen interaction method, terminal, and system. Background technique
  • One of the prior art is that when the mobile phone is used as a touch panel, when a touch operation is performed on the mobile phone, a mouse arrow is used on the television to indicate the currently operated area.
  • This method has several drawbacks: the mobile phone is only used as a touchpad, the mobile phone cannot display the interface synchronized with the TV end, and cannot form a one-to-one interface mapping, the operation accuracy is not high, and the mobile phone cannot display at the same time.
  • Content can only operate, can not achieve multi-screen sharing, in addition, if multi-touch on the phone, a single mouse arrow icon can not achieve this effect synchronously, can not provide timely feedback to the user's operation.
  • the second technique of the prior art is that the mobile phone is used as a remote controller to achieve positioning through the original focus movement on the television interface.
  • the drawback of this method is: Without the advantage of convenient operation of the mobile phone, the mobile phone is only another remote control. There are only virtual buttons corresponding to the remote control on the interface. When operating, you need to use the buttons to switch like the remote control. In addition, when operating on the mobile phone, because the buttons are virtual, the touch is not possible, the user still needs While watching TV, watching the phone operation. Summary of the invention The embodiment of the invention discloses a multi-screen interaction method, a terminal and a system, which can improve the accuracy of multi-screen interaction and improve the user experience.
  • a first aspect of the embodiments of the present invention provides a multi-screen interaction method, where the method includes: receiving a real-time screen data stream pushed by a digital television terminal, and playing the data stream on a touch screen;
  • the touch event message including touch location information
  • the monitoring the touch operation on the touch screen and generating the touch event message includes: monitoring a single or multi-touch operation on the touch screen, and generating a touch event message, where the touch event message further includes touch action information .
  • a second aspect of the embodiments of the present invention provides another multi-screen interaction method, the method comprising: pushing a real-time screen data stream to a mobile terminal, so that the mobile terminal plays the data stream on a touch screen;
  • the touch event message including touch location information
  • a touch track is displayed according to the touch event message.
  • the receiving, by the mobile terminal, a touch event message generated by the touch operation of the touch screen in real time includes:
  • the method further includes: determining whether the touch track falls into a valid position, and if it falls, obtaining the corresponding relationship between the effective position and the button instruction, Corresponding key commands of the effective position, and performing operations corresponding to the corresponding key commands.
  • a third aspect of the embodiments of the present invention provides a mobile terminal, where the mobile terminal includes: a data stream receiving module, configured to receive a real-time screen data stream pushed by a digital television terminal, and touch Playing the data stream on the touch screen;
  • a message generating module configured to monitor a touch operation on the touch screen, and generate a touch event message, where the touch event message includes touch location information;
  • a message sending module configured to send the touch event message to the digital television terminal, so that the digital television terminal displays the touch track according to the touch event message.
  • the message generating module is specifically configured to:
  • a single or multi-touch operation on the touch screen is monitored, and a touch event message is generated, the touch event message further including touch action information.
  • a fourth aspect of the embodiments of the present invention provides a digital television terminal, where the digital television terminal includes: a data stream pushing module, configured to push a real-time screen data stream to the mobile terminal, so that the mobile terminal plays the data on the touch screen.
  • a message receiving module configured to receive a touch event message generated by the mobile terminal listening to a touch operation of the touch screen in real time, where the touch event message includes touch location information;
  • a touch display module configured to display a touch track according to the touch event message.
  • the message receiving module is specifically configured to:
  • the digital television terminal further includes:
  • An operation module configured to determine, after the touch display module displays the touch track according to the touch position information in the touch event message, whether the touch track falls into a valid position, and if the drop occurs, according to the effective position and the button instruction Corresponding relationship, obtaining a corresponding button instruction of the valid position, and performing an operation corresponding to the corresponding button instruction.
  • a fifth aspect of the embodiments of the present invention provides a multi-screen interaction system, where the system includes a mobile terminal and a digital television terminal, where:
  • the mobile terminal is a mobile terminal provided by the third aspect of the embodiments of the present invention.
  • the digital television terminal is a digital television terminal provided by the fourth aspect of the embodiments of the present invention.
  • the mobile terminal can receive the real-time screen data stream pushed by the digital television terminal, And playing the data stream on the touch screen, and also listening to the touch operation on the touch screen, and generating a touch event message, sending the touch event message to the digital television terminal, so that the digital television terminal displays the touch track according to the touch event message, and transmits the screen through real time. Realizing the synchronous display operation of the mobile terminal, thereby improving the accuracy of multi-screen interaction control and improving the user experience.
  • FIG. 1 is a flowchart of a multi-screen interaction method according to an embodiment of the present invention
  • FIG. 2 is a flowchart of another multi-screen interaction method according to an embodiment of the present invention.
  • FIG. 3 is a schematic structural diagram of a mobile terminal according to an embodiment of the present invention.
  • FIG. 4 is a schematic structural diagram of a digital television terminal according to an embodiment of the present invention.
  • FIG. 5 is a schematic structural diagram of another digital television terminal according to an embodiment of the present invention.
  • FIG. 1 is a flowchart of a multi-screen interaction method according to an embodiment of the present invention. As shown in FIG. 1, the multi-screen interaction method may include the following steps.
  • S101 receiving a real-time screen data stream pushed by the digital television terminal, and playing the data stream on the touch screen;
  • the mobile terminal can send a multi-screen control "start" command to the digital television terminal, and after receiving the multi-screen control "start” command, the digital television terminal sets parameters (eg, IP, bandwidth, resolution, etc.) and push flow mode (HTTP or UDP), at the same time, the portal on the digital TV terminal displays a change.
  • parameters eg, IP, bandwidth, resolution, etc.
  • push flow mode HTTP or UDP
  • the multi-screen interactive connection is successful, and the mobile terminal (for example, a smart phone, an IPAD, etc.) can receive the real-time screen data stream pushed by the digital television terminal, where real time
  • the screen data stream may include an audio-video data stream and an on-demand program information data stream, and may also include information data such as a play control interface.
  • the mobile terminal may play on the touch screen of the mobile terminal, that is, the touch screen of the mobile terminal.
  • the picture displayed on the screen can be synchronized with the picture displayed on the digital television terminal; at the same time, the digital television terminal turns on the message event monitoring to listen to the message that the mobile terminal side may send, and the digital television terminal can turn on the 12170 server.
  • S102 Monitor a touch operation on the touch screen, and generate a touch event message
  • the touch monitoring can be started, and the user can perform a single-point or multi-touch operation on the touch screen of the mobile terminal, for example, clicking on the on-demand program list on the user's touch screen. Programs.
  • the touch event message may be generated, and the touch event message may include touch location information, and may also include touch action information.
  • S103 Send a touch event message to the digital television terminal, so that the digital television terminal displays the touch track according to the touch event message;
  • the mobile terminal can send a touch event message to the 12170 server on the digital television terminal side through the TCP/UDP channel.
  • the digital television terminal for example, the Android 4.0 digital television terminal
  • the digital television terminal receives
  • the touch track may be displayed according to the touch position information in the touch event message (ie, the real-time touch operation of the current mobile terminal is displayed with a effect such as a halo at the touch position (x, y)), and at the same time on the digital television terminal
  • the picture data of the display track is returned to the mobile terminal, so that the corresponding track can also be displayed on the mobile terminal.
  • the touch event message further includes a touch action message.
  • the mobile terminal monitors that the touch operation is a continuous operation such as sliding, that is, displaying the synchronous touch track of the dynamic touch operation according to the continuous touch event message, it can be understood as:
  • the digital television terminal can determine whether the touch track falls into a valid position, and if it falls, obtain a corresponding key command of the effective position according to the corresponding relationship between the effective position and the key command, and perform an operation corresponding to the corresponding key command. For example, the user can cause the touch television to select a program in the on-demand program list by touching the touch screen on the mobile terminal, thereby causing the digital television terminal to play the program.
  • the mobile terminal can receive a real-time screen data stream pushed by the digital television terminal to display the same interface as the playback interface of the digital television terminal, and can also send a touch event message about the touch screen to the digital television.
  • the terminal is configured to enable the digital television terminal to display the touch track according to the touch event message, and realize the synchronous display operation operation of the mobile terminal through real-time transmission, thereby improving the accuracy of the multi-screen interaction control and improving the user experience.
  • FIG. 2 is a flowchart of another multi-screen interaction method according to an embodiment of the present invention. As shown in FIG. 2, the multi-screen interaction method may include the following steps.
  • S201 Pushing the real-time screen data stream to the mobile terminal, so that the mobile terminal plays the data stream on the touch screen;
  • the mobile terminal can send a multi-screen control "start” command to the digital television terminal, and the digital television terminal receives the multi-screen control "start” command, and sets parameters (for example, , IP, bandwidth, resolution, etc.) and push flow (HTTP or UDP), while the portal display on the digital TV terminal changes, at this time the multi-screen interactive connection is successful, the digital TV terminal can push the real-time screen data stream to the mobile terminal (for example, a smart phone, an IPAD, etc., where the real-time screen data stream may include an audio-video data stream and an on-demand program information data stream, and of course may also include information data such as a playback control interface, and the mobile terminal may receive the real-time screen data stream.
  • the mobile terminal may receive the real-time screen data stream.
  • Playing on the touch screen of the mobile terminal that is, the screen displayed on the touch screen of the mobile terminal can be synchronized with the screen displayed on the digital television terminal; at the same time, the digital television terminal turns on the message event monitoring to monitor the mobile terminal side to transmit at any time.
  • the news, while the digital TV terminal can be turned on 12170 server.
  • S202 Receive a touch event message generated by the mobile terminal monitoring the touch operation of the touch screen in real time; Specifically, after the mobile terminal displays the same picture on the digital television terminal, the touch monitoring can be started, and the user can perform a single-point or multi-touch operation on the touch screen of the mobile terminal, for example, clicking on the on-demand program list on the user's touch screen. Programs. After the mobile terminal monitors the single-point or multi-touch operation of the touch screen by the user, the touch event message may be generated, and the touch event message includes touch location information, and further includes touch action information.
  • the digital television terminal can use the 12170 server on the digital television terminal side to receive a touch event message generated by the mobile terminal to monitor the single-point or multi-touch operation of the touch screen in real time through the TCP/UDP channel.
  • the digital television terminal can convert the touch location information in the touch event message into display position information of the digital television terminal, and display the touch track at the position indicated by the converted position information, and display the touch track on the digital television terminal.
  • the picture data is returned to the mobile terminal so that the corresponding touch track can also be displayed on the mobile terminal.
  • the touch event message further includes a touch action message.
  • the mobile terminal monitors that the touch operation is a continuous operation such as sliding, that is, displaying the synchronous touch track of the dynamic touch operation according to the continuous touch event message, it can be understood as a touch action message.
  • the digital television terminal can determine whether the touch track falls into a valid position, and if it falls, obtain a corresponding key command of the effective position according to the corresponding relationship between the effective position and the key command, and perform an operation corresponding to the corresponding key command. For example, the user can cause the touch television to select a program in the on-demand program list by touching the touch screen on the mobile terminal, thereby causing the digital television terminal to play the program.
  • the digital television terminal can push the real-time screen data stream to the mobile terminal, so that the mobile terminal displays the same interface as the playback interface of the digital television terminal, and can also receive the touch of the mobile terminal to monitor the touch screen in real time.
  • the touch event message generated by the operation displays the touch track according to the touch event message, and realizes the synchronous display operation of the mobile terminal through the real-time screen, thereby improving the accuracy of the multi-screen interaction control and improving the user experience.
  • FIG. 3 is a schematic structural diagram of a mobile terminal according to an embodiment of the present invention.
  • the mobile terminal 30 can be, for example, a smartphone or an IPAD. As shown in FIG.
  • the mobile terminal 30 may include a data stream receiving module 301, a message generating module 302, and a message sending module 303, where: the data stream receiving module 301 is configured to receive a real-time screen data stream pushed by the digital television terminal, and The received real-time screen data stream is played on the touch screen; specifically, when the digital television terminal turns on the launcher and is in use, the mobile terminal can send a multi-screen control "start" command to the digital television terminal, and the digital television terminal receives more After the screen controls the "Start" command, set parameters (for example, IP, bandwidth, resolution, etc.) and push flow mode (HTTP or UDP), and the portal display on the digital TV terminal changes, at this time the multi-screen interactive connection is successful, the data The stream receiving module 301 can receive the real-time screen data stream pushed by the digital television terminal, where the real-time screen data stream can include the audio-video data stream and the on-demand program information data stream, and of course, can also include information data such as a play control interface, and the mobile
  • the message sending module 303 is configured to send a touch event message to the digital television terminal, so that the digital television terminal displays the touch track according to the touch event message; specifically, the mobile terminal can send the touch event message to the digital television terminal side through the TCP/UDP channel.
  • the digital TV terminal for example, Andraid4.0 digital TV terminal
  • the digital television terminal after receiving the touch event message, the digital television terminal can display the touch track according to the touch position information in the touch event message, and the digital television Terminal
  • the picture data on the display track is returned to the mobile terminal, so that the corresponding touch track can also be displayed on the mobile terminal.
  • the touch event message further includes a touch action message.
  • the mobile terminal monitors that the touch operation is a continuous operation such as sliding, that is, displaying the synchronous touch track of the dynamic touch operation according to the continuous touch event message, it can be understood as a touch action message.
  • the digital television terminal can determine whether the touch track falls into a valid position, and if it falls, obtain a corresponding key command of the effective position according to the corresponding relationship between the effective position and the key command, and perform an operation corresponding to the corresponding key command. For example, the user can cause the touch television to select a program in the on-demand program list by touching the touch screen on the mobile terminal, thereby causing the digital television terminal to play the program.
  • FIG. 4 is a schematic structural diagram of a digital television terminal according to an embodiment of the present invention.
  • the digital television terminal 40 can include a data stream pushing module 401, a message receiving module 402, and a touch track display module 403, wherein:
  • the data stream pushing module 401 is configured to: push the real-time screen data stream to the mobile terminal, so that the mobile terminal plays the real-time screen data stream on the touch screen; specifically, when the digital television terminal 40 turns on the launcher and is in use, the mobile terminal may Sending a multi-screen control "start" command to the digital television terminal 40, after receiving the multi-screen control "start” command, the digital television terminal 40 sets parameters (eg, IP, bandwidth, resolution, etc.) and push flow mode (HTTP or UDP). At the same time, the portal display on the digital television terminal 40 is changed.
  • parameters eg, IP, bandwidth, resolution, etc.
  • HTTP or UDP push flow mode
  • the multi-screen interactive connection is successful, and the data stream pushing module 401 can push the real-time screen data stream to the mobile terminal (for example, a smart phone, an IPAD, etc.), where the real-time screen data is
  • the stream may include an audio-video data stream and an on-demand program information data stream, and may further include information data such as a play control interface.
  • the mobile terminal After receiving the real-time screen data stream, the mobile terminal may perform the touch screen on the mobile terminal.
  • Playback that is, the screen displayed on the touch screen of the mobile terminal can be synchronized with the screen displayed on the digital television terminal 40; at the same time, the digital television terminal 40 turns on the message event monitoring to listen to the message that the mobile terminal side may send at any time, and simultaneously The digital television terminal 40 can turn on the 12170 server.
  • the message receiving module 402 is configured to receive a touch event message generated by the mobile terminal listening to the touch operation instruction of the touch screen in real time; specifically, after the mobile terminal displays the same screen as that on the digital television terminal 40, the touch monitoring can be started, and the user can move A single-point or multi-touch operation is performed on the touch screen of the terminal, for example, a certain program in the list of on-demand programs is clicked on the user's touch screen.
  • the touch event message may be generated, and the touch event message may include touch location information, and may also include touch action information.
  • the digital television terminal 40 can receive the touch event message generated by the mobile terminal according to the single-point or multi-touch operation of the touch screen through the TCP/UDP channel by using the 12170 server on the side of the digital television terminal 40.
  • the touch display module 403 is configured to display the touch track according to the touch event message; specifically, the digital television terminal 40 can convert the touch position information in the touch event message into the display position information of the digital television terminal 40, and in the converted position.
  • the touch track is displayed at the position indicated by the information, and the picture data of the touch track displayed on the digital television terminal 40 is returned to the mobile terminal, so that the corresponding touch track can also be displayed on the mobile terminal.
  • the touch event message further includes a touch action message.
  • the mobile terminal monitors that the touch operation is a continuous operation such as sliding, that is, displaying the synchronous touch track of the dynamic touch operation according to the continuous touch event message, it can be understood as a touch action message.
  • the digital television terminal provided in FIG. 4 can push the real-time screen data stream to the mobile terminal, so that the mobile terminal displays the same interface as the playing interface of the digital television terminal, and can also receive the touch generated by the mobile terminal monitoring the touch operation of the touch screen in real time.
  • the event message displays the touch track according to the touch event message, and realizes the synchronous display operation of the mobile terminal through the real-time screen transmission, thereby improving the accuracy of the multi-screen interaction control and improving the user experience.
  • FIG. 5 is a schematic diagram showing the structure of another digital television terminal according to an embodiment of the present invention. Intention.
  • the digital television terminal 50 shown in FIG. 5 is optimized by the digital television terminal 40 shown in FIG. In the digital television terminal 50 shown in FIG.
  • the operation module 501 is further included, wherein: the operation module 501 is configured to determine whether the touch track falls after the touch display module 403 displays the touch track according to the touch event message. If the effective position, if it falls, the corresponding key command of the effective position is obtained according to the correspondence between the effective position and the button command, and the operation corresponding to the corresponding button command is performed.
  • the digital television terminal provided in FIG. 5 can be synchronously displayed with the mobile terminal, and can also receive a touch event message generated by the mobile terminal monitoring the touch operation of the touch screen in real time, displaying the touch track according to the touch event message, and performing according to the position of the touch track.
  • the corresponding operation can improve the accuracy of multi-screen interaction control and enhance the user experience.
  • the embodiment of the invention further provides a multi-screen interaction system, which comprises a mobile terminal and a digital television terminal, wherein:
  • the mobile terminal is configured to receive a real-time screen data stream pushed by the digital television terminal, play the data stream on the touch screen, monitor a touch operation on the touch screen, generate a touch event message, and send a touch event message to the digital television terminal.
  • the digital television terminal is configured to: push the real-time screen data stream to the mobile terminal, so that the mobile terminal plays the data stream on the touch screen, and is further configured to receive a touch event message generated by the mobile terminal monitoring the touch operation of the touch screen in real time, according to the touch event message. Show the track.
  • the mobile terminal in the multi-screen interactive system may be the mobile terminal 30 as shown in FIG.
  • the digital television terminal in the multi-screen interactive system may be a digital television terminal 40 as shown in Fig. 4 or a digital television terminal 50 as shown in Fig. 5.
  • the steps in the method of the embodiment of the present invention may be sequentially adjusted, merged, and deleted according to actual needs.
  • Modules or units in the apparatus of the embodiments of the present invention may be combined, divided, and deleted according to actual needs.
  • the module or module of the embodiment of the present invention may be a general-purpose integrated circuit (such as a central processing unit CPU), or Implemented as an application specific integrated circuit (ASIC).
  • a general-purpose integrated circuit such as a central processing unit CPU
  • ASIC application specific integrated circuit
  • the program may be stored in a computer readable storage medium, and the storage medium may include: Flash disk, read-only memory (ROM), random access memory (RAM), disk or optical disk.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

本发明实施例涉及数字电视技术领域，公开了一种多屏交互方法、终端及系统。其中，该方法包括：接收数字电视终端推送的实时屏幕数据流，并在触摸屏上播放所述数据流；监听对所述触摸屏的触摸操作，并生成触摸事件消息，所述触摸事件消息包括触摸位置信息；发送所述触摸事件消息给所述数字电视终端，以使得所述数字电视终端根据所述触摸事件消息显示触轨。通过本发明实施例，能够提高多屏互动的操控的准确性，并提升用户体验。

Description

一种多屏交互方法、 终端及系统 本申请要求于 2013 年 8 月 14 日提交中国专利局、 申请号为 201310353715.0 、 发明名称为 "一种多屏交互方法、 终端及系统" 的中国专 利申请的优先权， 其全部内容通过引用结合在本申请中。 技术领域
本发明涉及数字电视技术领域，具体涉及一种多屏交互方法、终端及系统。 背景技术
随着科技的发展以及人们对生活品质的要求的提高，生活中出现了各种尺 寸和功能的有屏电子产品。 不同的有屏电子产品有不同的优缺点， 于是就有了 把各个屏的优点结合起来， 形成多屏互动的需求。 目前在数字生活网络联盟 ( Digital Living Network Alliance , DLNA )等多屏互动协议的支持下， 多屏结 合的需求得以实现， 其中， 电视在多屏互动中的核心功能是显示功能， 而手机 的核心功能是操控功能。
现有技术之一是， 把手机当成触摸板， 在手机上进行触摸操作时， 电视上 用鼠标箭头指示当前操作的区域。这种方法有几个缺陷：手机仅被当成触摸板， 手机上不能够显示与电视端同步的界面， 不能够形成一对一的界面映射，操作 时准确性不高， 而且手机不能同时显示播放内容， 只能够操作， 不能够实现多 屏同分享， 此外， 如果在手机上进行多点触控时， 单一鼠标箭头图标无法同步 实现该效果， 无法给用户的操作提供及时的反馈。
现有技术之二是， 手机当成遥控器使用， 通过电视界面上原有的焦点移动 来实现定位。 这种方法的缺陷为： 没有利用手机操作方便的优点， 手机仅仅只 是另外一个遥控器。 界面上仅有和遥控器对应的虚拟按键， 操作时， 还是需要 像操作遥控器一样利用按键进行切换， 再者， 在手机上操作时， 因为按键是虚 拟的， 无法实现触摸感， 用户仍然需要一边看电视， 一边看着手机操作。 发明内容 本发明实施例公开了一种多屏交互方法、终端及系统， 能够提高多屏互动 的操控的准确性， 并提升用户体验。
本发明实施例的第一方面提供一种多屏交互方法， 所述方法包括： 接收数字电视终端推送的实时屏幕数据流， 并在触摸屏上播放所述数据 流;
监听对所述触摸屏的触摸操作， 并生成触摸事件消息， 所述触摸事件消息 包括触摸位置信息；
发送所述触摸事件消息给所述数字电视终端，以使得所述数字电视终端根据所 述触摸事件消息显示触轨。
进一步， 所述监听对所述触摸屏的触摸操作， 并生成触摸事件消息包括： 监听对所述触摸屏的单点或多点触摸操作， 并生成触摸事件消息， 所述触 摸事件消息还包括触摸动作信息。
本发明实施例的第二方面提供另一种多屏交互方法， 所述方法包括： 推送实时屏幕数据流给移动终端，以使得所述移动终端在触摸屏上播放所 述数据流；
接收所述移动终端实时监听所述触摸屏的触摸操作而生成的触摸事件消 息， 所述触摸事件消息包括触摸位置信息；
根据所述触摸事件消息显示触轨。
进一步，所述接收所述移动终端实时监听所述触摸屏的触摸操作而生成的 触摸事件消息包括：
接收所述移动终端实时监听所述触摸屏的单点或多点触摸操作而生成的 触摸事件消息， 所述触摸事件消息还包括触摸动作信息。
进一步， 所述根据所述触摸事件消息显示触轨之后， 所述方法还包括： 判断所述触轨是否落入有效位置， 若落入， 则按照所述有效位置与按键 指令的对应关系， 获取所述有效位置的对应按键指令， 并进行与所述对应按 键指令相应的操作。
本发明实施例的第三方面提供一种移动终端， 所述移动终端包括： 数据流接收模块， 用于接收数字电视终端推送的实时屏幕数据流， 并在触 摸屏上播放所述数据流；
消息生成模块，用于监听对所述触摸屏的触摸操作，并生成触摸事件消息， 所述触摸事件消息包括触摸位置信息；
消息发送模块， 用于发送所述触摸事件消息给所述数字电视终端， 以使得 所述数字电视终端根据所述触摸事件消息显示触轨。
进一步所述消息生成模块具体用于：
监听对所述触摸屏的单点或多点触摸操作， 并生成触摸事件消息， 所述触 摸事件消息还包括触摸动作信息。
本发明实施例第四方面提供一种数字电视终端， 所述数字电视终端包括： 数据流推送模块， 用于推送实时屏幕数据流给移动终端， 以使得所述移动 终端在触摸屏上播放所述数据流；
消息接收模块，用于接收所述移动终端实时监听所述触摸屏的触摸操作而 生成的触摸事件消息， 所述触摸事件消息包括触摸位置信息；
触轨显示模块， 用于根据所述触摸事件消息显示触轨。
进一步， 所述消息接收模块具体用于：
接收所述移动终端实时监听所述触摸屏的单点或多点触摸操作而生成的 触摸事件消息， 所述触摸事件消息还包括触摸动作信息。
进一步， 所述数字电视终端还包括：
操作模块，用于在触轨显示模块根据所述触摸事件消息中的触摸位置信息 显示触轨之后， 判断所述触轨是否落入有效位置， 若落入， 则按照所述有效位 置与按键指令的对应关系， 获取所述有效位置的对应按键指令， 并进行与所述 对应按键指令相应的操作。
本发明实施例第五方面提供一种多屏交互系统，所述系统包括移动终端和 数字电视终端， 其中：
所述移动终端为本发明实施例第三方面提供的移动终端；
所述数字电视终端为本发明实施例第四方面提供的数字电视终端。
本发明实施例中， 移动终端可接收数字电视终端推送的实时屏幕数据流， 并在触摸屏上播放该数据流，还可监听对触摸屏的触摸操作， 并生成触摸事件 消息，发送触摸事件消息给数字电视终端， 以使得数字电视终端根据触摸事件 消息显示触轨，通过实时传屏实现移动终端同步显示操作触轨， 从而可提高多 屏互动的操控的准确性， 并提升用户体验。
附图说明
为了更清楚地说明本发明实施例或现有技术中的技术方案，下面将对实施 例中所需要使用的附图作简单地介绍， 显而易见地， 下面描述中的附图仅仅是 本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的 前提下， 还可以根据这些附图获得其他的附图。
图 1是本发明实施例提供的一种多屏交互方法的流程图；
图 2是本发明实施例提供的另一种多屏交互方法的流程图；
图 3是本发明实施例提供的一种移动终端的结构示意图；
图 4是本发明实施例提供的一种数字电视终端的结构示意图；
图 5是本发明实施例提供的另一种数字电视终端的结构示意图。
具体实施方式
下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清 楚、 完整地描述， 显然， 所描述的实施例仅仅是本发明一部分实施例， 而不是 全部的实施例。基于本发明中的实施例， 本领域普通技术人员在没有做出创造 性劳动前提下所获得的所有其他实施例， 都属于本发明保护的范围。
本发明实施例公开了一种多屏交互方法、终端及系统， 能够提高多屏互动 的操控的准确性， 并提升用户体验。 以下分别进行详细说明。 - 请参阅图 1， 图 1示出了本发明实施例提供的一种多屏交互方法的流程图。 如图 1所示， 该多屏交互方法可以包括以下步骤。
S101 :接收数字电视终端推送的实时屏幕数据流，并在触摸屏上播放数据 流;
具体地， 当数字电视终端开启桌面启动器（launcher ),并处于使用状态时， 移动终端可发送多屏控制 "开始"指令给数字电视终端， 数字电视终端接收到 多屏控制 "开始" 指令后， 设置参数（例如， IP、 带宽和分辨率等）和推流方 式（ HTTP或 UDP )， 同时数字电视终端上的门户 （ portal )显示改变， 此时多 屏互动连接成功， 移动终端 （例如， 智能手机， IPAD等）可接收数字电视终 端推送的实时屏幕数据流，这里的实时屏幕数据流可以包括音视频数据流和点 播节目信息数据流， 当然还可以包括播放控制界面等信息数据， 移动终端收到 数据流后， 可在移动终端的触摸屏上进行播放， 即移动终端的触摸屏上显示的 画面可与数字电视终端上显示的画面同步； 与此同时，数字电视终端开启消息 事件监听， 以随时监听移动终端侧可能发送而来的消息， 同时数字电视终端可 以开启 12170服务端。
S102: 监听对触摸屏的触摸操作， 并生成触摸事件消息；
具体地，移动终端显示与数字电视终端上相同的画面后，可开启触摸监听， 用户可在移动终端的触摸屏上进行单点或多点触摸操作， 例如， 用户触摸屏上 点击点播节目列表中的某个节目。移动终端监听到用户对触摸屏的单点或多点 触摸操作后， 可生成触摸事件消息， 触摸事件消息包括触摸位置信息， 还可以 包括触摸动作信息， 例如， 触摸事件消息的格式可以为 （X, y, p )， 其中， x、 y 为触摸坐标值， p为触摸值， p = l表示按下， p = 0表示弹起。
S103: 发送触摸事件消息给数字电视终端， 以使得数字电视终端根据触摸 事件消息显示触轨；
具体地，移动终端可通过 TCP/UDP通道发送触摸事件消息给数字电视终端 侧的 12170服务端， 由于数字电视终端（例如， Android4.0数字电视终端） 自带 了触轨功能，数字电视终端接收到触摸事件消息后， 可根据触摸事件消息中的 触摸位置信息显示触轨（即在触摸位置（x， y )处以光晕等效果来展示当前移 动终端的实时触摸操作）， 同时数字电视终端上显示触轨的画面数据会返回到 移动终端， 从而使得移动终端上也可显示相应的触轨。 其中， 触摸事件消息还 包括触摸动作消息， 例如， 当移动终端监听到触摸操作为滑动等连续操作时， 即根据连续的触摸事件消息显示动态触摸操作的同步触轨， 可以理解为， 触摸 动作消息 P=l时， 在触摸位置 （x， y ) 处以光晕等效果来展示当前移动终端的 实时触摸操作， 当 P=0时， 即当前触轨结束。
进一步的， 数字电视终端可判断触轨是否落入有效位置， 若落入， 则按照 有效位置与按键指令的对应关系， 获取有效位置的对应按键指令， 并进行与对 应按键指令相应的操作。 例如， 用户可通过触摸移动终端上的触摸屏， 使触轨 选定点播节目列表中的某个节目， 从而使数字电视终端播放该节目。
在图 1提供的多屏交互方法中， 移动终端可接收数字电视终端推送的实时 屏幕数据流以显示与数字电视终端的播放界面相同的界面，还可将关于触摸屏 的触摸事件消息发送给数字电视终端，以使得数字电视终端根据触摸事件消息 显示触轨， 通过实时传屏实现移动终端同步显示操作触轨，从而可提高多屏互 动的操控的准确性， 并提升用户体验。 请参阅图 2， 图 2示出了本发明实施例提供的另一种多屏交互方法的流程 图。 如图 2所示， 该多屏交互方法可以包括以下步骤。
S201 : 推送实时屏幕数据流给移动终端， 以使得移动终端在触摸屏上播放 数据流；
具体地， 当数字电视终端开启 launcher, 并处于使用状态时， 移动终端可 发送多屏控制 "开始"指令给数字电视终端，数字电视终端接收到多屏控制 "开 始" 指令后， 设置参数（例如， IP、 带宽和分辨率等）和推流方式（HTTP或 UDP ), 同时数字电视终端上的 portal显示改变， 此时多屏互动连接成功， 数字 电视终端可推送实时屏幕数据流给移动终端（例如， 智能手机， IPAD等）， 这 里的实时屏幕数据流可以包括音视频数据流和点播节目信息数据流，当然还可 以包括播放控制界面等信息数据，移动终端收到实时屏幕数据流后， 可在移动 终端的触摸屏上进行播放，即移动终端的触摸屏上显示的画面可与数字电视终 端上显示的画面同步； 与此同时， 数字电视终端开启消息事件监听， 以随时监 听移动终端侧可能发送而来的消息， 同时数字电视终端可开启 12170服务端。
S202： 接收移动终端实时监听触摸屏的触摸操作而生成的触摸事件消息； 具体地，移动终端显示与数字电视终端上相同的画面后，可开启触摸监听， 用户可在移动终端的触摸屏上进行单点或多点触摸操作， 例如， 用户触摸屏上 点击点播节目列表中的某个节目。移动终端监听到用户对触摸屏的单点或多点 触摸操作后， 可生成触摸事件消息， 触摸事件消息包括触摸位置信息， 进一步 的，还包括触摸动作信息， 例如， 触摸事件消息的格式可以为（x, y, p )， 其中， x、 y为触摸坐标值， p为触摸值， p = l表示按下， p = 0表示弹起。 此外， 数字 电视终端可利用数字电视终端侧的 12170服务端通过 TCP/UDP通道接收移动终 端实时监听触摸屏的单点或多点触摸操作而生成的触摸事件消息。
S203: 根据触摸事件消息显示触轨；
具体地，数字电视终端可将触摸事件消息中的触摸位置信息转化为数字电 视终端的显示位置信息， 并在转化后的位置信息所指示的位置上显示触轨， 同 时数字电视终端上显示触轨的画面数据会返回到移动终端，从而使得移动终端 上也可显示相应的触轨。 其中， 触摸事件消息还包括触摸动作消息， 例如， 当 移动终端监听到触摸操作为滑动等连续操作时，即根据连续的触摸事件消息显 示动态触摸操作的同步触轨， 可以理解为， 触摸动作消息 P=l时， 在触摸位置 ( x, y )处以光晕等效果来展示当前移动终端的实时触摸操作， 当 P=0时， 即 触摸操作结束， 同步的， 当前触轨结束。
进一步的， 数字电视终端可判断触轨是否落入有效位置， 若落入， 则按照 有效位置与按键指令的对应关系， 获取有效位置的对应按键指令， 并进行与对 应按键指令相应的操作。 例如， 用户可通过触摸移动终端上的触摸屏， 使触轨 选定点播节目列表中的某个节目， 从而使数字电视终端播放该节目。
在图 2提供的多屏交互方法中， 数字电视终端可推送实时屏幕数据流给移 动终端， 以使得移动终端显示与数字电视终端的播放界面相同的界面，还可接 收移动终端实时监听触摸屏的触摸操作而生成的触摸事件消息，根据触摸事件 消息显示触轨，通过实时传屏实现移动终端同步显示操作触轨， 从而可提高多 屏互动的操控的准确性， 并提升用户体验。 请参阅图 3， 图 3示出了本发明实施例提供的一种移动终端的结构示意图。 该移动终端 30可以是， 例如， 智能手机或 IPAD。 如图 3所示， 该移动终端 30可 以包括数据流接收模块 301、 消息生成模块 302和消息发送模块 303， 其中： 数据流接收模块 301， 用于接收数字电视终端推送的实时屏幕数据流， 并 在触摸屏上播放接收到的实时屏幕数据流； 具体地， 当数字电视终端开启 launcher, 并处于使用状态时， 移动终端可发送多屏控制 "开始" 指令给数字 电视终端， 数字电视终端接收到多屏控制 "开始" 指令后， 设置参数（例如， IP、带宽和分辨率等）和推流方式（ HTTP或 UDP )，同时数字电视终端上的 portal 显示改变， 此时多屏互动连接成功， 数据流接收模块 301可接收数字电视终端 推送的实时屏幕数据流，这里的实时屏幕数据流可以包括音视频数据流和点播 节目信息数据流， 当然还可以包括播放控制界面等信息数据，移动终端 30收到 数据流后， 可在移动终端 30的触摸屏上进行播放， 即移动终端 30的触摸屏上显 示的画面可与数字电视终端上显示的画面同步； 与此同时，数字电视终端开启 消息事件监听， 以随时监听移动终端 30侧可能发送而来的消息， 同时数字电视 终端可开启 12170服务端。
消息生成模块 302， 用于监听对触摸屏的触摸操作指令， 并生成触摸事件 消息； 具体地， 移动终端 30显示与数字电视终端上相同的画面后， 可开启触摸 监听， 用户可在移动终端 30的触摸屏上进行单点或多点触摸操作， 例如， 用户 触摸屏上点击点播节目列表中的某个节目。移动终端 30接收到用户对触摸屏的 单点或多点触摸操作后， 可生成触摸事件消息，触摸事件消息包括触摸位置信 息， 还可以包括触摸动作信息， 例如， 触摸事件消息的格式可以为 （X, y, p )， 其中， x、 y为触摸坐标值， p为触摸值， p = l表示按下， p = 0表示弹起。
消息发送模块 303， 用于发送触摸事件消息给数字电视终端， 以使得数字 电视终端根据触摸事件消息显示触轨； 具体地，移动终端可通过 TCP/UDP通道 发送触摸事件消息给数字电视终端侧的 12170服务端， 由于数字电视终端 （例 如， Andraid4.0数字电视终端）具备触轨功能， 数字电视终端接收到触摸事件 消息后， 可根据触摸事件消息中的触摸位置信息显示触轨， 同时数字电视终端 上显示触轨的画面数据会返回到移动终端，从而使得移动终端上也可显示相应 的触轨。 其中， 触摸事件消息还包括触摸动作消息， 例如， 当移动终端监听到 触摸操作为滑动等连续操作时，即根据连续的触摸事件消息显示动态触摸操作 的同步触轨， 可以理解为， 触摸动作消息 P=l时， 在触摸位置 （x， y )处以光 晕等效果来展示当前移动终端的实时触摸操作， 当 P=0时， 即当前触轨结束。
进一步的， 数字电视终端可判断触轨是否落入有效位置， 若落入， 则按照 有效位置与按键指令的对应关系， 获取有效位置的对应按键指令， 并进行与对 应按键指令相应的操作。 例如， 用户可通过触摸移动终端上的触摸屏， 使触轨 选定点播节目列表中的某个节目， 从而使数字电视终端播放该节目。
其中， 图 3提供的移动终端可接收数字电视终端推送的实时屏幕数据流以 显示与数字电视终端的播放界面相同的界面，还可将关于触摸屏的触摸事件消 息发送给数字电视终端， 以使得数字电视终端根据触摸事件消息显示触轨，通 过实时传屏实现移动终端同步显示操作触轨，从而可提高多屏互动的操控的准 确性， 并提升用户体验。 请参阅图 4，图 4示出了本发明实施例提供的一种数字电视终端的结构示意 图。 如图 4所示， 该数字电视终端 40可以包括数据流推送模块 401、 消息接收模 块 402和触轨显示模块 403， 其中：
数据流推送模块 401， 用于推送实时屏幕数据流给移动终端， 以使得移动 终端在触摸屏上播放实时屏幕数据流； 具体地， 当数字电视终端 40开启 launcher, 并处于使用状态时， 移动终端可发送多屏控制 "开始" 指令给数字 电视终端 40， 数字电视终端 40接收到多屏控制 "开始" 指令后， 设置参数（例 如， IP、 带宽和分辨率等）和推流方式（HTTP或 UDP )， 同时数字电视终端 40 上的 portal显示改变， 此时多屏互动连接成功， 数据流推送模块 401可推送实时 屏幕数据流给移动终端 （例如， 智能手机， IPAD等）， 这里的实时屏幕数据流 可以包括音视频数据流和点播节目信息数据流，当然还可以包括播放控制界面 等信息数据，移动终端收到实时屏幕数据流后， 可在移动终端的触摸屏上进行 播放，即移动终端的触摸屏上显示的画面可与数字电视终端 40上显示的画面同 步； 与此同时， 数字电视终端 40开启消息事件监听， 以随时监听移动终端侧可 能发送而来的消息， 同时数字电视终端 40可开启 12170服务端。
消息接收模块 402， 用于接收移动终端实时监听触摸屏的触摸操作指令而 生成的触摸事件消息； 具体地，移动终端显示与数字电视终端 40上相同的画面 后，可开启触摸监听，用户可在移动终端的触摸屏上进行单点或多点触摸操作， 例如， 用户触摸屏上点击点播节目列表中的某个节目。移动终端监听到用户对 触摸屏的单点或多点触摸操作后， 可生成触摸事件消息， 触摸事件消息包括触 摸位置信息，还可以包括触摸动作信息，例如，触摸事件消息的格式可以为（X, y, p )， 其中， x、 y为触摸坐标值， p为触摸值， p = l表示按下， p = 0表示弹起。 此外， 数字电视终端 40可利用数字电视终端 40侧的 12170服务端通过 TCP/UDP 通道接收移动终端根据触摸屏的单点或多点触摸操作而生成的触摸事件消息。
触轨显示模块 403， 用于根据触摸事件消息显示触轨； 具体地， 数字电视 终端 40可将触摸事件消息中的触摸位置信息转化为数字电视终端 40的显示位 置信息， 并在转化后的位置信息所指示的位置上显示触轨， 同时数字电视终端 40上显示触轨的画面数据会返回到移动终端，从而使得移动终端上也可显示相 应的触轨。 其中， 触摸事件消息还包括触摸动作消息， 例如， 当移动终端监听 到触摸操作为滑动等连续操作时，即根据连续的触摸事件消息显示动态触摸操 作的同步触轨， 可以理解为， 触摸动作消息 P=l时， 在触摸位置 （x， y ) 处以 光晕等效果来展示当前移动终端的实时触摸操作， 当 P=0时， 即当前触轨结束。
其中， 图 4提供的数字电视终端可推送实时屏幕数据流给移动终端， 以使 得移动终端显示与数字电视终端的播放界面相同的界面，还可接收移动终端实 时监听触摸屏的触摸操作而生成的触摸事件消息， 根据触摸事件消息显示触 轨，通过实时传屏实现移动终端同步显示操作触轨，从而可提高多屏互动的操 控的准确性， 并提升用户体验。 请参阅图 5，图 5示出了本发明实施例提供的另一种数字电视终端的结构示 意图。其中， 图 5所示的数字电视终端 50是由图 4所示的数字电视终端 40进行优 化得到的。在图 5所示的数字电视终端 50中，进一步包括了操做模块 501，其中： 操做模块 501， 用于在触轨显示模块 403根据触摸事件消息显示触轨之后， 判断触轨是否落入有效位置，若落入，则按照有效位置与按键指令的对应关系， 获取有效位置的对应按键指令， 并进行与对应按键指令相应的操作。
其中， 图 5提供的数字电视终端可与移动终端进行同步显示， 还可接收移 动终端实时监听触摸屏的触摸操作而生成的触摸事件消息，根据触摸事件消息 显示触轨， 并根据触轨的位置进行相应的操作，从而可提高多屏互动的操控的 准确性， 并提升用户体验。 本发明实施例还提供一种多屏交互系统，该多屏交互系统包括移动终端和 数字电视终端， 其中：
移动终端， 用于接收数字电视终端推送的实时屏幕数据流， 并在触摸屏上 播放该数据流， 监听对触摸屏的触摸操作， 并生成触摸事件消息， 以及发送触 摸事件消息给数字电视终端。
数字电视终端， 用于推送实时屏幕数据流给移动终端， 以使得移动终端在 触摸屏上播放该数据流，还用于接收移动终端实时监听触摸屏的触摸操作而生 成的触摸事件消息， 根据触摸事件消息显示触轨。
进一步， 该多屏交互系统中的移动终端可以是如图 3所示的移动终端 30。 进一步， 该多屏交互系统中的数字电视终端可以是如图 4所示的数字电视 终端 40或如图 5所示的数字电视终端 50。 本发明实施例方法中的步骤可以根据实际需要进行顺序调整、 合并和删 减。
本发明实施例装置中的模块或单元可以根据实际需要进行合并、划分和删 减。
本发明实施例的模块或模块,可以以通用集成电路 (如中央处理器 CPU),或 以专用集成电路 (ASIC)来实现。
本领域普通技术人员可以理解上述实施例的各种方法中的全部或部分步 骤是可以通过程序来指令相关的硬件来完成，该程序可以存储于一计算机可读 存储介质中， 存储介质可以包括： 闪存盘、 只读存储器（Read-Only Memory ， ROM ), 随机存取器（Random Access Memory, RAM ), 磁盘或光盘等。
以上对本发明实施例所提供的多屏交互方法、 终端及系统进行了详细介 例的说明只是用于帮助理解本发明的方法及其核心思想； 同时，对于本领域的 一般技术人员，依据本发明的思想，在具体实施方式及应用范围上均会有改变 之处， 综上所述， 本说明书内容不应理解为对本发明的限制。

Claims

权 利 要 求
1、 一种多屏交互方法， 其特征在于， 所述方法包括：
接收数字电视终端推送的实时屏幕数据流， 并在触摸屏上播放所述数据 流;
监听对所述触摸屏的触摸操作， 并生成触摸事件消息， 所述触摸事件消息 包括触摸位置信息；
发送所述触摸事件消息给所述数字电视终端，以使得所述数字电视终端根 据所述触摸事件消息显示触轨。
2、 根据权利要求 1所述的多屏交互方法， 其特征在于， 所述监听对所述 触摸屏的触摸操作， 并生成触摸事件消息包括：
监听对所述触摸屏的单点或多点触摸操作， 并生成触摸事件消息， 所述触 摸事件消息还包括触摸动作信息。
3、 一种多屏交互方法， 其特征在于， 所述方法包括：
推送实时屏幕数据流给移动终端，以使得所述移动终端在触摸屏上播放所 述数据流；
接收所述移动终端实时监听所述触摸屏的触摸操作而生成的触摸事件消 息， 所述触摸事件消息包括触摸位置信息；
根据所述触摸事件消息显示触轨。
4、 根据权利要求 3所述的多屏交互方法， 其特征在于， 所述接收所述移动 终端实时监听所述触摸屏的触摸操作而生成的触摸事件消息包括：
接收所述移动终端实时监听所述触摸屏的单点或多点触摸操作而生成的 触摸事件消息， 所述触摸事件消息还包括触摸动作信息。
5、 根据权利要求 3或 4所述的多屏交互方法， 其特征在于， 所述根据所述 触摸事件消息显示触轨之后， 所述方法还包括：
判断所述触轨是否落入有效位置， 若落入， 则按照所述有效位置与按键指 令的对应关系， 获取所述有效位置的对应按键指令， 并进行与所述对应按键指 令相应的操作。
6、 一种移动终端， 其特征在于， 所述移动终端包括：
数据流接收模块， 用于接收数字电视终端推送的实时屏幕数据流， 并在触 摸屏上播放所述数据流；
消息生成模块，用于监听对所述触摸屏的触摸操作，并生成触摸事件消息， 所述触摸事件消息包括触摸位置信息；
消息发送模块， 用于发送所述触摸事件消息给所述数字电视终端， 以使得 所述数字电视终端根据所述触摸事件消息显示触轨。
7、 根据权利要求 6所述的移动终端， 其特征在于， 所述消息生成模块具体 用于：
监听对所述触摸屏的单点或多点触摸操作， 并生成触摸事件消息， 所述触 摸事件消息还包括触摸动作信息。
8、 一种数字电视终端， 其特征在于， 所述数字电视终端包括：
数据流推送模块， 用于推送实时屏幕数据流给移动终端， 以使得所述移动 终端在触摸屏上播放所述数据流；
消息接收模块，用于接收所述移动终端实时监听所述触摸屏的触摸操作而 生成的触摸事件消息， 所述触摸事件消息包括触摸位置信息；
触轨显示模块， 用于根据所述触摸事件消息显示触轨。
9、 根据权利要求 8所述的数字电视终端， 其特征在于， 所述消息接收模块 具体用于：
接收所述移动终端实时监听所述触摸屏的单点或多点触摸操作而生成的 触摸事件消息， 所述触摸事件消息还包括触摸动作信息。
10、 根据权利要求 8或 9所述的数字电视终端， 其特征在于， 所述数字电视 终端还包括：
操作模块，用于在触轨显示模块根据所述触摸事件消息中的触摸位置信息 显示触轨之后， 判断所述触轨是否落入有效位置， 若落入， 则按照所述有效位 置与按键指令的对应关系， 获取所述有效位置的对应按键指令， 并进行与所述 对应按键指令相应的操作。
11、 一种多屏交互系统， 其特征在于， 所述系统包括移动终端和数字电视 终端， 其中：
所述移动终端为权利要求 6或 7所述的移动终端；
所述数字电视终端为权利要求 8~10中任一项所述的数字电视终端。
PCT/CN2014/084321 2013-08-14 2014-08-13 一种多屏交互方法、终端及系统 WO2015021928A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201310353715.0 2013-08-14
CN2013103537150A CN103440099A (zh) 2013-08-14 2013-08-14 一种多屏交互方法、终端及系统

Publications (1)

Publication Number Publication Date
WO2015021928A1 true WO2015021928A1 (zh) 2015-02-19

Family

ID=49693790

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/084321 WO2015021928A1 (zh) 2013-08-14 2014-08-13 一种多屏交互方法、终端及系统

Country Status (2)

Country Link
CN (1) CN103440099A (zh)
WO (1) WO2015021928A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115348478A (zh) * 2022-07-25 2022-11-15 深圳市九洲电器有限公司 设备交互显示方法、装置、电子设备及可读存储介质

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103440099A (zh) * 2013-08-14 2013-12-11 深圳市同洲电子股份有限公司 一种多屏交互方法、终端及系统
CN103702159B (zh) * 2013-12-13 2017-12-08 乐视致新电子科技（天津）有限公司 人机交互控制方法、智能电视、穿戴式设备及系统
CN104765521B (zh) * 2014-01-07 2018-06-01 联想(北京)有限公司 一种信息处理的方法及一种装置
CN105573605A (zh) * 2014-10-10 2016-05-11 广州杰赛科技股份有限公司 一种手机与电脑互动游戏方法
CN104545997B (zh) * 2014-11-25 2017-09-22 深圳市理邦精密仪器股份有限公司 一种超声设备的多屏互动操作方法和系统
CN105120327B (zh) * 2015-02-04 2018-08-07 广州市智专信息科技有限公司 一种电子设备间的输入方法及相应的电子设备
CN105227986A (zh) * 2015-09-24 2016-01-06 小米科技有限责任公司 同步处理方法及装置
CN105933746A (zh) * 2016-06-20 2016-09-07 北京小米移动软件有限公司 控制播放设备的方法及装置
US10558288B2 (en) * 2016-07-07 2020-02-11 Samsung Display Co., Ltd. Multi-touch display panel and method of controlling the same
CN106453872A (zh) * 2016-09-28 2017-02-22 北京小米移动软件有限公司 显示控制方法和装置
CN108206836A (zh) * 2016-12-16 2018-06-26 乐视汽车（北京）有限公司 同步终端屏幕的动态画面至车机的方法、终端及系统
CN107071551B (zh) * 2017-04-26 2020-07-24 四川长虹电器股份有限公司 应用于智能电视系统中的多屏互动屏幕响应方法
CN108693997B (zh) * 2018-04-28 2020-08-04 广州视源电子科技股份有限公司 智能交互平板的触摸控制方法、装置及智能交互平板
CN109102335A (zh) * 2018-08-09 2018-12-28 佛山市苔藓云链科技有限公司 一种在服务器中执行媒体交互的方法
CN111467790B (zh) * 2020-04-13 2024-03-05 西安万像电子科技有限公司 目标对象的控制方法及装置、系统
CN111467791B (zh) * 2020-04-13 2024-04-12 西安万像电子科技有限公司 目标对象的控制方法及装置、系统
CN112714272A (zh) * 2020-12-14 2021-04-27 深圳市鹏创软件有限公司 设备间控制方法、终端和计算机可读存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102630057A (zh) * 2012-04-25 2012-08-08 青岛海信电器股份有限公司 多屏互动系统、智能终端及多屏互动控制方法
CN103150117A (zh) * 2013-03-21 2013-06-12 天脉聚源(北京)传媒科技有限公司 一种关闭应用或界面的方法及装置
JP5226142B1 (ja) * 2012-02-29 2013-07-03 株式会社東芝 表示制御装置、表示制御方法、電子機器、および電子機器の制御方法
CN103440099A (zh) * 2013-08-14 2013-12-11 深圳市同洲电子股份有限公司 一种多屏交互方法、终端及系统
US20140223490A1 (en) * 2013-02-07 2014-08-07 Shanghai Powermo Information Tech. Co. Ltd. Apparatus and method for intuitive user interaction between multiple devices

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102446049A (zh) * 2010-10-11 2012-05-09 梁宇杰 用外接显示设备显示信息的光标操作感应处理装置和方法
CN102520850A (zh) * 2011-11-29 2012-06-27 青岛海信移动通信技术股份有限公司 一种无线传屏中输入操作的处理方法及设备
CN102921171B (zh) * 2012-11-08 2015-08-19 上海仪电数字技术有限公司 智能mid、电视、游戏服务器、多屏游戏系统及方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5226142B1 (ja) * 2012-02-29 2013-07-03 株式会社東芝 表示制御装置、表示制御方法、電子機器、および電子機器の制御方法
CN102630057A (zh) * 2012-04-25 2012-08-08 青岛海信电器股份有限公司 多屏互动系统、智能终端及多屏互动控制方法
US20140223490A1 (en) * 2013-02-07 2014-08-07 Shanghai Powermo Information Tech. Co. Ltd. Apparatus and method for intuitive user interaction between multiple devices
CN103150117A (zh) * 2013-03-21 2013-06-12 天脉聚源(北京)传媒科技有限公司 一种关闭应用或界面的方法及装置
CN103440099A (zh) * 2013-08-14 2013-12-11 深圳市同洲电子股份有限公司 一种多屏交互方法、终端及系统

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115348478A (zh) * 2022-07-25 2022-11-15 深圳市九洲电器有限公司 设备交互显示方法、装置、电子设备及可读存储介质
CN115348478B (zh) * 2022-07-25 2023-09-19 深圳市九洲电器有限公司 设备交互显示方法、装置、电子设备及可读存储介质

Also Published As

Publication number Publication date
CN103440099A (zh) 2013-12-11

Similar Documents

Publication Publication Date Title
WO2015021928A1 (zh) 一种多屏交互方法、终端及系统
US9913301B2 (en) Content sharing method and device
US20210337246A1 (en) Apparatus and method for aggregating video streams into composite media content
WO2017173793A1 (zh) 一种视频投屏方法及装置
WO2020244266A1 (zh) 智能电视的远程控制方法、移动终端和智能电视
US9529738B2 (en) Method and system for sharing content, device and computer-readable recording medium for performing the method
US9086778B2 (en) Apparatus for controlling three-dimensional images
US9344758B2 (en) Video stream processing apparatus, method for displaying mirror video, and display device
WO2017008627A1 (zh) 多媒体直播方法、装置和系统
EP2858322B1 (en) Method and terminal for sharing media stream
CN107659712A (zh) 一种投屏的方法、装置及存储介质
US9736518B2 (en) Content streaming and broadcasting
US9756373B2 (en) Content streaming and broadcasting
WO2015096687A1 (zh) 移动通信终端控制智能电视播放视频文件的方法及装置
US9024894B1 (en) Remote control including touch-sensing surface
US10652622B2 (en) Method and apparatus for providing content based upon a selected language
US20140337883A1 (en) Method and apparatus for networking media content consumption status in a group of users
CN103809874A (zh) 一种针对智能终端的交互控制系统及方法
EP2775436A1 (en) Method and system for seamless navigation of content across different devices
US11153627B2 (en) System and method for switching video presentations between devices
US20160373804A1 (en) Systems and methods of displaying and navigating content based on dynamic icon mapping
WO2018010338A1 (zh) 显示方法和装置
WO2017181603A1 (zh) 一种视频显示方法及装置
WO2017092323A1 (zh) 一种主控设备、播放设备，及其数据传输方法
CN114465838A (zh) 显示设备、智能家居系统及多屏控制方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14836415

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14836415

Country of ref document: EP

Kind code of ref document: A1