WO2019062318A1 - 多屏互动操控同步响应方法及系统 - Google Patents

多屏互动操控同步响应方法及系统 Download PDF

Info

Publication number
WO2019062318A1
WO2019062318A1 PCT/CN2018/098059 CN2018098059W WO2019062318A1 WO 2019062318 A1 WO2019062318 A1 WO 2019062318A1 CN 2018098059 W CN2018098059 W CN 2018098059W WO 2019062318 A1 WO2019062318 A1 WO 2019062318A1
Authority
WO
WIPO (PCT)
Prior art keywords
top box
devices
set top
time
sensor data
Prior art date
Application number
PCT/CN2018/098059
Other languages
English (en)
French (fr)
Inventor
邓鹏�
Original Assignee
深圳市九洲电器有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市九洲电器有限公司 filed Critical 深圳市九洲电器有限公司
Publication of WO2019062318A1 publication Critical patent/WO2019062318A1/zh

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • H04N21/43637—Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04J—MULTIPLEX COMMUNICATION
    • H04J3/00—Time-division multiplex systems
    • H04J3/02—Details
    • H04J3/06—Synchronising arrangements
    • H04J3/0635—Clock or time synchronisation in a network
    • H04J3/0638—Clock or time synchronisation among nodes; Internode synchronisation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/14—Session management
    • H04L67/141—Setup of application sessions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/14—Session management
    • H04L67/143—Termination or inactivation of sessions, e.g. event-controlled end of session
    • H04L67/145—Termination or inactivation of sessions, e.g. event-controlled end of session avoiding end of session, e.g. keep-alive, heartbeats, resumption message or wake-up for inactive or interrupted session

Definitions

  • the solution relates to the field of communications, and in particular relates to a multi-screen interactive control synchronous response method and system.
  • Multi-screen interaction is to share the content of one device to another device to realize the interactive function of content sharing. For example, share the video that the mobile phone is watching into the set-top box, and then watch the content in the mobile phone through the TV; or share the video played by the set-top box to the mobile phone for viewing. Multi-screen interaction brings great convenience and fun to users.
  • the first aspect of the present application provides a multi-screen interactive control synchronization response method, including:
  • a wireless local area network is created by the set top box, and other devices establish a connection with the set top box through the wireless local area network to perform multi-screen interaction;
  • S20 establishing a heartbeat between the other device and the application on the set top box, sending the system time of the set top box to other devices for time calibration, and obtaining a time difference between the set top box system time and other device system time;
  • the control set top box only listens to the sensor category used by the current application, and sends the monitoring category to other devices, and controls other devices to only obtain sensor data of the listening category;
  • S50 Control the set top box to decompress the received sensor data packet to obtain sensor data, and distribute it to the corresponding application.
  • the second aspect of the present application provides a multi-screen interactive control synchronization response system, including:
  • Multi-screen interactive connection unit controls the creation of a wireless local area network by the set top box, and controls other devices to establish a connection with the set top box through the wireless local area network for multi-screen interaction;
  • the time calibration unit establishes a heartbeat between the other device and the application on the set top box, and sends the system time of the set top box to other devices for time calibration, and obtains the time difference between the set top box system time and other device system time;
  • the sensor category monitoring unit controls the set top box to only monitor the sensor category used by the current application, and sends the monitoring category to other devices, and controls other devices to only obtain sensor data of the listening category;
  • the data collection unit sets a data collection period, controls other devices to package all the sensor data acquired in the data collection period, and adds the time difference value and the data collection period to the set-top box.
  • the data decompression distribution unit controls the set top box to decompress the received sensor data packet to acquire the sensor data, and distributes the sensor data to the corresponding application.
  • a third aspect of the present application provides a computer readable storage medium storing a computer program that, when executed by a processor, implements the steps of the method as described above.
  • the multi-screen interactive control synchronous response method and system of the solution integrates other devices into the wireless local area network of the set top box and performs time proofreading, and other devices only acquire sensor data of the type used by the application, and collect sensor data of a data collection period.
  • the set-top box After being sent to the set-top box in a centralized manner, the set-top box is separately applied to the application, and the time difference calibration, sensor data filtering and sensor data centralized transmission are used to eliminate the delay problem existing in the multi-screen interaction, thereby greatly improving the synchronization of the multi-screen interactive control and controlling Simple, it brings great convenience to users and enhances the user experience.
  • Embodiment 1 is a flowchart of a multi-screen interactive control synchronization response method provided by Embodiment 1 of the present embodiment
  • FIG. 2 is a structural diagram of a multi-screen interactive control synchronous response system provided by Embodiment 2 of the present solution.
  • the method for feeding back the quality of the set-top box component in the present application includes the following steps:
  • a wireless local area network is created by the set top box, and other devices establish a connection with the set top box through the wireless local area network to perform multi-screen interaction.
  • the set-top box When multi-screen interaction, communication needs to be established between multiple devices, so as to reduce the occurrence of delay as much as possible.
  • the set-top box creates a wireless local area network, and other devices directly connect to the set-top box.
  • the WLAN establishes multi-screen interaction and communicates directly with the set-top box, thus reducing the interference of network factors.
  • the step is specifically: the other device establishes multi-screen interaction with the set top box through the UPNP protocol to communicate.
  • S20 Establish a heartbeat between the other device and the application on the set top box, send the system time of the set top box to other devices for time calibration, and obtain the time difference between the set top box system time and other device system time.
  • the first thing to ensure is that the system time of other devices is consistent with the system time of the set-top box, and the inconsistent time will cause serious delay.
  • This step establishes a heartbeat between the other device and the application on the set-top box, and the heartbeat is once every 5 seconds.
  • Sending the system time of the set-top box to other devices for time calibration is specifically: controlling the set-top box to continuously acquire its own system time several times and sending it to other devices, and other devices obtain the time difference value with each set-top box system time, and select the time difference value to appear. The most frequent is the final time difference value.
  • the set-top box sends 6 system times to other devices, and the time difference values obtained by other devices are 6ms, 7ms, 7ms, 7ms, 7ms, and 8ms, respectively, and the final time difference value is 7ms.
  • the control set top box only monitors the sensor category used by the current application, and sends the monitoring category to other devices, and controls other devices to only obtain sensor data of the listening category.
  • multi-screen interaction when interacting, other devices often pass all sensor data to the set-top box, and then the set-top box filters the sensor data, filters the required sensor data and transmits it to the set-top box application, because the sensor data is Real-time updates, and most other devices have a large number of sensors (gyroscope data, magnetic sensing data, touch data, infrared data, temperature data, etc.), so that the amount of data that other devices send to the set-top box through the wireless LAN every moment. Very large, this will increase the data processing time of other devices, and also increase the time of data processing of the set-top box, and the chance of network transmission time and data error is greatly increased, which is also important for delay and non-flux of multi-screen interactive operation.
  • this step controls the set-top box to only listen to the sensor category used by the current application and send it to other devices, and other devices only obtain sensor data of the listening category, which greatly optimizes the acquisition of sensor data, greatly reducing Amount of data Increased efficiency and greatly reduced latency.
  • S40 Set a data collection period, and other devices package all the sensor data acquired in the data collection period, and add the time difference value and the data collection period to be sent to the set top box.
  • the sensor data acquired by other devices is not sent to the set-top box in real time, but each data collection period (preferably, the data collection period is not more than 20ms, this will not affect the user's control.
  • the sensor data collected in the user is compressed into a package, and then collectively transferred to the set-top box, thus solving the problem caused by real-time transmission.
  • S50 Control the set top box to decompress the received sensor data packet to obtain sensor data, and distribute it to the corresponding application.
  • the set-top box After other devices send the data packet to the set-top box, the set-top box is controlled to complete the data decompression and distribution, and the multi-screen interactive control can be completed with the greatest possible synchronization.
  • the multi-screen interactive control synchronous response method connects other devices into the wireless local area network of the set top box and performs time proofreading, and other devices only acquire sensor data of the type used by the application, and then collect the sensor data of a data collection period and then concentrate. Sended to the set-top box, separated by the set-top box for application, through time difference calibration, sensor data filtering and sensor data centralized transmission to eliminate the delay problem in multi-screen interaction, greatly improving the synchronization of multi-screen interactive control, simple control, giving User use brings great convenience and enhances the user experience.
  • the embodiment 2 of the present application provides a multi-screen interactive control synchronization response system. For convenience of description, only the parts related to the present application are shown.
  • the multi-screen interactive control synchronization response system includes:
  • the multi-screen interactive connection unit 100 controls the creation of a wireless local area network by the set top box, and controls other devices to establish a connection with the set top box through the wireless local area network for multi-screen interaction.
  • the multi-screen interactive connection unit 100 controls the creation of a wireless local area network by the set-top box, and other devices.
  • the wireless LAN directly connected to the set-top box establishes multi-screen interaction and directly communicates with the set-top box, thus reducing the interference of network factors.
  • the multi-screen interactive connection unit 100 controls other devices to establish multi-screen interaction with the set top box through the UPNP protocol for communication.
  • the time calibration unit 200 establishes a heartbeat between the other device and the application on the set top box, and sends the system time of the set top box to other devices for time calibration, and obtains a time difference between the set top box system time and other device system time.
  • the time calibration unit 200 establishes a heartbeat between the other device and the application on the set top box, and the heartbeat is once every 5 seconds.
  • the time calibration unit 200 controls the set top box to continuously acquire its own system time several times and send it to other devices, control other devices to obtain the time difference value with each set top box system time, and select the time difference value occurrence number as the final time difference value.
  • the set-top box sends 6 system times to other devices, and the time difference values obtained by other devices are 6ms, 7ms, 7ms, 7ms, 7ms, and 8ms, respectively, and the final time difference value is 7ms.
  • the sensor category monitoring unit 300 controls the set top box to monitor only the sensor categories used by the current application, and sends the listening category to other devices, and controls other devices to only acquire sensor data of the listening category.
  • multi-screen interaction when interacting, other devices often pass all sensor data to the set-top box, and then the set-top box filters the sensor data, filters the required sensor data and transmits it to the set-top box application, because the sensor data is Real-time updates, and most other devices have a large number of sensors (gyroscope data, magnetic sensing data, touch data, infrared data, temperature data, etc.), so that the amount of data that other devices send to the set-top box through the wireless LAN every moment. Very large, this will increase the data processing time of other devices, and also increase the time of data processing of the set-top box, and the chance of network transmission time and data error is greatly increased, which is also important for delay and non-flux of multi-screen interactive operation.
  • the system sensor category monitoring unit 300 controls the set top box to only listen to the sensor category used by the current application and sends it to other devices, and other devices only obtain sensor data of the listening category, thus greatly optimizing the sensor data. Obtained , Greatly reducing the amount of data, increased efficiency and greatly reduced latency.
  • the data collection unit 400 sets a data collection period, and controls other devices to package all the sensor data acquired in the data collection period, and adds the time difference value and the data collection period to the set top box.
  • the data collection unit 400 optimizes, and the sensor data acquired by other devices is not sent to the set top box in real time, but each data collection period (preferably, data collection)
  • the sensor data collected in the period of no more than 20ms is compressed into a packet, and then collectively transmitted to the set-top box, thereby solving the problem caused by real-time transmission.
  • the data collection unit 400 needs to add a time difference value and a data collection period when controlling other devices to send data packets, thereby eliminating the difference in time.
  • the data decompression distribution unit 500 controls the set top box to decompress the received sensor data packet to acquire sensor data, and distributes the data to the corresponding application.
  • the data decompression distribution unit 500 controls the set top box to complete the data decompression and distribution, so that the multi-screen interactive control can be completed with the greatest possible synchronization.
  • the multi-screen interactive control synchronous response system connects other devices into the wireless local area network of the set top box and performs time proofreading. Other devices only acquire sensor data of the type used by the application, and then collect the sensor data of a data collection period and then concentrate. Sended to the set-top box, separated by the set-top box for application, through time difference calibration, sensor data filtering and sensor data centralized transmission to eliminate the delay problem in multi-screen interaction, greatly improving the synchronization of multi-screen interactive control, simple control, giving User use brings great convenience and enhances the user experience.
  • the multi-screen interactive control synchronous response method and system of the solution integrates other devices into the wireless local area network of the set top box and performs time proofreading, and other devices only acquire sensor data of the type used by the application, and collect sensor data of a data collection period.
  • the set-top box After being sent to the set-top box in a centralized manner, the set-top box is separately applied to the application, and the time difference calibration, sensor data filtering and sensor data centralized transmission are used to eliminate the delay problem existing in the multi-screen interaction, thereby greatly improving the synchronization of the multi-screen interactive control and controlling Simple, it brings great convenience to users and enhances the user experience.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Cardiology (AREA)
  • Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Selective Calling Equipment (AREA)
  • Telephonic Communication Services (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

本方案涉及一种多屏互动操控同步响应方法及系统，将其他设备连入机顶盒的无线局域网中，并进行时间校对，其他设备只获取应用所使用类型的传感器数据，并且在收集一个数据收集周期的传感器数据后再集中发送给机顶盒，由机顶盒分开给应用，通过时间差异校准、传感器数据过滤及传感器数据集中发送来消除多屏互动中存在的延时问题，大大提高了多屏互动操控的同步性，操控简单，给用户使用带来极大便利，增强用户的使用体验。

Description

多屏互动操控同步响应方法及系统 技术领域
本方案涉及通信领域，尤其涉及一种多屏互动操控同步响应方法及系统。
 背景技术
随着科技的发展以及三网融合进程的加速，多种终端设备（手机、PAD等）都具备与电视设备（电视或者机顶盒）进行网络互联、互相通信，实现多屏互动的功能。多屏互动就是将一种设备中的内容分享到另外的设备中，实现内容共享的互动功能。比如，将手机正在看的视频分享到机顶盒中，然后通过电视观看手机中的内容；或者将机顶盒播放的视频分享到手机上进行观看。多屏互动给用户带来极大的方便和乐趣。
但是，目前的多屏互动设备之间互相的操控存在非常大的延时，导致不同步的问题非常明显，尤其是对于需要实时操作的应用，比如游戏类，例如将机顶盒安装的赛车游戏多屏互动到手机，通过手机重力感应实现对机顶盒上赛车游戏的操控，延时非常大，操控非常困难，延时给用户使用造成极大的不便，严重影响用户的使用。
 技术问题
有鉴于此，有必要针对上述多屏互动操控存在很大延时、不同步的问题，提供一种多屏互动操控同步响应方法及系统。
 技术解决方案
本申请第一方面提供了一种多屏互动操控同步响应方法，包括：
S10：由机顶盒创建无线局域网，其他设备通过无线局域网与机顶盒建立连接进行多屏互动；
S20：将其他设备与机顶盒上应用建立心跳，将机顶盒的系统时间发送至其他设备进行时间校准，获取机顶盒系统时间与其他设备系统时间的时间差异值；
S30：控制机顶盒只监听当前应用所使用到的传感器类别，并将监听类别发送至其他设备，控制其他设备只获取监听类别的传感器数据；
S40：设置一个数据收集周期，其他设备将数据收集周期内获取的所有传感器数据进行打包，并加上时间差异值和数据收集周期后集中发给机顶盒；
S50：控制机顶盒解压收到的传感器数据包获取传感器数据，并分发给相应的应用。
本申请第二方面提供一种多屏互动操控同步响应系统，包括：
多屏互动连接单元，控制由机顶盒创建无线局域网，并控制其他设备通过无线局域网与机顶盒建立连接进行多屏互动；
时间校准单元，将其他设备与机顶盒上应用建立心跳，并将机顶盒的系统时间发送至其他设备进行时间校准，获取机顶盒系统时间与其他设备系统时间的时间差异值；
传感器类别监听单元，控制机顶盒只监听当前应用所使用到的传感器类别，并将监听类别发送至其他设备，控制其他设备只获取监听类别的传感器数据；
数据收集单元，设置一个数据收集周期，控制其他设备将数据收集周期内获取的所有传感器数据进行打包，并加上时间差异值和数据收集周期后集中发给机顶盒；
数据解压分发单元，控制机顶盒解压收到的传感器数据包获取传感器数据，并分发给相应的应用。
本申请第三方面提供了一种计算机可读存储介质，所述计算机可读存储介质存储有计算机程序，所述计算机程序被处理器执行时实现如上所述方法的步骤。
 有益效果
本方案多屏互动操控同步响应方法及系统，将其他设备连入机顶盒的无线局域网中，并进行时间校对，其他设备只获取应用所使用类型的传感器数据，并且在收集一个数据收集周期的传感器数据后再集中发送给机顶盒，由机顶盒分开给应用，通过时间差异校准、传感器数据过滤及传感器数据集中发送来消除多屏互动中存在的延时问题，大大提高了多屏互动操控的同步性，操控简单，给用户使用带来极大便利，增强用户的使用体验。
 附图说明
为了更清楚地说明本申请实施例中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本申请的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动性的前提下，还可以根据这些附图获得其它的附图。
图1为本方案实施例1提供的多屏互动操控同步响应方法的流程图；
图2为本方案实施例2提供的多屏互动操控同步响应系统的结构图。
 本发明的实施方式
以下描述中，为了说明而不是为了限定，提出了诸如特定系统结构、技术之类的具体细节，以便透彻理解本申请实施例。然而，本领域的技术人员应当清楚，在没有这些具体细节的其它实施例中也可以实现本申请。在其它情况中，省略对众所周知的系统、装置、电路以及方法的详细说明，以免不必要的细节妨碍本申请的描述。
为了说明本申请上述的技术方案，下面通过具体实施例来进行说明。
实施例1：
下面对本方案实施例1提供多屏互动操控同步响应的方法进行描述，请参阅附图1，本申请中的机顶盒元器件质量反馈方法包括步骤：
S10：由机顶盒创建无线局域网，其他设备通过无线局域网与机顶盒建立连接进行多屏互动。
多屏互动时，多个设备之间需要建立通信，为尽可能的减少延时的发生，该步骤其他设备与机顶盒在建立多屏互动时，由机顶盒创建无线局域网，其他设备直接连入机顶盒的无线局域网建立多屏互动，与机顶盒进行直接的通信，这样就减少网络因素的干扰。
进一步的，该步骤具体为：其他设备通过UPNP协议与机顶盒建立多屏互动进行通信。
S20：将其他设备与机顶盒上应用建立心跳，将机顶盒的系统时间发送至其他设备进行时间校准，获取机顶盒系统时间与其他设备系统时间的时间差异值。
其他设备与机顶盒建立多屏互动后，为避免延时首先需要保证的就是其他设备系统时间与机顶盒的系统时间保持一致，时间不一致将导致严重的延时。该步骤将其他设备与机顶盒上应用建立心跳，每不高于5秒心跳一次。
将机顶盒的系统时间发送至其他设备进行时间校准具体为：控制由机顶盒连续获取几次自身系统时间并发送至其他设备，其他设备获取与每次机顶盒系统时间的时间差异值，选择时间差异值出现次数最多的作为最终的时间差异值。例如，机顶盒发送6次系统时间给其他设备，其他设备获取的时间差异值分别为6ms、7ms、7ms、7ms、7ms和8ms，那么最终的时间差异值为7ms。
S30：控制机顶盒只监听当前应用所使用到的传感器类别，并将监听类别发送至其他设备，控制其他设备只获取监听类别的传感器数据。
目前的多屏互动，在互动时其他设备往往是将所有的传感器数据全部传递给机顶盒，然后由机顶盒将传感器数据过滤处理，将需要的传感器数据过滤出来再传递给机顶盒端应用，由于传感器数据是实时更新的，而其他设备大都具备的传感器非常多（陀螺仪数据、磁力感应数据、触摸数据、红外数据、温度数据等等），这样每时每刻其他设备通过无线局域网发送到机顶盒的数据量非常大，这就会增加其他设备数据处理时间，也会增加机顶盒数据处理的时间，同时造成网络传输的时间与数据出错的几率大大增加，这也是导致多屏互动操作延时和不流畅的重要因素，为解决这个问题，该步骤控制机顶盒只监听当前应用所使用到的传感器类别发给其他设备，其他设备也只获取监听类别的传感器数据，这样就极大优化了传感器数据的获取，大大减少了数据量，增加了效率，大大降低了延时。
S40：设置一个数据收集周期，其他设备将数据收集周期内获取的所有传感器数据进行打包，并加上时间差异值和数据收集周期后集中发给机顶盒。
由于传感器数据触发的时间是非固定的，目前多屏互动其他设备都是一有传感器数据就立即直接发送到机顶盒，而有些机顶盒应用功能是需要几个传感器同时生效才有响应，机顶盒某个时间可能先收到某个传感器数据，然后就分发到应用，将导致应用不响应其他设备的操控。同时由于数据的随机性在不同网络情况下可能会存在数据丢失的情况，且不容易恢复，这都会导致多屏互动操控延时或者失败。为了避免这些问题，同时增加多屏互动的鲁棒性，该步骤进行优化，其他设备获取的传感器数据并不是实时发送到机顶盒，而是将每个数据收集周期（优选的，数据收集周期不大于20ms，这样不会影响用户操控）内所搜集的传感器数据压缩成一个包，然后再一起集中传递到机顶盒，从而解决实时发送所带来的问题。
为消除延时，其他设备发送数据包时需要加上时间差异值和数据收集周期，消除时间上的差异。
S50：控制机顶盒解压收到的传感器数据包获取传感器数据，并分发给相应的应用。
其他设备将数据包发送到机顶盒后，则控制机顶盒完成数据解压和分发，即可最大可能的同步完成多屏互动操控。
该多屏互动操控同步响应方法，将其他设备连入机顶盒的无线局域网中，并进行时间校对，其他设备只获取应用所使用类型的传感器数据，并且在收集一个数据收集周期的传感器数据后再集中发送给机顶盒，由机顶盒分开给应用，通过时间差异校准、传感器数据过滤及传感器数据集中发送来消除多屏互动中存在的延时问题，大大提高了多屏互动操控的同步性，操控简单，给用户使用带来极大便利，增强用户的使用体验。
实施例2：
本申请实施例2提供一种多屏互动操控同步响应系统，为了便于说明，仅示出与本申请相关的部分，如图2所示，上述多屏互动操控同步响应系统包括：
多屏互动连接单元100，控制由机顶盒创建无线局域网，并控制其他设备通过无线局域网与机顶盒建立连接进行多屏互动。
多屏互动时，多个设备之间需要建立通信，为尽可能的减少延时的发生，其他设备与机顶盒在建立多屏互动时，多屏互动连接单元100控制由机顶盒创建无线局域网，其他设备直接连入机顶盒的无线局域网建立多屏互动，与机顶盒进行直接的通信，这样就减少网络因素的干扰。
进一步的，多屏互动连接单元100控制其他设备通过UPNP协议与机顶盒建立多屏互动进行通信。
时间校准单元200，将其他设备与机顶盒上应用建立心跳，并将机顶盒的系统时间发送至其他设备进行时间校准，获取机顶盒系统时间与其他设备系统时间的时间差异值。
其他设备与机顶盒建立多屏互动后，为避免延时首先需要保证的就是其他设备系统时间与机顶盒的系统时间保持一致，时间不一致将导致严重的延时。时间校准单元200将其他设备与机顶盒上应用建立心跳，每不高于5秒心跳一次。
时间校准单元200控制机顶盒连续获取几次自身系统时间并发送至其他设备，控制其他设备获取与每次机顶盒系统时间的时间差异值，选择时间差异值出现次数最多的作为最终的时间差异值。例如，机顶盒发送6次系统时间给其他设备，其他设备获取的时间差异值分别为6ms、7ms、7ms、7ms、7ms和8ms，那么最终的时间差异值为7ms。
传感器类别监听单元300，控制机顶盒只监听当前应用所使用到的传感器类别，并将监听类别发送至其他设备，控制其他设备只获取监听类别的传感器数据。
目前的多屏互动，在互动时其他设备往往是将所有的传感器数据全部传递给机顶盒，然后由机顶盒将传感器数据过滤处理，将需要的传感器数据过滤出来再传递给机顶盒端应用，由于传感器数据是实时更新的，而其他设备大都具备的传感器非常多（陀螺仪数据、磁力感应数据、触摸数据、红外数据、温度数据等等），这样每时每刻其他设备通过无线局域网发送到机顶盒的数据量非常大，这就会增加其他设备数据处理时间，也会增加机顶盒数据处理的时间，同时造成网络传输的时间与数据出错的几率大大增加，这也是导致多屏互动操作延时和不流畅的重要因素，为解决这个问题，该系统传感器类别监听单元300控制机顶盒只监听当前应用所使用到的传感器类别发给其他设备，其他设备也只获取监听类别的传感器数据，这样就极大优化了传感器数据的获取，大大减少了数据量，增加了效率，大大降低了延时。
数据收集单元400，设置一个数据收集周期，控制其他设备将数据收集周期内获取的所有传感器数据进行打包，并加上时间差异值和数据收集周期后集中发给机顶盒。
由于传感器数据触发的时间是非固定的，目前多屏互动其他设备都是一有传感器数据就立即直接发送到机顶盒，而有些机顶盒应用功能是需要几个传感器同时生效才有响应，机顶盒某个时间可能先收到某个传感器数据，然后就分发到应用，将导致应用不响应其他设备的操控。同时由于数据的随机性在不同网络情况下可能会存在数据丢失的情况，且不容易恢复，这都会导致多屏互动操控延时或者失败。为了避免这些问题，同时增加多屏互动的鲁棒性，数据收集单元400进行优化，控制其他设备获取的传感器数据并不实时发送到机顶盒，而是将每个数据收集周期（优选的，数据收集周期不大于20ms）内所搜集的传感器数据压缩成一个包，然后再一起集中传递到机顶盒，从而解决实时发送所带来的问题。
为消除延时，数据收集单元400控制其他设备发送数据包时需要加上时间差异值和数据收集周期，消除时间上的差异。
数据解压分发单元500，控制机顶盒解压收到的传感器数据包获取传感器数据，并分发给相应的应用。
其他设备将数据包发送到机顶盒后，数据解压分发单元500则控制机顶盒完成数据解压和分发，即可最大可能的同步完成多屏互动操控。
该多屏互动操控同步响应系统，将其他设备连入机顶盒的无线局域网中，并进行时间校对，其他设备只获取应用所使用类型的传感器数据，并且在收集一个数据收集周期的传感器数据后再集中发送给机顶盒，由机顶盒分开给应用，通过时间差异校准、传感器数据过滤及传感器数据集中发送来消除多屏互动中存在的延时问题，大大提高了多屏互动操控的同步性，操控简单，给用户使用带来极大便利，增强用户的使用体验。
本方案多屏互动操控同步响应方法及系统，将其他设备连入机顶盒的无线局域网中，并进行时间校对，其他设备只获取应用所使用类型的传感器数据，并且在收集一个数据收集周期的传感器数据后再集中发送给机顶盒，由机顶盒分开给应用，通过时间差异校准、传感器数据过滤及传感器数据集中发送来消除多屏互动中存在的延时问题，大大提高了多屏互动操控的同步性，操控简单，给用户使用带来极大便利，增强用户的使用体验。
以上仅为本方案的较佳实施例而已，并不用以限制本方案，凡在本方案的精神和原则之内所作的任何修改、等同替换和改进等，均应包含在本方案的保护范围之内。

Claims (11)

  1. 一种多屏互动操控同步响应方法，其特征在于，包括如下步骤：
    S10：由机顶盒创建无线局域网，其他设备通过无线局域网与机顶盒建立连接进行多屏互动；
    S20：将其他设备与机顶盒上应用建立心跳，将机顶盒的系统时间发送至其他设备进行时间校准，获取机顶盒系统时间与其他设备系统时间的时间差异值；
    S30：控制机顶盒只监听当前应用所使用到的传感器类别，并将监听类别发送至其他设备，控制其他设备只获取监听类别的传感器数据；
    S40：设置一个数据收集周期，其他设备将数据收集周期内获取的所有传感器数据进行打包，并加上时间差异值和数据收集周期后集中发给机顶盒；
    S50：控制机顶盒解压收到的传感器数据包获取传感器数据，并分发给相应的应用。
  2. 根据权利要求1所述的多屏互动操控同步响应方法，其特征在于，所述步骤S10具体为：其他设备通过UPNP协议与机顶盒建立多屏互动进行通信。
  3. 根据权利要求1所述的多屏互动操控同步响应方法，其特征在于，所述步骤S20具体为：其他设备与机顶盒上应用建立心跳，每不高于5秒心跳一次。
  4. 根据权利要求1所述的多屏互动操控同步响应方法，其特征在于，所述步骤S20具体为：控制由机顶盒连续获取几次自身系统时间并发送至其他设备，其他设备获取与每次机顶盒系统时间的时间差异值，选择时间差异值出现次数最多的作为最终的时间差异值。
  5. 根据权利要求1所述的多屏互动操控同步响应方法，其特征在于，所述数据收集周期不大于20ms。
  6. 一种多屏互动操控同步响应系统，其特征在于，包括：
    多屏互动连接单元，控制由机顶盒创建无线局域网，并控制其他设备通过无线局域网与机顶盒建立连接进行多屏互动；
    时间校准单元，将其他设备与机顶盒上应用建立心跳，并将机顶盒的系统时间发送至其他设备进行时间校准，获取机顶盒系统时间与其他设备系统时间的时间差异值；
    传感器类别监听单元，控制机顶盒只监听当前应用所使用到的传感器类别，并将监听类别发送至其他设备，控制其他设备只获取监听类别的传感器数据；
    数据收集单元，设置一个数据收集周期，控制其他设备将数据收集周期内获取的所有传感器数据进行打包，并加上时间差异值和数据收集周期后集中发给机顶盒；
    数据解压分发单元，控制机顶盒解压收到的传感器数据包获取传感器数据，并分发给相应的应用。
  7. 根据权利要求6所述的多屏互动操控同步响应系统，其特征在于，所述多屏互动连接单元控制其他设备通过UPNP协议与机顶盒建立多屏互动进行通信。
  8. 根据权利要求6所述的多屏互动操控同步响应系统，其特征在于，所述时间校准单元将其他设备与机顶盒上应用建立心跳，每不高于5秒心跳一次。
  9. 根据权利要求6所述的多屏互动操控同步响应系统，其特征在于，所述时间校准单元控制由机顶盒连续获取几次自身系统时间并发送至其他设备，其他设备获取与每次机顶盒系统时间的时间差异值，选择时间差异值出现次数最多的作为最终的时间差异值。
  10. 根据权利要求6所述的多屏互动操控同步响应系统，其特征在于，所述数据收集周期不大于20ms。
  11. 一种计算机可读存储介质，所述计算机可读存储介质存储有计算机程序，其特征在于，所述计算机程序被处理器执行时实现如权利要求1至5中任一项所述方法的步骤。
PCT/CN2018/098059 2017-09-28 2018-08-01 多屏互动操控同步响应方法及系统 WO2019062318A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710899838.2 2017-09-28
CN201710899838.2A CN107750010A (zh) 2017-09-28 2017-09-28 多屏互动操控同步响应方法及系统

Publications (1)

Publication Number Publication Date
WO2019062318A1 true WO2019062318A1 (zh) 2019-04-04

Family

ID=61255099

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/098059 WO2019062318A1 (zh) 2017-09-28 2018-08-01 多屏互动操控同步响应方法及系统

Country Status (2)

Country Link
CN (1) CN107750010A (zh)
WO (1) WO2019062318A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111031374A (zh) * 2019-12-26 2020-04-17 大庆思特传媒科技有限公司 多计算机视频和软件同步运行控制系统和方法

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107750010A (zh) * 2017-09-28 2018-03-02 深圳市九洲电器有限公司 多屏互动操控同步响应方法及系统

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120127831A1 (en) * 2010-11-24 2012-05-24 Samsung Electronics Co., Ltd. Position determination of devices using stereo audio
CN103491422A (zh) * 2013-09-17 2014-01-01 深圳市九洲电器有限公司 一种机顶盒进行信息共享的方法及系统
CN103517108A (zh) * 2012-06-29 2014-01-15 深圳市快播科技有限公司 智能电视播放设备、移动终端、体感功能实现方法及系统
CN104506916A (zh) * 2014-12-12 2015-04-08 深圳市天威视讯股份有限公司 机顶盒与智能移动终端的交互方法及其装置
CN106604085A (zh) * 2016-12-19 2017-04-26 天脉聚源(北京)传媒科技有限公司 一种视频分享方法及装置
CN106686576A (zh) * 2015-11-11 2017-05-17 中兴通讯股份有限公司 终端用户状态获取方法、装置和系统
CN107750010A (zh) * 2017-09-28 2018-03-02 深圳市九洲电器有限公司 多屏互动操控同步响应方法及系统

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120127831A1 (en) * 2010-11-24 2012-05-24 Samsung Electronics Co., Ltd. Position determination of devices using stereo audio
CN103517108A (zh) * 2012-06-29 2014-01-15 深圳市快播科技有限公司 智能电视播放设备、移动终端、体感功能实现方法及系统
CN103491422A (zh) * 2013-09-17 2014-01-01 深圳市九洲电器有限公司 一种机顶盒进行信息共享的方法及系统
CN104506916A (zh) * 2014-12-12 2015-04-08 深圳市天威视讯股份有限公司 机顶盒与智能移动终端的交互方法及其装置
CN106686576A (zh) * 2015-11-11 2017-05-17 中兴通讯股份有限公司 终端用户状态获取方法、装置和系统
CN106604085A (zh) * 2016-12-19 2017-04-26 天脉聚源(北京)传媒科技有限公司 一种视频分享方法及装置
CN107750010A (zh) * 2017-09-28 2018-03-02 深圳市九洲电器有限公司 多屏互动操控同步响应方法及系统

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111031374A (zh) * 2019-12-26 2020-04-17 大庆思特传媒科技有限公司 多计算机视频和软件同步运行控制系统和方法

Also Published As

Publication number Publication date
CN107750010A (zh) 2018-03-02

Similar Documents

Publication Publication Date Title
CN106165368B (zh) 实时传输协议的流送控制
US9497516B2 (en) Remote control via local area network
CN106792055A (zh) 实时投屏方法、设备及系统
CN104254007B (zh) 一种音频处理方法及装置
CN103166941B (zh) 一种数据分享的方法及装置
CN105187871B (zh) 一种基于nfc的移动终端数据传输电视终端的方法及系统
CN105828213A (zh) 用于减少呈现等待时间的分配器、输出设备和方法
CN105430459B (zh) 音频数据播放方法、装置及智能电视机
CN107950036B (zh) 用于控制无线扬声器的音频棒
CN105094638A (zh) 移动终端与智能家居设备的图片屏幕共享方法及移动终端
JP2014513903A (ja) ネットワーキング方法、サーバ装置およびクライアント装置
CN103634657B (zh) 电视同步移动终端wifi连接设置的方法和装置
CN104156258B (zh) 一种应用程序的共享操作方法、相关设备和系统
CN104065401B (zh) 基于hid蓝牙模块语音传输方法及hid蓝牙语音通信装置
CN104333788A (zh) 无接口电视、无线盒子、无接口电视系统及播放控制方法
WO2019062318A1 (zh) 多屏互动操控同步响应方法及系统
CN102571735A (zh) 一种多终端进行应用处理的方法、装置及系统
CN111654742A (zh) 一种远程智能联动投屏方法及系统
CN102802081A (zh) 基于智能电视终端与手持设备实现虚拟外设的方法
CN108513159A (zh) 多终端同步播放控制方法、主设备、装置及系统
JP2001170360A (ja) 対戦ゲーム観戦システム
CN109756744A (zh) 数据处理方法、电子设备及计算机存储介质
CN103095535A (zh) 操作请求处理方法、家庭网络系统及设备
CN202617263U (zh) 一种双画面显示的音频处理装置
CN104935571B (zh) 一种电视游戏服务端与客户端的交互方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18861546

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 07.09.2020)

122 Ep: pct application non-entry in european phase

Ref document number: 18861546

Country of ref document: EP

Kind code of ref document: A1