WO2015018185A1 - 实现分布式遥控的方法、装置及其电视端和移动终端 - Google Patents

实现分布式遥控的方法、装置及其电视端和移动终端 Download PDF

Info

Publication number
WO2015018185A1
WO2015018185A1 PCT/CN2014/070740 CN2014070740W WO2015018185A1 WO 2015018185 A1 WO2015018185 A1 WO 2015018185A1 CN 2014070740 W CN2014070740 W CN 2014070740W WO 2015018185 A1 WO2015018185 A1 WO 2015018185A1
Authority
WO
WIPO (PCT)
Prior art keywords
remote control
mobile terminal
signal
television
real
Prior art date
Application number
PCT/CN2014/070740
Other languages
English (en)
French (fr)
Inventor
韦泽垠
王凌晨
Original Assignee
深圳Tcl新技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳Tcl新技术有限公司 filed Critical 深圳Tcl新技术有限公司
Priority to EP14816093.0A priority Critical patent/EP2869584B1/en
Priority to US14/411,398 priority patent/US20160105706A1/en
Publication of WO2015018185A1 publication Critical patent/WO2015018185A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/4227—Providing Remote input by a user located remotely from the client device, e.g. at work
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4126—The peripheral being portable, e.g. PDAs or mobile phones
    • H04N21/41265—The peripheral being portable, e.g. PDAs or mobile phones having a remote control device for bidirectional communication between the remote control device and client device
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/441—Acquiring end-user identification, e.g. using personal code sent by the remote control or by inserting a card
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/441—Acquiring end-user identification, e.g. using personal code sent by the remote control or by inserting a card
    • H04N21/4415—Acquiring end-user identification, e.g. using personal code sent by the remote control or by inserting a card using biometric characteristics of the user, e.g. by voice recognition or fingerprint scanning
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213—Monitoring of end-user related data
    • H04N21/44218—Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/475—End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data
    • H04N21/4755—End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data for defining user preferences, e.g. favourite actors or genre

Definitions

  • the present invention relates to the field of television technologies, and in particular, to a method and apparatus for implementing distributed remote control, and a television terminal and a mobile terminal thereof.
  • the TV is an access center, and all kinds of video devices in the home are uniformly connected to the TV. After the installation is arranged, there is no need to move anymore.
  • the video stream sharing function of the home private cloud of the TV can be Share these real-time content streams to other screened devices in the home, including additional TVs or mobile phones or tablets.
  • the main object of the present invention is to provide a method and device for implementing distributed remote control, and a television terminal and a mobile terminal thereof, aiming at solving a remote control request initiated by a content providing device in different spaces when a user separates a real-time content stream of a television. , realize remote synchronization of time domain in space.
  • the present invention provides a method for implementing distributed remote control, comprising the following steps:
  • Step A establishing a network connection between the television end and the mobile terminal
  • Step B The television end sends a real-time content signal to the mobile terminal, and monitors the remote control request of the mobile terminal;
  • Step C The mobile terminal receives the real-time content signal to obtain a real-time video program from the television end, and sends a remote control request signal to the television end;
  • Step D The television end receives the remote control request signal sent by the mobile terminal, and sends a corresponding response signal to the mobile terminal according to the user response of the television end and the presence of the user, and the response signal includes a reject signal, an idle signal, and a busy signal;
  • Step E The mobile terminal receives the response signal of the television end, and enters the following processing steps according to the type of the response signal:
  • Step E1 If the response signal is a rejection signal, indicating that the television terminal directly rejects the remote control request, the remote control request process is ended;
  • Step E2 If the response signal is an idle signal, indicating that no user is watching on the television end, the corresponding remote control code is sent to the real-time content providing device through the IR forwarding module of the television end, and then the remote control request process is ended and the free remote control mode is entered;
  • Step E3 If the response signal is a busy signal, indicating that the user is watching before the television end, the mobile terminal sends an application control right signal to the television end, and if the television end sends the permission remote control signal to the mobile terminal, enters the free remote control mode; The terminal sends a rejection remote control signal to the mobile terminal, and ends the remote control request process.
  • the step D specifically includes:
  • Step D1 The television end receives a remote control request signal sent by the mobile terminal
  • Step D2 popping up on the television side whether to reject the remote control request prompt box for the television end user to select, if the user chooses to reject, then proceeds to step D3, if the user does not choose to reject, then enter D4;
  • Step D3 The television end sends a rejection signal to the mobile terminal.
  • Step D4 the television end detects whether the user is watching before the television end, if it is not detected that the user is watching, then proceeds to step D5, if it is detected that the user is watching, then enter D6;
  • Step D5 The television end sends an idle signal to the mobile terminal.
  • Step D6 The television end sends a busy signal to the mobile terminal.
  • the step of detecting, by the television end, whether the user is watching before the television end is specifically: the television end starts the user detection module, collects a group of images in front of the television end, and performs post-processing on the group of images, and then performs the person Face recognition to analyze whether there is a user present in the image.
  • the step of sending the corresponding remote control code to the content providing device by the IR forwarding module of the television end comprises: the television end acquiring the device ID of the real-time content providing device by using the real-time content providing device ID identification module, and providing the device according to the real-time content
  • the device ID parses the control original code corresponding to the remote control request signal sent by the mobile terminal, and then sends the control original code to the real-time content providing device through the IR forwarding module.
  • the step E3 specifically includes:
  • the television terminal sends the user image before the television terminal to the main window of the mobile terminal video for display;
  • the mobile terminal sends an application control right signal to the television terminal;
  • the television terminal After receiving the application control right signal, the television terminal pops up whether to allow the remote control selection box for the user to select. If the user selects yes, the television terminal sends an allowable remote control signal to the mobile terminal, and the mobile terminal obtains the allowed remote control signal of the television end, and then enters the free remote control. If the user selects No, the TV terminal sends a rejection remote control signal to the mobile terminal, and after the mobile terminal acquires the remote control signal of the television terminal, the remote control request process ends.
  • the invention also provides a device for realizing distributed remote control, comprising a television terminal and a mobile terminal establishing a network connection with the television terminal;
  • the television end is configured to: send a real-time content signal to the mobile terminal, and monitor a remote control request of the mobile terminal; receive a remote control request signal sent by the mobile terminal, and send a corresponding response signal to the mobile terminal according to the user response of the television end and the presence of the user.
  • the response signal includes a reject signal, an idle signal, and a busy signal; and after transmitting the idle signal to the mobile terminal, transmitting the corresponding remote control code to the real-time content providing device; and after receiving the application control right signal sent by the mobile terminal, according to the user Selecting to send an allow remote control signal or reject the remote control signal to the mobile terminal;
  • the mobile terminal is configured to: receive a real-time content signal sent by the television end to obtain a real-time video program from the television end, and send a remote control request signal to the television end; end the current remote control request process after receiving the rejection signal; After the idle signal, the remote control request process is ended and the free remote control mode is entered; after receiving the busy signal, the application control signal is sent to the television; after receiving the permission remote control signal, the free remote control mode is entered; and the remote control signal is received. After the end of this remote request process.
  • the television end is further configured to: after receiving the remote control request signal sent by the mobile terminal, pop up a prompt box for rejecting the remote control request on the television end for the television end user to select; when the user selects to respond to whether to reject the remote control request Sending a rejection signal to the mobile terminal; detecting whether the user is watching before the television end when the user does not choose to reject the remote control request; sending an idle signal to the mobile terminal when no user is being watched; and detecting that the user is watching Sending a busy signal to the mobile terminal, and transmitting the user image before the television terminal to the video main window of the mobile terminal for display.
  • the television end starts a user detection module, collects a group of images in front of the television end and performs post-processing on the group of images, and then performs face recognition to analyze whether there is a user present in the image.
  • the television end acquires the device ID of the real-time content providing device by using the real-time content providing device ID identification module, and parses the control original code corresponding to the remote control request signal sent by the mobile terminal according to the device ID of the real-time content providing device, and then The control original code is sent to the real-time content providing device through the IR forwarding module.
  • the television end is further configured to send a user image before the television terminal to a main window of the mobile terminal video for display.
  • the television end is further configured to: after receiving the application control right signal sent by the mobile terminal, pop up whether to allow the remote control selection box for the user to select, after receiving the remote control selection box according to the signal selected by the user for feedback Send an allow remote control signal or reject the remote control signal to the mobile terminal.
  • the present invention further provides a television terminal used in the foregoing apparatus for implementing distributed remote control, the television end comprising a television end network connection module, a remote control request monitoring and processing module, an IR forwarding module, and a real-time content stream encoding module;
  • the television end network connection module is configured to establish a network connection with the mobile terminal to exchange data, and is configured to communicate with the remote control request monitoring and processing module, and receive and send an instruction of the remote control request monitoring and processing module;
  • the remote control request monitoring and processing module is configured to monitor the remote control request of the mobile terminal, and after receiving the remote control request signal sent by the mobile terminal, generate a corresponding response signal according to the user response of the television end and the user presence condition, and connect the module through the television end network Sending to the mobile terminal, the response signal includes a reject signal, an idle signal, and a busy signal, for establishing a free remote connection with the mobile terminal when no user is watching on the television end, and for using the mobile terminal when the television end user allows the mobile terminal to control Establish a free remote connection;
  • the IR forwarding module is configured to send an infrared code instruction to the real-time content providing device
  • the real-time content stream encoding module is configured to encode a video audio stream input by the real-time content providing device to form a real-time content signal and send the data to the mobile terminal through a television end network connection module.
  • the remote control request monitoring and processing module is further configured to: after receiving the remote control request signal sent by the mobile terminal, pop up a prompt box for rejecting the remote control request on the television end for the television end user to select, and for receiving the application After the control signal, whether the remote control selection box is allowed for the TV end user to select.
  • the television end further includes a user detection module, configured to collect a group of images in front of the television end when the instruction of the remote control request monitoring and processing module arrives, and analyze the image according to the set of images. Whether there is a user who is watching, and output the analysis result to the remote control request monitoring and processing module.
  • a user detection module configured to collect a group of images in front of the television end when the instruction of the remote control request monitoring and processing module arrives, and analyze the image according to the set of images. Whether there is a user who is watching, and output the analysis result to the remote control request monitoring and processing module.
  • the television end further includes a real-time content providing device ID identifying module
  • the real-time content providing device ID identifying module is configured to acquire a device ID of the real-time content providing device, and parse the mobile according to the device ID of the real-time content providing device
  • the control original code corresponding to the remote control request signal sent by the terminal, and then the control original code is sent to the real-time content providing device through the IR forwarding module.
  • the present invention further provides a mobile terminal used in the foregoing apparatus for implementing distributed remote control, the mobile terminal comprising a mobile terminal network connection module, a real-time content stream decoding module, a real-time content stream display module, and a remote control request module;
  • the mobile terminal network connection module is configured to establish a network connection with the television end to exchange data, and an instruction for communicating with the remote control request module to receive and send the remote control request module;
  • the real-time content stream decoding module is configured to decode the obtained video stream and the audio stream of the television end, and send the decoded original video stream and the audio stream to the real-time content stream display module for final display;
  • the real-time content stream display module is configured to play the original video and audio stream decoded by the real-time content stream decoding module;
  • the remote control request module is configured to send a remote control request signal to the television end after acquiring the real-time video program of the television end, and is configured to end the remote control request process after receiving the rejection signal of the television end, for receiving the television end After the idle signal, the remote control request process is terminated and a free remote connection is established with the television end, and after receiving the busy signal of the television end, the application control signal is sent to the television end for receiving the remote control signal of the television end and the television.
  • the terminal establishes a free remote control connection and is used to end the remote control request process after receiving the rejection remote control signal of the television end.
  • the method and device for realizing the distributed remote control, the television terminal and the mobile terminal thereof, and the corresponding response signals are sent to the mobile terminal according to the user response of the television end and the presence of the user, so that the remote synchronization of the time domain in the space can be realized, and the user is solved.
  • the device-initiated remote control is provided to the real-time content in different spaces.
  • FIG. 1 is a schematic block diagram of an apparatus for implementing distributed remote control according to the present invention.
  • FIG. 2 is a schematic flow chart of an embodiment of a method for implementing distributed remote control according to the present invention.
  • FIG. 3 is a detailed flowchart of step D in FIG. 2.
  • the apparatus for implementing distributed remote control in this embodiment includes a television terminal 10 and a mobile terminal 20 that establishes a network connection with the television terminal 10.
  • the television terminal 10 is configured to: send a real-time content signal to the mobile terminal 20, and monitor the remote control request of the mobile terminal 20; the television terminal 10 receives the remote control request signal sent by the mobile terminal 20, and according to the user response of the television terminal 10 and the presence of the user
  • the mobile terminal 20 transmits a corresponding response signal including a reject signal (S_REFUSE), an idle signal (S_FREE), and a busy signal (S_BUSY); after transmitting the idle signal to the mobile terminal 20, transmitting the corresponding remote control code to the real-time content providing device.
  • S_REFUSE reject signal
  • S_FREE idle signal
  • S_BUSY busy signal
  • the television terminal 10 is further configured to: after receiving the remote control request signal sent by the mobile terminal 20, pop up a prompt box for rejecting the remote control request on the television terminal 10 for the user of the television terminal 10 to select; when the user selects to reject the remote control request, send the mobile terminal 20 to the mobile terminal 20.
  • S_REFUSE Rejection signal
  • S_FREE idle signal
  • S_BUSY busy signal
  • the mobile terminal 20 is configured to: receive a real-time content signal sent by the television terminal 10 to acquire a real-time video program from the television terminal 10, and send a remote control request signal to the television terminal 10; and end the remote control request process after receiving the rejection signal; After receiving the idle signal, the current remote request control process is ended and the free remote control mode is entered; after receiving the busy signal, the application control signal can be sent to the television terminal 10; after receiving the permission remote control signal, the free remote control mode is entered; End the remote request flow after receiving the rejection remote control signal.
  • the free remote control mode means that after the mobile terminal 20 obtains the permission of the television terminal 10, the remote control signal can be freely transmitted to the television terminal 10 through the control interface of the mobile terminal 20, and the user in front of the television terminal 10 is no longer required to confirm, the television terminal 10 forwards the remote control signal to a real-time content providing device such as a set top box through its infrared (IR) forwarding module to remotely control the real-time content providing device.
  • a real-time content providing device such as a set top box through its infrared (IR) forwarding module to remotely control the real-time content providing device.
  • the television end 10 includes a television end network connection module 11, a remote control request monitoring and processing module 12, an IR (infrared) forwarding module 13, a real-time content stream encoding module 14, a user detecting module 15, and a real-time content providing device ID (identity identification number) identification.
  • a television end network connection module 11 includes a remote control request monitoring and processing module 12, an IR (infrared) forwarding module 13, a real-time content stream encoding module 14, a user detecting module 15, and a real-time content providing device ID (identity identification number) identification.
  • IR infrared
  • the television end network connection module 11 is configured to establish a network connection with the mobile terminal 20 to exchange data, and to communicate with the remote control request monitoring and processing module 12 to receive and send instructions of the remote control request monitoring and processing module 12.
  • the TV network connection module 11 can be connected via the Internet (Internet) or mobile Internet (Mobile). Internet) is connected to the mobile terminal 20 such as 3G/4G, Bluetooth or Wi-Fi.
  • the remote control request monitoring and processing module 12 is configured to monitor the remote control request of the mobile terminal 20, and after receiving the remote control request signal sent by the mobile terminal 20, generate a corresponding response signal according to the user response of the television terminal 10 and the user presence condition.
  • the television end network connection module 11 transmits to the mobile terminal 20, the response signal includes a reject signal, an idle signal, and a busy signal; for establishing a free remote connection with the mobile terminal 20 at the television terminal 10 when no user is watching, and for using the television
  • the end 10 user allows the mobile terminal 20 to establish a free remote connection with the mobile terminal 20 when controlling.
  • the IR forwarding module 13 includes an IR transmitting tube for transmitting infrared code commands to a real-time content providing device such as a set top box.
  • the real-time content stream encoding module 14 includes a video encoder (such as H264, MJPEG, MPEG4, etc.) and an audio encoder (such as mp3, AAC, etc.) for encoding the video audio stream input by the real-time content providing device into compressed binary data.
  • the stream is formed into a real-time content signal and transmitted to the mobile terminal 20 through the television end network connection module 11.
  • the user detection module 15 is configured to collect a group of images in front of the television terminal 10 when the instruction of the remote control request monitoring and processing module 12 arrives, and analyze whether the user is present in the image according to the group of images, and The analysis result is output to the remote control request monitoring and processing module 12.
  • the user detection module 15 specifically includes a camera, a camera acquisition unit, an image post-processing unit, and a user identification unit.
  • the camera acquisition unit is configured to control the camera to collect a group of images in front of the television terminal 10
  • the image post-processing unit is configured to capture the acquired image.
  • the face recognition unit is configured to perform face recognition on the post-processed image, analyze whether there is a user present in the image, and output the analysis result to the remote control request monitoring with a Boolean value (TRUE/FALSE).
  • Processing module 12 is configured to perform face recognition on the post-processed image, analyze whether there is a user present in the image, and output the analysis result to the remote control request monitoring with a Boolean value (TRUE/FALSE).
  • the real-time content providing device ID identification module 16 includes an HDMI CEC communication device and a device ID database for passing HDMI
  • the CEC communication device acquires a device ID of a real-time content providing device, such as a DVD, a set top box, and a game machine, searches for a data item of the related device ID in the device ID database, and extracts a device tag name associated with the device ID.
  • the real-time content providing device ID identifying module 16 is further configured to parse the control original code corresponding to the remote control request signal sent by the mobile terminal 20 according to the device ID of the real-time content providing device, for example, parsing the remote control request signal 0X0010 sent by the mobile terminal 20 into Corresponding control original code CH+: 0Xff001e1e, and then transmitting the control original code to the real-time content providing device through the IR forwarding module 13.
  • the remote control request monitoring and processing module 12 is further configured to: after receiving the remote control request signal sent by the mobile terminal 20, pop up a prompt box for rejecting the remote control request on the television terminal 10 for the user of the television terminal 10 to select, and for receiving After applying the control right signal, it is popped up whether to allow the remote control selection box for the user of the television terminal 10 to select.
  • the mobile terminal 20 includes a mobile terminal network connection module 21, a real-time content stream decoding module 22, a real-time content stream display module 23, and a remote control request module 24.
  • the mobile terminal 20 can be a terminal having a network connection function, a display function, and a remote command input function, such as a mobile phone or a tablet computer.
  • the mobile terminal network connection module 21 is configured to establish a network connection with the television terminal 10 to exchange data, and to communicate with the remote control request module 24 to receive and send an instruction of the remote control request module 24.
  • the mobile terminal network connection module 21 can be connected via the Internet (Internet) or mobile Internet (Mobile). Internet) is connected to the TV terminal 10 such as 3G/4G, Bluetooth or Wi-Fi.
  • the real-time content stream decoding module 22 includes a video decoder and an audio decoder for decoding the acquired video stream and audio stream of the television terminal 10, and sending the decoded original video stream and audio stream to the real-time content stream.
  • Display module 23 makes the final display.
  • the real-time content stream display module 23 is configured to play the original video and audio stream decoded by the real-time content stream decoding module 22.
  • the remote control requesting module 24 is configured to send a remote control request signal to the television terminal 10 after acquiring the real-time video program of the television terminal 10, for ending the remote control request process after receiving the rejection signal of the television terminal 10, for After receiving the idle signal of the television terminal 10, the remote control request process is terminated and a free remote control connection is established with the television terminal 10, for transmitting the application control right signal to the television terminal 10 after receiving the busy signal of the television terminal 10, for After receiving the permission remote control signal of the television terminal 10, a free remote connection is established with the television terminal 10, and the remote control request flow is ended after receiving the rejection remote control signal of the television terminal 10.
  • the method for implementing distributed remote control in this embodiment includes the following steps:
  • Step A establishing a network connection between the television terminal 10 and the mobile terminal 20;
  • the TV terminal 10 and the mobile terminal 20 can communicate via the Internet (Internet) and the mobile Internet (Mobile).
  • Internet establishes a network connection such as 3G/4G, Bluetooth or Wi-Fi to implement data exchange between the television terminal 10 and the mobile terminal 20.
  • Step B the television terminal 10 transmits a real-time content signal to the mobile terminal 20, and monitors the remote control request of the mobile terminal 20;
  • the television terminal 10 transmits a real-time content signal to the mobile terminal 20 by activating a video source forwarding program, and monitors the remote control request of the mobile terminal 20 by activating the remote control request monitoring program.
  • Step C The mobile terminal 20 receives the real-time content signal sent by the television terminal 10 to obtain a real-time video program from the television terminal 10, and sends a remote control request signal to the television terminal 10;
  • the mobile terminal 20 starts receiving the real-time content signal sent by the television terminal 10 by starting the real-time content sharing program to acquire the real-time video program from the television terminal 10, and sends a remote control request signal to the television terminal 10 by activating the remote control input module, and then waiting for the television terminal. 10 responses. For example, a remote control request signal with a remote control code of 0X0010 is initiated to the television terminal 10, and the real-time content providing device under the current source is required to perform "channel+" (CH+).
  • CH+ channel+
  • Step D The television terminal 10 receives the remote control request signal sent by the mobile terminal 20, and sends a corresponding response signal to the mobile terminal 20 according to the user response of the television terminal 10 and the user presence condition, and the response signal includes a rejection signal (S_REFUSE) and an idle signal ( S_FREE) and busy signal (S_BUSY);
  • S_REFUSE rejection signal
  • S_FREE idle signal
  • S_BUSY busy signal
  • the step D specifically includes:
  • Step D1 The television terminal 10 receives the remote control request signal sent by the mobile terminal 20;
  • Step D2 popping up on the television terminal 10 whether to reject the remote control request prompt box for the television terminal 10 user to select, if the user chooses to reject, then proceeds to step D3, if the user does not choose to reject, then enter D4;
  • Step D3 the television terminal 10 sends a rejection signal (S_REFUSE) to the mobile terminal 20;
  • Step D4 the television terminal 10 detects whether the user is watching before the television terminal 10, if it is not detected that the user is watching, then proceeds to step D5, if it is detected that the user is watching, then enters D6;
  • Step D5 the television terminal 10 sends an idle signal (S_FREE) to the mobile terminal 20;
  • step D6 the television terminal 10 transmits a busy signal (S_BUSY) to the mobile terminal 20.
  • the television terminal 10 can detect whether a user is watching before the television terminal 10 by means of image recognition.
  • the step of detecting whether the user is watching the television terminal 10 before the television terminal 10 is specifically: the television terminal 10 initiates user detection.
  • the module 15 collects a set of images in front of the television terminal 10 and performs post-processing on the set of images, and then performs face recognition to analyze whether there is a user present in the image.
  • the user may not select to reject if the user's selection operation is not received after the predetermined time is reached.
  • Step E The mobile terminal 20 receives the response signal of the television terminal 10, and enters the following processing steps according to the type of the response signal:
  • Step E1 If the response signal is a reject signal (S_REFUSE), indicating that the television terminal 10 directly rejects the remote control request, the remote control request process is ended;
  • Step E2 If the response signal is an idle signal (S_FREE), indicating that the television terminal 10 is not being viewed by the user, the IR forwarding module 13 of the television terminal 10 transmits the corresponding remote control code to the real-time content providing device, and then ends the remote control request process. And enter the free remote mode;
  • S_FREE idle signal
  • the step of transmitting the corresponding remote control code to the content providing device by the IR forwarding module 13 of the television terminal 10 is specifically: the television terminal 10 acquires the device ID of the real-time content providing device through the real-time content providing device ID identification module 16, and according to the real-time content
  • the device ID of the device is provided to parse the control original code corresponding to the remote control request signal sent by the mobile terminal 20, and then the control original code is sent to the real-time content providing device through the IR forwarding module 13.
  • the remote control request signal 0X0010 sent by the mobile terminal 20 is parsed into a corresponding control original code CH+:0Xff001e1e, and the control original code is sent to the real-time content providing device through the IR forwarding module 13.
  • Step E3 If the response signal is a busy signal (S_BUSY), indicating that the user is watching before the television terminal 10, the mobile terminal 20 sends a request control signal to the television terminal 10. If the television terminal 10 sends the permission remote control signal to the mobile terminal 20, Then, the remote control mode is entered; if the television terminal 10 sends a rejection remote control signal to the mobile terminal 20, the remote control request process is ended.
  • S_BUSY busy signal
  • the step E3 is specifically:
  • the television terminal 10 sends the user image before the television terminal 10 to the video main window of the mobile terminal 20 for display;
  • the mobile terminal 20 sends an application control right signal to the television terminal 10, and waits for the television terminal 10 to respond;
  • the television terminal 10 pops up whether to allow the remote control selection box for the user to select. If the user selects yes, the television terminal 10 sends an allowable remote control signal to the mobile terminal 20, and the mobile terminal 20 acquires the allowed remote control of the television terminal 10. After the signal, the remote control mode is entered; if the user selects No, the television terminal 10 sends a rejection remote control signal to the mobile terminal 20, and the mobile terminal 20 acquires the rejection remote control signal of the television terminal 10, and ends the remote control request process.
  • the step of the mobile terminal 20 transmitting the application control right signal to the television terminal 10 may send an application control right signal to the television terminal 10 by clicking a control button of the video main window of the mobile terminal 20.
  • the method and device for implementing the distributed remote control and the television terminal 10 and the mobile terminal 20 of the present invention can send a corresponding response signal to the mobile terminal 20 according to the user response of the television terminal 10 and the presence of the user, thereby realizing remote synchronization of the time domain in the space.
  • the remote control initiated by the real-time content providing device in different spaces when the user shares the real-time content stream of the television is solved.

Abstract

本发明提供一种实现分布式遥控的方法，包括如下步骤：电视端向移动终端发送实时内容信号；移动终端接收实时内容信号以从电视端获取实时的视频节目，并向电视端发送遥控请求信号；电视端接收移动终端发送的遥控请求信号，并根据电视端的用户响应和用户存在情况向移动终端发送相应的回应信号，回应信号包括拒绝信号、空闲信号和繁忙信号；移动终端接收电视端的回应信号，根据回应信号的类型分别进入相应处理步骤。本发明的实现分布式遥控的方法，可以实现空间内时域的遥控同步，解决了用户在分享电视的实时内容流时在不同的空间内对实时内容提供设备发起的遥控。本发明还提供一种实现分布式遥控的装置及其电视端和移动终端。

Description

实现分布式遥控的方法、装置及其电视端和移动终端
技术领域
　　　本发明涉及电视技术领域，尤其涉及一种实现分布式遥控的方法、装置及其电视端和移动终端。
背景技术
　　　随着智能电视以及其他智能消费电子设备的发展，家庭中聚合了大量用户信息与数据，这些数据中有用户存储的媒体文件，也有各种视频输出设备如机顶盒、游戏机、蓝光DVD等的实时内容流，用户希望能有一个系统统一存储并管理他们的数据，并在统一的操作界面上对这些数据进行浏览与编辑、分享。在家庭领域，电视通常作为最大的一块公共显示屏，因此以电视为使用中心的家庭私有云的概念应育而生。
　　　对于实时内容流来说，电视是一个接入中心，家庭中各种视频设备都统一接入电视中，安装布置好以后就不需要再移动，通过电视的家庭私有云的视频流分享功能，可以将这些实时内容流分享给家庭中的其他有屏设备，包括另外的电视或者手机或者平板电脑，然而，在这样的应用场景下，会产生一些问题：如在分享了实时内容流的设备上遥控控制那些产生内容的装置呢？如何实现这样一种分布式的遥控系统并且能实现不同空间内时域控制的同步呢？故现有技术有待改进。　　　
发明内容
　　　本发明的主要目的在于提供一种实现分布式遥控的方法、装置及其电视端和移动终端，旨在解决用户在分离电视的实时内容流时在不同的空间内对内容提供设备发起的遥控请求，实现空间内时域的遥控同步。
　　　为了实现上述目的，本发明一种实现分布式遥控的方法，包括如下步骤：
　　　步骤A、电视端与移动终端之间建立网络连接；
　　　步骤B、电视端向移动终端发送实时内容信号，并监测移动终端的遥控请求；
　　　步骤C、移动终端接收实时内容信号以从电视端获取实时的视频节目，并向电视端发送遥控请求信号；
　　　步骤D、电视端接收移动终端发送的遥控请求信号，并根据电视端的用户响应和用户存在情况向移动终端发送相应的回应信号，回应信号包括拒绝信号、空闲信号和繁忙信号；
　　　步骤E、移动终端接收电视端的回应信号，根据回应信号的类型分别进入如下处理步骤：
　　　步骤E1、如果回应信号为拒绝信号，表明电视端直接拒绝了遥控请求，则结束本次遥控请求流程；
　　　步骤E2、如果回应信号为空闲信号，表明电视端没有用户正在观看，则通过电视端的IR转发模块向实时内容提供设备发送相应的遥控码，然后结束本次遥控请求流程并进入自由遥控模式；
　　　步骤E3、如果回应信号为繁忙信号，表明电视端前有用户正在观看，则移动终端向电视端发送申请控制权信号，如果电视端向移动终端发送允许遥控信号，则进入自由遥控模式；如果电视端向移动终端发送拒绝遥控信号，则结束本次遥控请求流程。
　　　优选地，所述步骤D具体包括：
　　　步骤D1、电视端接收移动终端发送的遥控请求信号；
　　　步骤D2、在电视端弹出是否拒绝遥控请求的提示框供电视端用户选择，如果用户选择拒绝，则进入步骤D3，如果用户没有选择拒绝，则进入D4；
　　　步骤D3、电视端向移动终端发送拒绝信号；
　　　步骤D4、电视端检测电视端前是否有用户正在观看，如果没有检测到有用户正在观看，则进入步骤D5，如果检测到有用户正在观看，则进入D6；
　　　步骤D5、电视端向移动终端发送空闲信号；
　　　步骤D6、电视端向移动终端发送繁忙信号。
　　　优选地，所述电视端检测电视端前是否有用户正在观看的步骤具体为：电视端启动用户检测模块，采集电视端前方的一组图像并将这组图像进行后处理，然后进行人脸识别以分析出图像中是否有正在观看的用户存在。
　　　优选地，所述通过电视端的IR转发模块向内容提供设备发送相应的遥控码的步骤具体包括：电视端通过实时内容提供设备ID识别模块获取实时内容提供设备的设备ID，并根据实时内容提供设备的设备ID解析出移动终端发送的遥控请求信号所对应的控制原码，然后将控制原码通过IR转发模块发送给实时内容提供设备。
　　　优选地，所述步骤E3具体包括：
　　　如果回应信号为繁忙信号，表明电视端前有用户正在观看，则电视端发送电视端前的用户图像到移动终端视频的主窗口进行显示；
　　　移动终端向电视端发送申请控制权信号；
　　　电视端接收所述申请控制权信号后，弹出是否允许遥控选择框供用户选择，如果用户选择是，则电视端向移动终端发送允许遥控信号，移动终端获取电视端的允许遥控信号后，进入自由遥控模式；如果用户选择否，则电视端向移动终端发送拒绝遥控信号，移动终端获取电视端的拒绝遥控信号后，结束本次遥控请求流程。
　　　本发明还一种实现分布式遥控的装置，包括电视端及与所述电视端建立网络连接的移动终端；
　　　所述电视端用于：向移动终端发送实时内容信号，并监测移动终端的遥控请求；接收移动终端发送的遥控请求信号，并根据电视端的用户响应和用户存在情况向移动终端发送相应的回应信号，回应信号包括拒绝信号、空闲信号和繁忙信号；以及在向移动终端发送空闲信号后，向实时内容提供设备发送相应的遥控码；以及在接收到移动终端发送的申请控制权信号后，根据用户选择向移动终端发送允许遥控信号或拒绝遥控信号；
　　　所述移动终端用于：接收电视端所发送的实时内容信号以从电视端获取实时的视频节目，并向电视端发送遥控请求信号；在接收到拒绝信号后结束本次遥控请求流程；在接收到空闲信号后结束本次遥控请求流程并进入自由遥控模式；在接收到繁忙信号后向电视端发送申请控制权信号；在接收到允许遥控信号后进入自由遥控模式；以及在接收到拒绝遥控信号后结束本次遥控请求流程。
　　　优选地，所述电视端还用于：在接收移动终端发送的遥控请求信号后，在电视端弹出是否拒绝遥控请求的提示框供电视端用户选择；在用户选择对是否拒绝遥控请求作出响应时向移动终端发送拒绝信号；在用户没有选择拒绝遥控请求时检测电视端前是否有用户正在观看；在没有检测到有用户正在观看时向移动终端发送空闲信号；以及在检测到有用户正在观看时向移动终端发送繁忙信号，并发送电视端前的用户图像到移动终端的视频主窗口进行显示。
　　　优选地，所述电视端通过启动用户检测模块，采集电视端前方的一组图像并将这组图像进行后处理，然后进行人脸识别以分析出图像中是否有正在观看的用户存在。
　　　优选地，所述电视端通过实时内容提供设备ID识别模块获取实时内容提供设备的设备ID，并根据实时内容提供设备的设备ID解析出移动终端发送的遥控请求信号所对应的控制原码，然后将控制原码通过IR转发模块发送给实时内容提供设备。
　　　优选地，所述电视端还用于发送电视端前的用户图像到移动终端视频的主窗口进行显示。
　　　优选地，所述电视端还用于在接收到所述移动终端发送的申请控制权信号后，弹出是否允许遥控选择框供用户选择，在接收到所述遥控选择框根据用户选择反馈的信号后向移动终端发送允许遥控信号或拒绝遥控信号。
　　　本发明还提供一种用于前述实现分布式遥控的装置中的电视端，所述电视端包括电视端网络连接模块、遥控请求监测与处理模块、IR转发模块和实时内容流编码模块；
　　　所述电视端网络连接模块，用于与移动终端建立网络连接以交互数据，以及用于与遥控请求监测与处理模块进行通讯，接收和发送遥控请求监测与处理模块的指令；
　　　遥控请求监测与处理模块，用于监测移动终端的遥控请求，用于在接收移动终端发送的遥控请求信号后，根据电视端的用户响应和用户存在情况生成相应的回应信号并通过电视端网络连接模块发送给移动终端，回应信号包括拒绝信号、空闲信号和繁忙信号，用于在电视端没有用户正在观看时与移动终端建立自由遥控连接，以及用于在电视端用户允许移动终端控制时与移动终端建立自由遥控连接；
　　　所述IR转发模块，用于向实时内容提供设备发送红外码指令；
　　　所述实时内容流编码模块，用于将实时内容提供设备输入的视频音频流编码形成实时内容信号并通过电视端网络连接模块发送给移动终端。
　　　优选地，所述遥控请求监测与处理模块，还用于在接收到移动终端发送的遥控请求信号后，在电视端弹出是否拒绝遥控请求的提示框供电视端用户选择，以及用于在接收申请控制权信号后，弹出是否允许遥控选择框供电视端用户选择。
　　　优选地，所述电视端还包括用户检测模块，所述用户检测模块用于在遥控请求监测与处理模块的指令到达时采集电视端前方的一组图像，并根据这组图像分析出图像中是否有正在观看的用户存在，并把分析结果输出给遥控请求监测与处理模块。
　　　优选地，所述电视端还包括实时内容提供设备ID识别模块，所述实时内容提供设备ID识别模块，用于获取实时内容提供设备的设备ID，并根据实时内容提供设备的设备ID解析出移动终端发送的遥控请求信号所对应的控制原码，然后将控制原码通过IR转发模块发送给实时内容提供设备。
　　　本发明还提供一种用于前述实现分布式遥控的装置中的移动终端，所述移动终端包括移动终端网络连接模块、实时内容流解码模块、实时内容流显示模块和遥控请求模块；
　　　所述移动终端网络连接模块用于与电视端建立网络连接以交互数据，以及用于与遥控请求模块进行通讯，接收和发送遥控请求模块的指令；
　　　所述实时内容流解码模块，用于将获取到的电视端的视频流与音频流解码出来，并将解码出来的原始视频流和音频流送往实时内容流显示模块做最终的显示；
　　　所述实时内容流显示模块用于将实时内容流解码模块解码出来的原始视频和音频流进行播放；
　　　所述遥控请求模块，用于在获取到电视端实时的视频节目后向电视端发送遥控请求信号，用于在接收到电视端的拒绝信号后结束本次遥控请求流程，用于在接收到电视端的空闲信号后结束本次遥控请求流程并与电视端建立自由遥控连接，用于在接收到电视端的繁忙信号后向电视端发送申请控制权信号，用于在接收到电视端的允许遥控信号后与电视端建立自由遥控连接，以及用于在接收到电视端的拒绝遥控信号后结束本次遥控请求流程。
　　　本发明实现分布式遥控的方法、装置及其电视端和移动终端，根据电视端的用户响应和用户存在情况向移动终端发送相应的回应信号，可以实现空间内时域的遥控同步，解决了用户在分享电视的实时内容流时在不同的空间内对实时内容提供设备发起的遥控。　　　
附图说明
　　　图1为本发明实现分布式遥控的装置的原理框图。
　　　图2为本发明实现分布式遥控的方法一实施例的流程示意图。
　　　图3为图2中步骤D的细化流程图。　　　
　　　本发明目的的实现、功能特点及优点将结合实施例，参照附图做进一步说明。　　　
具体实施方式
　　　应当理解，此处所描述的具体实施方式仅仅用以解释本发明，并不用于限定本发明。
　　　如图1至图3所示，本实施例实现分布式遥控的装置包括电视端10和与电视端10建立网络连接的移动终端20。
　　　电视端10用于：向移动终端20发送实时内容信号，并监测移动终端20的遥控请求；电视端10接收移动终端20发送的遥控请求信号，并根据电视端10的用户响应和用户存在情况向移动终端20发送相应的回应信号，回应信号包括拒绝信号（S_REFUSE）、空闲信号（S_FREE）和繁忙信号（S_BUSY）；在向移动终端20发送空闲信号后，向实时内容提供设备发送相应的遥控码；以及在接收到移动终端20发送的申请控制权信号后，根据用户选择向移动终端20发送允许遥控信号或拒绝遥控信号。
　　　电视端10还用于：在接收移动终端20发送的遥控请求信号后，在电视端10弹出是否拒绝遥控请求的提示框供电视端10用户选择；在用户选择拒绝遥控请求时向移动终端20发送拒绝信号（S_REFUSE）；在用户没有选择对是否拒绝遥控请求作出响应时，检测电视端10前是否有用户正在观看；在没有检测到有用户正在观看时，向移动终端20发送空闲信号（S_FREE）；以及在检测到有用户正在观看时，向移动终端20发送繁忙信号（S_BUSY），并发送电视端10前的用户图像到移动终端20的视频主窗口进行显示，为方便移动终端20的操作，优选采集悬浮显示。
　　　移动终端20用于：接收电视端10所发送的实时内容信号以从电视端10获取实时的视频节目，并向电视端10发送遥控请求信号；在接收到拒绝信号后结束本次遥控请求流程；在接收到空闲信号后结束本次遥请求控流程并进入自由遥控模式；在接收到繁忙信号后可选择向电视端10发送申请控制权信号；在接收到允许遥控信号后进入自由遥控模式；以及在接收到拒绝遥控信号后结束本次遥控请求流程。
　　　其中，自由遥控模式是指移动终端20得到电视端10的许可之后，可以通过移动终端20的控制界面自由地向电视端10发送遥控信号而不再需要电视端10前的用户进行确认，电视端10通过其红外线（IR）转发模块将遥控信号转发给实时内容提供设备例如机顶盒，对实时内容提供设备进行遥控。
　　　电视端10包括电视端网络连接模块11、遥控请求监测与处理模块12、IR（红外线）转发模块13、实时内容流编码模块14、用户检测模块15和实时内容提供设备ID（身份标识号码）识别模块16。
　　　电视端网络连接模块11，用于与移动终端20建立网络连接以交互数据，以及用于与遥控请求监测与处理模块12进行通讯，接收和发送遥控请求监测与处理模块12的指令。电视端网络连接模块11可以通过互联网（Internet）、移动互联网（Mobile Internet）如3G/4G、蓝牙或Wi-Fi方式与移动终端20进行连接。
　　　遥控请求监测与处理模块12，用于监测移动终端20的遥控请求，用于在接收移动终端20发送的遥控请求信号后，根据电视端10的用户响应和用户存在情况生成相应的回应信号并通过电视端网络连接模块11发送给移动终端20，回应信号包括拒绝信号、空闲信号和繁忙信号；用于在电视端10在没有用户正在观看时与移动终端20建立自由遥控连接，以及用于在电视端10用户允许移动终端20控制时与移动终端20建立自由遥控连接。
　　　IR转发模块13包括IR发射管，用于向实时内容提供设备例如机顶盒发送红外码指令。
　　　实时内容流编码模块14包括视频编码器（如H264、MJPEG、MPEG4等）和音频编码器（如mp3、AAC等），用于将实时内容提供设备输入的视频音频流编码成压缩后的二进制数据流，形成实时内容信号并通过电视端网络连接模块11发送给移动终端20。
　　　用户检测模块15，用于在遥控请求监测与处理模块12的指令到达时采集电视端10前方的一组图像，并根据这组图像分析出图像中是否有正在观看的用户存在，以及将分析结果输出给遥控请求监测与处理模块12。
　　　用户检测模块15具体包括摄像头、摄像头采集单元、图像后处理单元及用户识别单元，摄像头采集单元用于控制摄像头采集电视端10前方的一组图像，图像后处理单元用于对采集后的图像进行后处理，人脸识别单元用于对后处理后的图像进行人脸识别，分析图像中是否有正在观看的用户存在，并把分析结果以布尔值（TRUE/FALSE）输出给遥控请求监测与处理模块12。
　　　实时内容提供设备ID识别模块16包括HDMI CEC通讯装置和设备ID数据库，用于通过HDMI CEC通讯装置获取实时内容提供设备，如DVD、机顶盒、游戏机的设备ID，在设备ID数据库中查找相关的设备ID的数据项，提取与此设备ID相关的设备标示名。实时内容提供设备ID识别模块16还用于根据实时内容提供设备的设备ID解析出移动终端20发送的遥控请求信号所对应的控制原码，如：将移动终端20发送的遥控请求信号0X0010解析成对应的控制原码CH+:0Xff001e1e，然后将控制原码通过IR转发模块13发送给实时内容提供设备。
　　　所述遥控请求监测与处理模块12，还用于在接收到移动终端20发送的遥控请求信号后，在电视端10弹出是否拒绝遥控请求的提示框供电视端10用户选择，以及用于在接收申请控制权信号后，弹出是否允许遥控选择框供电视端10用户选择。
　　　移动终端20包括移动终端网络连接模块21、实时内容流解码模块22、实时内容流显示模块23和遥控请求模块24。
　　　移动终端20可以为手机、平板电脑等具有网络连接功能、显示功能及遥控指令输入功能的终端。
　　　所述移动终端网络连接模块21用于与电视端10建立网络连接以交互数据，以及用于与遥控请求模块24进行通讯，接收和发送遥控请求模块24的指令。移动终端网络连接模块21可以通过互联网（Internet）、移动互联网（Mobile Internet）如3G/4G、蓝牙或Wi-Fi方式与电视端10进行连接。
　　　实时内容流解码模块22，包括视频解码器和音频解码器，用于将获取到的电视端10的视频流与音频流解码出来，并将解码出来的原始视频流和音频流送往实时内容流显示模块23做最终的显示。
　　　实时内容流显示模块23，用于将实时内容流解码模块22解码出来的原始视频和音频流进行播放。
　　　所述遥控请求模块24，用于在获取到电视端10实时的视频节目后向电视端10发送遥控请求信号，用于在接收到电视端10的拒绝信号后结束本次遥控请求流程，用于在接收到电视端10的空闲信号后结束本次遥控请求流程并与电视端10建立自由遥控连接，用于在接收到电视端10的繁忙信号后向电视端10发送申请控制权信号，用于在接收到电视端10的允许遥控信号后与电视端10建立自由遥控连接，以及用于在接收到电视端10的拒绝遥控信号后结束本次遥控请求流程。
　　　参照图2和图3，并结合图1，本实施例实现分布式遥控的方法，包括如下步骤：
　　　步骤A、电视端10与移动终端20之间建立网络连接；
　　　电视端10与移动终端20之间可以通过互联网（Internet）、移动互联网（Mobile Internet）如3G/4G、蓝牙或Wi-Fi方式建立网络连接，以实现在电视端10与移动终端20之间交互数据。
　　　步骤B、电视端10向移动终端20发送实时内容信号，并监测移动终端20的遥控请求；
　　　电视端10通过启动视频信源转发程序来向移动终端20发送实时内容信号，并通过启动遥控请求监测程序来监测移动终端20的遥控请求。
　　　步骤C、移动终端20接收电视端10所发送的实时内容信号以从电视端10获取实时的视频节目，并向电视端10发送遥控请求信号；
　　　移动终端20通过启动实时内容分享程序开始接收电视端10所发送的实时内容信号以从电视端10获取实时的视频节目，并通过启动遥控输入模块向电视端10发送遥控请求信号，然后等待电视端10回应。如：向电视端10发起遥控码为0X0010的遥控请求信号，代表需要当前的信源下的实时内容提供设备进行“频道+”（CH+）。
　　　步骤D、电视端10接收移动终端20发送的遥控请求信号，并根据电视端10的用户响应和用户存在情况向移动终端20发送相应的回应信号，回应信号包括拒绝信号（S_REFUSE）、空闲信号（S_FREE）和繁忙信号（S_BUSY）；
　　　如图3所示，所述步骤D具体包括：
　　　步骤D1、电视端10接收移动终端20发送的遥控请求信号；
　　　步骤D2、在电视端10弹出是否拒绝遥控请求的提示框供电视端10用户选择，如果用户选择拒绝，则进入步骤D3，如果用户没有选择拒绝，则进入D4；
　　　步骤D3、电视端10向移动终端20发送拒绝信号（S_REFUSE）；
　　　步骤D4、电视端10检测电视端10前是否有用户正在观看，如果没有检测到有用户正在观看，则进入步骤D5，如果检测到有用户正在观看，则进入D6；
　　　步骤D5、电视端10向移动终端20发送空闲信号（S_FREE）；
　　　步骤D6、电视端10向移动终端20发送繁忙信号（S_BUSY）。
　　　其中，电视端10可以通过图像识别的方式来检测电视端10前是否有用户正在观看，则所述电视端10检测电视端10前是否有用户正在观看的步骤具体为：电视端10启动用户检测模块15，采集电视端10前方的一组图像并将这组图像进行后处理，然后进行人脸识别以分析出图像中是否有正在观看的用户存在。
　　　在判断用户没有选择拒绝时，可以通过计时的方式，达到预定的时间后，如果没有接收到用户的选择操作，则认为用户没有选择拒绝。
　　　步骤E、移动终端20接收电视端10的回应信号，根据回应信号的类型分别进入如下处理步骤：
　　　步骤E1、如果回应信号为拒绝信号（S_REFUSE），表明电视端10直接拒绝了遥控请求，则结束本次遥控请求流程；
　　　步骤E2、如果回应信号为空闲信号（S_FREE），表明电视端10没有用户正在观看，则通过电视端10的IR转发模块13向实时内容提供设备发送相应的遥控码，然后结束本次遥控请求流程并进入自由遥控模式；
　　　所述通过电视端10的IR转发模块13向内容提供设备发送相应的遥控码的步骤具体为：电视端10通过实时内容提供设备ID识别模块16获取实时内容提供设备的设备ID，并根据实时内容提供设备的设备ID解析出移动终端20发送的遥控请求信号所对应的控制原码，然后将控制原码通过IR转发模块13发送给实时内容提供设备。如：将移动终端20发送的遥控请求信号0X0010解析成对应的控制原码CH+:0Xff001e1e，将这个控制原码通过IR转发模块13发送给实时内容提供设备。
　　　步骤E3、如果回应信号为繁忙信号（S_BUSY），表明电视端10前有用户正在观看，则移动终端20向电视端10发送申请控制权信号，如果电视端10向移动终端20发送允许遥控信号，则进入自由遥控模式；如果电视端10向移动终端20发送拒绝遥控信号，则结束本次遥控请求流程。
　　　所述步骤E3具体为：
　　　如果回应信号为繁忙信号（S_BUSY），表明电视端10前有用户正在观看，则电视端10发送电视端10前的用户图像到移动终端20的视频主窗口进行显示；
　　　移动终端20向电视端10发送申请控制权信号，并等待电视端10回应；
　　　电视端10接收所述申请控制权信号后，弹出是否允许遥控选择框供用户选择，如果用户选择是，则电视端10向移动终端20发送允许遥控信号，移动终端20获取电视端10的允许遥控信号后，进入自由遥控模式；如果用户选择否，电视端10向移动终端20发送拒绝遥控信号，移动终端20获取电视端10的拒绝遥控信号后，结束本次遥控请求流程。
　　　所述移动终端20向电视端10发送申请控制权信号的步骤可以通过点击移动终端20视频主窗口的控制按钮来向电视端10发送申请控制权信号。
　　　本发明实现分布式遥控的方法、装置及其电视端10和移动终端20，根据电视端10的用户响应和用户存在情况向移动终端20发送相应的回应信号，可以实现空间内时域的遥控同步，解决了用户在分享电视的实时内容流时在不同的空间内对实时内容提供设备发起的遥控。
　　　本发明并不局限于以上实施方式，在上述实施方式公开的技术内容下，还可以进行各种变化。凡是利用本发明说明书及附图内容所作的等效结构变换，或直接或间接运用在其他相关的技术领域，均同理包括在本发明的专利保护范围内。

Claims (17)

  1. 一种实现分布式遥控的方法，其特征在于，包括如下步骤：
    　　　步骤A、电视端与移动终端之间建立网络连接；
    　　　步骤B、电视端向移动终端发送实时内容信号，并监测移动终端的遥控请求；
    　　　步骤C、移动终端接收实时内容信号以从电视端获取实时的视频节目，并向电视端发送遥控请求信号；
    　　　步骤D、电视端接收移动终端发送的遥控请求信号，并根据电视端的用户响应和用户存在情况向移动终端发送相应的回应信号，回应信号包括拒绝信号、空闲信号和繁忙信号；
    　　　步骤E、移动终端接收电视端的回应信号，根据回应信号的类型分别进入如下处理步骤：
    　　　步骤E1、如果回应信号为拒绝信号，表明电视端直接拒绝了遥控请求，则结束本次遥控请求流程；
    　　　步骤E2、如果回应信号为空闲信号，表明电视端没有用户正在观看，则通过电视端的IR转发模块向实时内容提供设备发送相应的遥控码，然后结束本次遥控请求流程并进入自由遥控模式；
    　　　步骤E3、如果回应信号为繁忙信号，表明电视端前有用户正在观看，则移动终端向电视端发送申请控制权信号，如果电视端向移动终端发送允许遥控信号，则进入自由遥控模式；如果电视端向移动终端发送拒绝遥控信号，则结束本次遥控请求流程。
  2. 如权利要求1所述的实现分布式遥控的方法，其特征在于，所述步骤D具体包括：
    　　　步骤D1、电视端接收移动终端发送的遥控请求信号；
    　　　步骤D2、在电视端弹出是否拒绝遥控请求的提示框供电视端用户选择，如果用户选择拒绝，则进入步骤D3，如果用户没有选择拒绝，则进入D4；
    　　　步骤D3、电视端向移动终端发送拒绝信号；
    　　　步骤D4、电视端检测电视端前是否有用户正在观看，如果没有检测到有用户正在观看，则进入步骤D5，如果检测到有用户正在观看，则进入D6；
    　　　步骤D5、电视端向移动终端发送空闲信号；
    　　　步骤D6、电视端向移动终端发送繁忙信号。
  3. 如权利要求2所述的实现分布式遥控的方法，其特征在于，所述电视端检测电视端前是否有用户正在观看的步骤具体为：电视端启动用户检测模块，采集电视端前方的一组图像并将这组图像进行后处理，然后进行人脸识别以分析出图像中是否有正在观看的用户存在。
  4. 如权利要求1所述的实现分布式遥控的方法，其特征在于，所述通过电视端的IR转发模块向内容提供设备发送相应的遥控码的步骤具体包括：电视端通过实时内容提供设备ID识别模块获取实时内容提供设备的设备ID，并根据实时内容提供设备的设备ID解析出移动终端发送的遥控请求信号所对应的控制原码，然后将控制原码通过IR转发模块发送给实时内容提供设备。
  5. 如权利要求1所述的实现分布式遥控的方法，其特征在于，所述步骤E3具体包括：
    　　　如果回应信号为繁忙信号，表明电视端前有用户正在观看，则电视端发送电视端前的用户图像到移动终端视频的主窗口进行显示；
    　　　移动终端向电视端发送申请控制权信号；
    　　　电视端接收所述申请控制权信号后，弹出是否允许遥控选择框供用户选择，如果用户选择是，则电视端向移动终端发送允许遥控信号，移动终端获取电视端的允许遥控信号后，进入自由遥控模式；如果用户选择否，则电视端向移动终端发送拒绝遥控信号，移动终端获取电视端的拒绝遥控信号后，结束本次遥控请求流程。
  6. 一种实现分布式遥控的装置，其特征在于，包括电视端及与所述电视端建立网络连接的移动终端；
    　　　所述电视端用于：向移动终端发送实时内容信号，并监测移动终端的遥控请求；接收移动终端发送的遥控请求信号，并根据电视端的用户响应和用户存在情况向移动终端发送相应的回应信号，回应信号包括拒绝信号、空闲信号和繁忙信号；以及在向移动终端发送空闲信号后，向实时内容提供设备发送相应的遥控码；以及在接收到移动终端发送的申请控制权信号后，根据用户选择向移动终端发送允许遥控信号或拒绝遥控信号；
    　　　所述移动终端用于：接收电视端所发送的实时内容信号以从电视端获取实时的视频节目，并向电视端发送遥控请求信号；在接收到拒绝信号后结束本次遥控请求流程；在接收到空闲信号后结束本次遥控请求流程并进入自由遥控模式；在接收到繁忙信号后向电视端发送申请控制权信号；在接收到允许遥控信号后进入自由遥控模式；以及在接收到拒绝遥控信号后结束本次遥控请求流程。
  7. 如权利要求6所述的实现分布式遥控的装置，其特征在于，所述电视端还用于：在接收移动终端发送的遥控请求信号后，在电视端弹出是否拒绝遥控请求的提示框供电视端用户选择；在用户选择对是否拒绝遥控请求作出响应时向移动终端发送拒绝信号；在用户没有选择拒绝遥控请求时检测电视端前是否有用户正在观看；在没有检测到有用户正在观看时向移动终端发送空闲信号；以及在检测到有用户正在观看时向移动终端发送繁忙信号，并发送电视端前的用户图像到移动终端的视频主窗口进行显示。
  8. 如权利要求7所述的实现分布式遥控的装置，其特征在于，所述电视端通过启动用户检测模块，采集电视端前方的一组图像并将这组图像进行后处理，然后进行人脸识别以分析出图像中是否有正在观看的用户存在。
  9. 如权利要求6所述的实现分布式遥控的装置，其特征在于，所述电视端通过实时内容提供设备ID识别模块获取实时内容提供设备的设备ID，并根据实时内容提供设备的设备ID解析出移动终端发送的遥控请求信号所对应的控制原码，然后将控制原码通过IR转发模块发送给实时内容提供设备。
  10. 如权利要求6所述的实现分布式遥控的装置，其特征在于，所述电视端还用于发送电视端前的用户图像到移动终端视频的主窗口进行显示。
  11. 如权利要求6所述的实现分布式遥控的装置，其特征在于，所述电视端还用于在接收到所述移动终端发送的申请控制权信号后，弹出是否允许遥控选择框供用户选择，在接收到所述遥控选择框根据用户选择反馈的信号后向移动终端发送允许遥控信号或拒绝遥控信号。
  12. 一种用于如权利要求6所述的实现分布式遥控的装置中的电视端，其特征在于，所述电视端包括电视端网络连接模块、遥控请求监测与处理模块、IR转发模块和实时内容流编码模块；
    　　　所述电视端网络连接模块，用于与移动终端建立网络连接以交互数据，以及用于与遥控请求监测与处理模块进行通讯，接收和发送遥控请求监测与处理模块的指令；
    　　　遥控请求监测与处理模块，用于监测移动终端的遥控请求，用于在接收移动终端发送的遥控请求信号后，根据电视端的用户响应和用户存在情况生成相应的回应信号并通过电视端网络连接模块发送给移动终端，回应信号包括拒绝信号、空闲信号和繁忙信号，用于在电视端没有用户正在观看时与移动终端建立自由遥控连接，以及用于在电视端用户允许移动终端控制时与移动终端建立自由遥控连接；
    　　　所述IR转发模块，用于向实时内容提供设备发送红外码指令；
    　　　所述实时内容流编码模块，用于将实时内容提供设备输入的视频音频流编码形成实时内容信号并通过电视端网络连接模块发送给移动终端。
  13. 如权利要求12所述的电视端，其特征在于，所述遥控请求监测与处理模块，还用于在接收到移动终端发送的遥控请求信号后，在电视端弹出是否拒绝遥控请求的提示框供电视端用户选择，以及用于在接收申请控制权信号后，弹出是否允许遥控选择框供电视端用户选择。
  14. 如权利要求12所述的电视端，其特征在于，所述电视端还包括用户检测模块，所述用户检测模块用于在遥控请求监测与处理模块的指令到达时采集电视端前方的一组图像，并根据这组图像分析出图像中是否有正在观看的用户存在，并把分析结果输出给遥控请求监测与处理模块。
  15. 如权利要求14所述的电视端，其特征在于，所述电视端还包括实时内容提供设备ID识别模块，所述实时内容提供设备ID识别模块，用于获取实时内容提供设备的设备ID，并根据实时内容提供设备的设备ID解析出移动终端发送的遥控请求信号所对应的控制原码，然后将控制原码通过IR转发模块发送给实时内容提供设备。
  16. 如权利要求12所述的电视端，其特征在于，所述电视端还包括实时内容提供设备ID识别模块，所述实时内容提供设备ID识别模块，用于获取实时内容提供设备的设备ID，并根据实时内容提供设备的设备ID解析出移动终端发送的遥控请求信号所对应的控制原码，然后将控制原码通过IR转发模块发送给实时内容提供设备。
  17. 一种用于如权利要求6所述的实现分布式遥控的装置中的移动终端，其特征在于，所述移动终端包括移动终端网络连接模块、实时内容流解码模块、实时内容流显示模块和遥控请求模块；
    　　　所述移动终端网络连接模块用于与电视端建立网络连接以交互数据，以及用于与遥控请求模块进行通讯，接收和发送遥控请求模块的指令；
    　　　所述实时内容流解码模块，用于将获取到的电视端的视频流与音频流解码出来，并将解码出来的原始视频流和音频流送往实时内容流显示模块做最终的显示；
    　　　所述实时内容流显示模块用于将实时内容流解码模块解码出来的原始视频和音频流进行播放；
    　　　所述遥控请求模块，用于在获取到电视端实时的视频节目后向电视端发送遥控请求信号，用于在接收到电视端的拒绝信号后结束本次遥控请求流程，用于在接收到电视端的空闲信号后结束本次遥控请求流程并与电视端建立自由遥控连接，用于在接收到电视端的繁忙信号后向电视端发送申请控制权信号，用于在接收到电视端的允许遥控信号后与电视端建立自由遥控连接，以及用于在接收到电视端的拒绝遥控信号后结束本次遥控请求流程。
PCT/CN2014/070740 2013-08-06 2014-01-16 实现分布式遥控的方法、装置及其电视端和移动终端 WO2015018185A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP14816093.0A EP2869584B1 (en) 2013-08-06 2014-01-16 Method and device for realizing distributed remote control, and television terminal and mobile terminal thereof
US14/411,398 US20160105706A1 (en) 2013-08-06 2014-01-16 Method and device for realizing distributed remote control, television and mobile terminal of the device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201310339800.1 2013-08-06
CN201310339800.1A CN103442280B (zh) 2013-08-06 2013-08-06 实现分布式遥控的方法、装置及其电视端和移动终端

Publications (1)

Publication Number Publication Date
WO2015018185A1 true WO2015018185A1 (zh) 2015-02-12

Family

ID=49695938

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/070740 WO2015018185A1 (zh) 2013-08-06 2014-01-16 实现分布式遥控的方法、装置及其电视端和移动终端

Country Status (4)

Country Link
US (1) US20160105706A1 (zh)
EP (1) EP2869584B1 (zh)
CN (1) CN103442280B (zh)
WO (1) WO2015018185A1 (zh)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103442280B (zh) * 2013-08-06 2017-11-17 深圳Tcl新技术有限公司 实现分布式遥控的方法、装置及其电视端和移动终端
CN103686290A (zh) * 2013-12-27 2014-03-26 乐视致新电子科技（天津）有限公司 移动通信终端控制智能电视延时播放视频的方法及装置
US20160205429A1 (en) * 2015-01-06 2016-07-14 Luis Miguel Ortiz Media reservation system and methods
US10681421B2 (en) * 2017-01-03 2020-06-09 Turner Broadcasting System, Inc. Personalized, event-driven, and location-based consumption of media content
CN110430474A (zh) * 2018-10-11 2019-11-08 彩云之端文化传媒(北京)有限公司 一种基于电视的跨屏社交化的方法
CN112073638B (zh) * 2020-09-10 2022-02-15 深圳创维－Rgb电子有限公司 摄像头角度控制方法、装置、设备及计算机存储介质
CN114039985B (zh) * 2021-10-16 2024-02-02 深圳市奥金瑞科技有限公司 一种基于可同步本地和远程控制信息的智能遥控系统

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101764920A (zh) * 2009-12-02 2010-06-30 陈奎林 一种家用影视设备的控制系统及方法
CN102769724A (zh) * 2011-05-03 2012-11-07 Lg电子株式会社 电子设备以及操作该电子设备的方法
CN202563671U (zh) * 2012-05-17 2012-11-28 温州大学 一种分布式家电设备智能遥控器
CN103442280A (zh) * 2013-08-06 2013-12-11 深圳Tcl新技术有限公司 实现分布式遥控的方法、装置及其电视端和移动终端

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7131132B1 (en) * 2001-06-11 2006-10-31 Lucent Technologies Inc. Automatic access denial
US8243141B2 (en) * 2007-08-20 2012-08-14 Greenberger Hal P Adjusting a content rendering system based on user occupancy
US9986293B2 (en) * 2007-11-21 2018-05-29 Qualcomm Incorporated Device access control
US20100053457A1 (en) * 2008-08-27 2010-03-04 International Business Machines Corporation Network enabled remote controls and method for hierarchical structure
US20110070819A1 (en) * 2009-09-23 2011-03-24 Rovi Technologies Corporation Systems and methods for providing reminders associated with detected users
KR101657565B1 (ko) * 2010-04-21 2016-09-19 엘지전자 주식회사 증강 원격제어장치 및 그 동작 방법
US20110320963A1 (en) * 2010-06-28 2011-12-29 Rovi Technologies Corporation Systems and methods for controlling multiple user access to media devices in a connected platform environment
US10341711B2 (en) * 2010-11-10 2019-07-02 Saturn Licensing Llc Remote controller device with electronic programming guide and video display
US20130027613A1 (en) * 2011-05-03 2013-01-31 Lg Electronics Inc. Image display apparatus, portable terminal, and methods for operating the same
CN102981758B (zh) * 2012-11-05 2015-05-13 福州瑞芯微电子有限公司 电子设备之间的连接方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101764920A (zh) * 2009-12-02 2010-06-30 陈奎林 一种家用影视设备的控制系统及方法
CN102769724A (zh) * 2011-05-03 2012-11-07 Lg电子株式会社 电子设备以及操作该电子设备的方法
CN202563671U (zh) * 2012-05-17 2012-11-28 温州大学 一种分布式家电设备智能遥控器
CN103442280A (zh) * 2013-08-06 2013-12-11 深圳Tcl新技术有限公司 实现分布式遥控的方法、装置及其电视端和移动终端

Also Published As

Publication number Publication date
EP2869584A1 (en) 2015-05-06
EP2869584A4 (en) 2015-08-12
CN103442280B (zh) 2017-11-17
CN103442280A (zh) 2013-12-11
US20160105706A1 (en) 2016-04-14
EP2869584B1 (en) 2017-03-08

Similar Documents

Publication Publication Date Title
WO2015018185A1 (zh) 实现分布式遥控的方法、装置及其电视端和移动终端
WO2017028601A1 (zh) 智能终端的语音控制方法、装置及电视机系统
WO2018026162A1 (en) Electronic apparatus and method of operating the same
WO2019119771A1 (zh) 语音交互方法、装置及计算机可读存储介质
AU2019381040B2 (en) Display apparatus and method of controlling the same
WO2016187964A1 (zh) 智能控制受控设备的方法和装置
EP3430811A1 (en) Electronic apparatus and method of operating the same
WO2016101698A1 (zh) 基于dlna技术实现屏幕推送的方法及系统
WO2014187158A1 (zh) 终端数据云分享的控制方法、服务器及终端
WO2017126835A1 (en) Display apparatus and controlling method thereof
WO2018023926A1 (zh) 电视与移动终端的互动方法及系统
WO2019054791A1 (ko) 컨텐트를 실행하는 방법 및 장치
WO2016080700A1 (en) Display apparatus and display method
WO2020067759A1 (en) Display apparatus control method and display apparatus using the same
WO2019045337A1 (en) IMAGE DISPLAY APPARATUS AND METHOD FOR OPERATING SAME
WO2020141814A1 (en) Display apparatus, image providing apparatus, and methods of controlling the same
WO2017036209A1 (zh) 基于智能电视的音频数据播放方法、智能电视及系统
WO2017036203A1 (zh) 媒体应用的播放控制方法、遥控装置及电视系统
WO2020017930A1 (ko) 추천 채널 리스트 제공 방법 및 그에 따른 디스플레이 장치
WO2015069082A1 (en) Display apparatus and method of controlling the same
WO2019135433A1 (ko) 디스플레이 장치 및 디스플레이 장치를 포함하는 시스템
WO2016029502A1 (zh) 信号源的切换方法及装置
WO2018006581A1 (zh) 智能电视的播放方法及装置
WO2016058471A1 (zh) 显示设备及对mhl信源实现来电通功能的方法
WO2019137016A1 (zh) 电视节目推荐方法、设备及计算机可读存储介质

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 14411398

Country of ref document: US

REEP Request for entry into the european phase

Ref document number: 2014816093

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2014816093

Country of ref document: EP

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14816093

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE