WO2018103733A1 - 一种控制方法及设备 - Google Patents

一种控制方法及设备 Download PDF

Info

Publication number
WO2018103733A1
WO2018103733A1 PCT/CN2017/115166 CN2017115166W WO2018103733A1 WO 2018103733 A1 WO2018103733 A1 WO 2018103733A1 CN 2017115166 W CN2017115166 W CN 2017115166W WO 2018103733 A1 WO2018103733 A1 WO 2018103733A1
Authority
WO
WIPO (PCT)
Prior art keywords
control
controlled device
connection channel
remote control
message
Prior art date
Application number
PCT/CN2017/115166
Other languages
English (en)
French (fr)
Inventor
龚亚辉
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Priority to EP17878171.2A priority Critical patent/EP3557877A4/en
Priority to US16/611,630 priority patent/US20200169774A1/en
Publication of WO2018103733A1 publication Critical patent/WO2018103733A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4126—The peripheral being portable, e.g. PDAs or mobile phones
    • H04N21/41265—The peripheral being portable, e.g. PDAs or mobile phones having a remote control device for bidirectional communication between the remote control device and client device
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network
    • H04N21/43637—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/4227—Providing Remote input by a user located remotely from the client device, e.g. at work
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643—Communication protocols
    • H04N21/6437—Real-time Transport Protocol [RTP]

Definitions

  • the present disclosure relates to wireless transmission technologies in the field of communications, and in particular, to a control method and apparatus.
  • Embodiments of the present disclosure provide a control method and device.
  • the embodiment of the present disclosure provides a control method, which is applied to a master control device, and includes:
  • the sending by the second RTP connection channel, a control message to the Control equipment, including:
  • the triggering the preset first user control interface to display including:
  • a floating window of the preset first user control interface is triggered for display.
  • the embodiment of the present disclosure provides a control method, which is applied to a controlled device, and includes:
  • the first remote control function is implemented according to the first remote control command.
  • the parsing the control message to obtain the parsed first remote control command includes:
  • the message header is a forward control function WCPC message header
  • the message body of the control message is parsed to obtain the parsed first remote control command.
  • the method further includes:
  • the control message is discarded.
  • An embodiment of the present disclosure provides a master control device, including:
  • a first connection unit configured to connect the channel and the channel through the established first real-time transmission protocol RTP Establishing a wireless projection FFD session connection, wherein the first RTP connection channel is used to implement negotiation between the master control device and the controlled device;
  • a first establishing unit configured to establish a second RTP connection channel with the controlled device when the FWP connection is completed based on the first RTP connection channel, where the second RTP connection channel is used to transmit the main control device Controlling a remote control command of the controlled device;
  • a sending unit configured to send a control message to the controlled device by using the second RTP connection channel, where the control message carries a first remote control command, where the first remote control command is used for the controlled device Realize remote control.
  • the display unit further includes: displaying, according to the establishment of the second RTP connection channel, triggering the preset first user control interface to display;
  • a generating unit configured to generate the control message based on the first operation of the user in the preset first user control interface
  • the sending unit is configured to send the control message to the controlled device through the second RTP connection channel.
  • the display unit is configured to trigger a floating window of the preset first user control interface for display.
  • An embodiment of the present disclosure provides a controlled device, including:
  • a second connection unit configured to establish a wireless projection FFD session connection with the master device by using the established first real-time transport protocol RTP connection channel, where the first RTP connection channel is used to implement the master control device and the Negotiation of the controlled device;
  • a second establishing unit configured to establish a second RTP connection channel with the main control device when the WFD connection is completed based on the first RTP connection channel, where the second RTP connection channel is used to transmit the main control device Controlling a remote control command of the controlled device;
  • a receiving unit configured to receive a control message sent by the master control device
  • the parsing unit is configured to parse the control message to obtain a parsed first remote control command, where the first remote control command is used to implement a remote control function on the controlled device;
  • the remote control unit is configured to implement the first remote control function according to the first remote control command.
  • the parsing unit is configured to parse a message header of the control message; when the message header is a forward control function WCPC message header, parsing the message body of the control message to obtain a parsed The first remote control command.
  • the parsing unit is further configured to discard the control message when the header is a non-WCPC message header after the header of the control message is parsed.
  • Embodiments of the present disclosure also provide a computer readable storage medium storing computer executable instructions that, when executed by a processor, implement any of the methods described above.
  • the embodiment of the present disclosure provides a control method and device, and establishes a wireless projection screen (WFD, Wi-Fi Display) connection between the controlled channel and the controlled device through a first Real-time Transport Protocol (RTP) connection channel.
  • the first RTP connection channel is used to implement negotiation between the master control device and the controlled device; when the first RTP connection channel completes the WFD connection, the second RTP connection channel is established with the controlled device; and the second RTP connection channel is used to send the control.
  • the message is sent to the controlled device, and the control message carries the first remote control command, and the first remote control command is used to implement the remote control function on the controlled device.
  • the master device can establish an RTP connection channel based on the connection of the WFD in the environment of the peer-to-peer network, and control the controlled device through the RTP connection channel, the master device can be free from the distance.
  • Wi-Fi it is possible to remotely control the controlled device, avoiding the distance and connection limitation of the remote control function of the main control device, thereby improving the flexibility of the main control device to realize the remote control function.
  • FIG. 1 is a schematic structural diagram of a control system according to an embodiment of the present disclosure
  • FIG. 2 is a flowchart 1 of a control method according to an embodiment of the present disclosure
  • FIG. 3 is a schematic flowchart of a connection process of a Miracast according to an embodiment of the present disclosure
  • FIG. 4 is a diagram showing an example of a preset first user control interface of a master device according to an embodiment of the present disclosure
  • FIG. 5 is a flowchart of a control method according to an embodiment of the present disclosure.
  • FIG. 6 is an interaction diagram of a control method according to an embodiment of the present disclosure.
  • FIG. 7 is a schematic structural diagram 1 of a main control device according to an embodiment of the present disclosure.
  • FIG. 8 is a schematic structural diagram 2 of a main control device according to an embodiment of the present disclosure.
  • FIG. 9 is a schematic structural diagram 3 of a main control device according to an embodiment of the present disclosure.
  • FIG. 10 is a schematic structural diagram 4 of a main control device according to an embodiment of the present disclosure.
  • FIG. 11 is a schematic structural diagram 1 of a controlled device according to an embodiment of the present disclosure.
  • FIG. 12 is a schematic structural diagram 2 of a controlled device according to an embodiment of the present disclosure.
  • the intelligent terminal ie, the main control device
  • the main control device and the controlled device are connected through Bluetooth, and the control commands are exchanged through Bluetooth, thereby realizing the remote control function; or the main control device and the controlled device are connected via Wi-Fi, and the remote control device is simulated on the main control device side.
  • the interface then transmits control commands to the controlled device via the network to implement remote control functions.
  • the Bluetooth pairing between the master device and the controlled device is performed, and the Bluetooth resources are occupied, and the distance of the master device to control the controlled device is limited; when the remote control function is implemented by Wi-Fi, The main control device and the controlled device must be in the same local area network to realize remote control work. That is to say, the current way of implementing the remote control function through the main control device has certain limitations and is not flexible.
  • the control method provided by the embodiment of the present disclosure is implemented based on the architecture of the control system.
  • the control system 1 in the embodiment of the present disclosure includes: a master device 2 and a controlled device 3.
  • the main control device 2 is provided with a user operation interface module and a client module (client module), and the controlled device 3 is provided with a server module (service module) and an instruction parsing module.
  • a first RTP connection channel and a second RTP connection channel are established between the main control device 2 and the controlled terminal 3, and the first RTP connection channel mainly transmits multimedia data, and the second RTP connection channel is used for transmitting the control device of the main control device.
  • the first RTP connection channel and the second RTP connection channel are connected to the service module and the client module.
  • the embodiment of the present disclosure provides a control method, which is applied to a main control device. As shown in FIG. 2, the method may include:
  • a control method provided by the embodiment of the present disclosure is applicable to a peer-to-peer networking (P2P network), for example, a source based on a miracast (ie, WFD) protocol, that is, a transmitting end (Miracast source).
  • the control process with sink is the receiving end (Miracast destination).
  • Miracast is also called Wi-Fi Display, which is a point-to-point multimedia sharing protocol developed by the Wi-Fi Alliance. Its main purpose is to transmit the multimedia data of the master device to the controlled by wireless transmission.
  • the device plays a display.
  • the controlled device After the connection between the master device and the controlled device P2P is successful, the controlled device starts the service module, and the master device starts the client module.
  • the miracast supports Channel and the User Access Back Channel (UIBC), which defines how to send the receiving end control signal back to the transmitting end, that is, let the user input through the receiving end.
  • UIBC User Access Back Channel
  • the device returns to the transmitting end, for example, by using an input device such as a touch, a mouse, a keyboard, or a joystick to call back the transmitting end.
  • the receiving end may be an electronic device that receives the transmitted multimedia data (for example, audio and video data), and the transmitting end may be a terminal that stores the multimedia data to be transmitted, such as a mobile phone or a computer. No specific restrictions are imposed.
  • the transmitting end can be used as the master control device, and the receiving end can be used as the controlled device.
  • FIG. 3 shows the connection process of the existing Miracast.
  • establishing a connection phase ie, phase 1 includes: two operations of device discovery and WFD connection establishment; and establishing a session phase (ie, phase 2) includes establishing an RTP connection, function negotiation, and session establishment operations;
  • the phase ie, phase 3) includes two operations of suspending and resuming multimedia data stream transmission and disconnecting the session.
  • the first RTP connection channel is established between the master device and the controlled device, that is, a first RTP connection channel is established between the service module and the client module, and the master device is in the WFD session connection.
  • the first RTP connection channel is used to implement the WFD session connection between the master device and the controlled device.
  • the first RTP connection channel is used to negotiate between the master device and the controlled device.
  • the first RTP channel is also used to transmit multimedia data from the master device to the controlled device.
  • the multimedia data can also be transmitted between the master device and the controlled device.
  • the master device can implement a process of establishing a second RTP connection channel with the controlled device. For example, the master device may actively send a second RTP establishment request to the controlled device, and the controlled device responds to the establishment request, and sends a consent to establish a response to the master device, thereby completing the master device and the controlled device.
  • the establishment of the second RTP connection channel After the connection between the WFD session of the master device and the controlled device is successful, the first user control interface is triggered to be displayed based on the establishment of the second RTP connection channel, that is, the display interface of the master device is displayed.
  • the first user interface is configured to be used as a remote control interface of the master device to the controlled device.
  • the preset first user interface is mainly controlled by the user operation interface module.
  • the master device may display a floating window of the preset first user control interface.
  • the preset first user control interface may be provided with a plurality of forms of control operation platforms such as a user touch interface, a physical button or a sensor input.
  • a user control interface in the form of a touch direction key is shown in FIG.
  • the up and down key use cases can be defined to adjust the volume of the controlled device
  • the left and right keys are used to adjust the focus of the controlled device
  • the middle button is defined as the switch between auto focus and manual focus.
  • S103 Send a control message to the controlled device by using the second RTP connection channel, where the control message carries a first remote control command, where the first remote control command is used to implement a remote control function on the controlled device.
  • the master device After the master device establishes the second RTP connection channel and displays the preset first user control interface, the user may obtain the first operation of the user by using a preset first user control interface displayed on the master device, for example, clicking on the The operation of the key, etc., at this time, the master device sends a control message to the controlled device through the second RTP connection channel based on the first operation.
  • a control message is generated based on a first operation of the user at the preset first user control interface, and a control message is sent to the controlled device through the second RTP connection channel.
  • the first remote control command is generated, and the first control command is encapsulated to obtain a control message.
  • the Client module After receiving or obtaining the first operation of the user, the Client module performs remote control information or data to be packaged, and then sends a certain message header of the data packet to the service module through the second RTP connection channel.
  • control message sent by the master device carries the first remote control command.
  • a user control interface in the form of a touch direction key is shown in FIG.
  • the up and down keys are defined to adjust the volume of the controlled device
  • the left and right buttons are used to adjust the focus of the controlled device
  • the middle button is defined as the switch between auto focus and manual focus.
  • the up and down keys are positioned as 00010001 and 00010002
  • the left and right keys are positioned as 00020001 and 00020002
  • the middle key is positioned as 00020003.
  • the user interface module of the master device (for example, the mobile phone) generates a button command, which is 00010001, and the user interface module of the master device encapsulates the button command as volume00010001, That is, the first remote control command, and the first remote control command is sent to the client module of the main control device, and the client module encapsulates the first remote control command into WCPC: volume00010001, that is, a control message. Then, the client module of the master device sends the control message to the service module of the controlled device through the second RTP connection channel to implement adjustment of the volume of the controlled device (first remote control function).
  • a button command which is 00010001
  • the user interface module of the master device encapsulates the button command as volume00010001, That is, the first remote control command, and the first remote control command is sent to the client module of the main control device, and the client module encapsulates the first remote control command into WCPC: volume00010001, that is, a control message.
  • the client module of the master device sends the
  • the master device can establish an RTP connection channel based on the connection of the WFD in the environment of the peer-to-peer network, and control the controlled device through the RTP connection channel, the master device can be free from With the limitation of distance and Wi-Fi, the remote control of the controlled device can be performed, and the distance and connection limitation of the remote control function of the main control device can be avoided, thereby improving the applicability and flexibility of the remote control function of the main control device.
  • the embodiment of the present disclosure provides a control method, which is applied to a controlled device. As shown in FIG. 5, the method may include:
  • a control method provided by an embodiment of the present disclosure is applicable to a P2P network environment, for example, a control process of a transmitting end and a receiving end based on a miracast (ie, WFD) protocol.
  • Miracast is also called Wi-Fi Display, which is a point-to-point multimedia sharing protocol developed by the Wi-Fi Alliance. Its main purpose is to transmit the multimedia data of the master device to the controlled by wireless transmission. The device plays a display.
  • the miraccast supports UIBC, and the UIBC defines how to send the receiving end control signal back to the transmitting end, that is, the user can call back the transmitting end through the input device of the receiving end, for example, by touch, mouse, keyboard,
  • the input device such as the joystick returns to the transmitting end.
  • the receiving end may be an electronic device that receives the transmitted multimedia data (for example, audio and video data), and the transmitting end may be a terminal that stores the multimedia data to be transmitted, such as a mobile phone or a computer. No specific restrictions are imposed.
  • the transmitting end can be used as the master control device, and the receiving end can be used as the controlled device.
  • Miracast's connection process includes three stages: establishing a connection, establishing a session, and operating.
  • Figure 3 shows the connection process of the existing Miracast.
  • establishing a connection phase ie, phase 1 includes: two operations of device discovery and WFD connection establishment; and establishing a session phase (ie, phase 2) includes establishing an RTP connection, function negotiation, and session establishment operations;
  • the phase ie, phase 3) includes two operations of suspending and resuming multimedia data stream transmission and disconnecting the session.
  • the phase 2 when the phase 2 is performed, the first RTP connection channel is established between the master device and the controlled device.
  • the controlled device passes the device.
  • the first RTP connection channel is established to negotiate with the controlled device to implement a WFD session connection between the master device and the controlled device.
  • the first RTP connection channel is used to negotiate between the master device and the controlled device.
  • the first RTP channel is also used to transmit multimedia data from the master device to the controlled device.
  • the number of multimedia can also be performed between the master device and the controlled device. According to the transmission.
  • the controlled device can implement a process of establishing a second RTP connection channel with the master device. For example, the controlled device receives the second RTP establishment request of the master device, and the controlled device responds to the establishment request, and sends a consent to establish a response to the master device, thereby completing the second RTP of the master device and the controlled device. The establishment of the connection channel.
  • the service module defines the port (the port connecting the channel) and receives the data packet or control message sent by the client module.
  • the port number for creating the connection channel is 3002, and in the service module, the port 3002 is monitored; and the data transmission interface for creating the connection channel in the client module is synchronized.
  • S203 Receive a control message sent by the master control device, and parse the control message to obtain a parsed first remote control command, where the first remote control command is used to implement a remote control function on the controlled device.
  • the controlled device can receive the control message sent by the master device through the second RTP, where the control message carries or encapsulates the first remote control command, and is The control device parses the control message to obtain the parsed first remote control command.
  • the control message includes a message header and a message body, and the controlled device can parse the message header of the control message.
  • the message header is a WCPC (Wifi-display User positive Channel) message header
  • the representation is an embodiment of the present disclosure.
  • the remote control message is implemented, so that the controlled device continues to parse the message body of the control message to obtain the parsed first remote control command; conversely, when the message header is a non-WCPC message header, the representation is not implemented by the disclosure.
  • the remote control message is implemented, and the control message is an error message, and the controlled device discards the control message.
  • the controlled device parses the message header as the WCPC is implemented in the service module of the controlled terminal, and then the service module sends the message body of the control message to the command analysis of the controlled device. The module continues to parse and obtain the first remote control command.
  • the instruction parsing module parses the data packet or the control message received by the service module.
  • the service module of the controlled terminal parses the message header of the control message into a WCPC message header, and then sends the message body volume00010001 of the control message to the instruction parsing module, and the instruction parsing module parses the message header of the control message into a volume. And determining that the control message is a volume control message, and the first remote control command is 00010001.
  • the controlled device can implement the first remote control function according to the first remote control command, and the specific remote control function corresponding to the remote control function is different, and the corresponding relationship between the remote control function and the remote control command is
  • the embodiment of the present disclosure is not limited.
  • the first remote control command is a key value or a functional form conversion representation generated by the first operation of the user.
  • the controlled device converts the first remote control command into its own corresponding function event, and executes the Function event, complete the first remote control function.
  • the instruction parsing module converts the parsed remote control command into a button event or an action operation behavior of the controlled device, and performs a remote control function of controlling the controlled device.
  • the first remote control function in the embodiment of the present disclosure may be a function of adjusting the volume, switching the focus, and switching the focus mode, and the embodiment of the present disclosure is not limited.
  • the first remote control command is 00010001
  • the main control device converts 00010001 into a key 49 (volume and button message of the projector) message, simulates a real controlled device key event, and implements a function of the volume added by the controlled device.
  • the master device can establish an RTP connection channel based on the connection of the WFD in the environment of the peer-to-peer network, and control the controlled device through the RTP connection channel, the master device can be free from With the limitation of distance and Wi-Fi, it is possible to remotely control the controlled device, avoiding the distance and connection limitations of the remote control function of the main control device, thereby improving the main control.
  • the device achieves the applicability and flexibility of the remote control function.
  • the embodiment of the present disclosure provides a control method, which is illustrated by using a connection based on a Miracast. As shown in FIG. 6, the method may include:
  • the master control device performs a P2P connection with the controlled device.
  • a control method provided by the embodiment of the present disclosure is applicable to a peer-to-peer networking (P2P network), for example, a source based on a miracast (ie, WFD) protocol, that is, a transmitting end (Miracast source).
  • the control process with sink is the receiving end (Miracast destination).
  • Miracast is also called Wi-Fi Display, which is a point-to-point multimedia sharing protocol developed by the Wi-Fi Alliance. Its main purpose is to transmit the multimedia data of the master device to the controlled by wireless transmission.
  • the device plays a display.
  • the miracast supports Channel and the User Access Back Channel (UIBC), which defines how to send the receiving end control signal back to the transmitting end, that is, let the user input through the receiving end.
  • UIBC User Access Back Channel
  • the device returns to the transmitting end, for example, by using an input device such as a touch, a mouse, a keyboard, or a joystick to call back the transmitting end.
  • the receiving end may be an electronic device that receives the transmitted multimedia data (for example, audio and video data), and the transmitting end may be a terminal that stores the multimedia data to be transmitted, such as a mobile phone or a computer. No specific restrictions are imposed.
  • the transmitting end can be used as the master control device, and the receiving end can be used as the controlled device.
  • the master device establishes a WFD connection with the controlled device by using the established first RTP connection channel, where the first RTP connection channel is used to negotiate between the master device and the controlled device.
  • the P2P connection is made between the master device and the controlled device, that is, the peer-to-peer pairing is performed, and the WFD connection between the master device and the controlled device (ie, the connection of Miracast) is performed.
  • Miracast's connection process includes three stages: establishing a connection, establishing a session, and operating.
  • Figure 3 shows the connection process of the existing Miracast.
  • establishing a connection phase ie, phase 1 includes: two operations of device discovery and WFD connection establishment; and establishing a session phase (ie, phase 2) includes establishing an RTP connection, function negotiation, and session establishment operations;
  • Stage ie stage 3 It includes remote control functions such as pause and resume of multimedia data stream transmission and two operations of disconnecting the session.
  • the first RTP connection channel is established between the master device and the controlled device, and the master device is connected through the established first RTP when performing the WFD session connection.
  • the channel negotiates with the controlled device to implement a WFD session connection between the master device and the controlled device.
  • the first RTP connection channel is used to negotiate between the master device and the controlled device.
  • the master control device When the FWP connection is completed according to the first RTP connection channel, the master control device establishes a second RTP connection channel with the controlled device, and triggers the preset first user control based on the establishment of the second RTP connection channel.
  • the interface is displayed.
  • S304 Generate a control message based on a first operation of the user in the preset first user control interface, and the master control device sends the control message to the controlled device by using the second RTP connection channel, where the control message carries the first remote control command.
  • the first remote control command is used to implement a remote control function for the controlled device.
  • the controlled device parses a message header of the control message.
  • the controlled device implements the first remote control function according to the first remote control command.
  • the controlled device discards the control message.
  • the controlled device parses the message header of the control message, when the message header is a non-WCPC message header, the remote control message that is not implemented in the embodiment of the present disclosure is characterized, and the control message is an error.
  • the controlled device discards the control message.
  • the main control device remotely controls the controlled device to realize the first remote control function
  • the main control device completes the remote control function. Therefore, when the master device does not perform remote control or data transmission on the controlled device, the master device can disconnect the WFD from the controlled device, and when the connection of the WFD is disconnected, the master device does not implement the pair on the master device.
  • the control device controls the control interface. Therefore, at this time, the master device exits the display of the preset first user control interface.
  • the master device can establish an RTP connection channel based on the connection of the WFD in the environment of the peer-to-peer network, and control the controlled device through the RTP connection channel, the master device can be free from With the limitation of distance and Wi-Fi, the remote control of the controlled device can be performed, and the distance and connection limitation of the remote control function of the main control device can be avoided, thereby improving the applicability and flexibility of the remote control function of the main control device.
  • the embodiment of the present disclosure provides a master control device 2, which corresponds to a control method on the master device side, and the master device 2 may include:
  • the first connection unit 20 is configured to establish a WFD connection with the controlled device by using the established first RTP connection channel, where the first RTP connection channel is used to implement negotiation between the master control device and the controlled device.
  • the first establishing unit 21 is configured to establish a second RTP connection channel with the controlled device when the WFD connection is completed based on the first RTP connection channel, where the second RTP connection channel is used to transmit the main control
  • the device controls a remote control command of the controlled device.
  • the sending unit 23 is configured to send a control message to the controlled device by using the second RTP connection channel, where the control message carries a first remote control command, where the first remote control command is used to control the
  • the device implements a remote control function.
  • the main control device 2 may further include: a display unit 22, a generating unit 24, and a packaging unit 25.
  • the display unit 22 is configured to trigger the pre-start based on the establishment of the second RTP connection channel.
  • the first user control interface is displayed for display.
  • the generating unit 24 is configured to generate the control message based on the first operation of the user on the preset first user control interface.
  • the sending unit 23 is configured to send the control message to the controlled device by using the second RTP connection channel.
  • the generating unit 24 is configured to generate the first remote control command based on the first operation of the user in the preset first user control interface.
  • the encapsulating unit 25 is configured to encapsulate the first remote control command to obtain the control message.
  • the display unit 22 can be configured to trigger a floating window of the preset first user control interface for display.
  • the main control device 2 may further include an exit unit 26.
  • the exit unit 26 is configured to exit the preset first user control interface when the connection of the WFD is disconnected after the control message is sent to the controlled device by using the second RTP connection channel. Display.
  • the first establishing unit 21, the generating unit 24, the encapsulating unit 25, and the ejecting unit 26 may be implemented by a processor 27 located on the main control device, for example, by a central processing unit (CPU), Implemented by a microprocessor (MPU), a digital signal processor (DSP) or a field programmable gate array (FPGA), etc.
  • the display unit 22 is implemented by a display 28, and the first connection unit 20 is implemented by the receiver 29 and the transmitter 210, and transmits
  • the unit 23 is implemented by a transmitter 210, which further comprises a storage medium 211, the display 28, the storage medium 211, the receiver 29 and the transmitter 210 can be connected to the processor 27 via a system bus 212, wherein the storage medium 211 is used
  • the executable program code is stored, the program code includes computer operating instructions, the storage medium 211 may include a high speed RAM memory, and may also include a nonvolatile memory, such as at least one disk storage.
  • the main control device in the embodiment of the present disclosure may be a terminal for storing multimedia data to be transmitted, such as a mobile phone or a computer, and is not specifically limited in this embodiment.
  • an embodiment of the present disclosure provides a controlled device 3 corresponding to a controlled device.
  • the control method of the side, the controlled device 3 may include:
  • the second connection unit 30 is configured to establish a WFD connection with the master device by using the established first RTP connection channel, where the first RTP connection channel is used to implement negotiation between the master device and the controlled device.
  • the second establishing unit 31 is configured to establish a second RTP connection channel with the main control device when the WFD connection is completed based on the first RTP connection channel, where the second RTP connection channel is used to transmit the main control
  • the device controls a remote control command of the controlled device.
  • the receiving unit 32 is configured to receive a control message sent by the master device.
  • the parsing unit 33 is configured to parse the control message to obtain a parsed first remote control command, and the first remote control command is used to implement a remote control function on the controlled device.
  • the remote control unit 34 is configured to implement the first remote control function according to the first remote control command.
  • the parsing unit 33 may be configured to parse a message header of the control message; when the message header is a WCPC message header, parse the message body of the control message to obtain the parsed first remote control command .
  • the parsing unit 33 may be further configured to discard the control message when the header is a non-WCPC message header after the header of the control message is parsed.
  • the second establishing unit 31, the parsing unit 33, and the remote control unit 34 may be implemented by a processor 35 located on the controlled device, such as a central processing unit (CPU), a microprocessor ( Implemented by an MPU), a digital signal processor (DSP) or a field programmable gate array (FPGA), the second connection unit 30 is implemented by a receiver 36 and a transmitter 37, and the receiving unit 32 is implemented by a receiver 36, the controlled device Also included is a storage medium 38, which can be coupled to the processor 35 via a system bus 39, wherein the storage medium 38 is for storing executable program code, the program code including computer operating instructions, Storage medium 38 may include high speed RAM memory and may also include non-volatile memory, such as at least one disk storage.
  • the device to be controlled in the embodiment of the present disclosure may be an electronic device that receives the transmitted multimedia data (for example, audio and video data) by a projector, a smart TV, or the like, and is not specifically limited in the embodiment of the present disclosure.
  • the transmitted multimedia data for example, audio and video data
  • Embodiments of the present disclosure also provide a computer readable storage medium storing a computer executable The instructions, when executed by a processor, implement the methods described above.
  • the master device can establish an RTP connection channel based on the connection of the WFD in the environment of the peer-to-peer network, and control the controlled device through the RTP connection channel, the master device can be free from With the limitation of distance and Wi-Fi, the remote control of the controlled device can be performed, and the distance and connection limitation of the remote control function of the main control device can be avoided, thereby improving the applicability and flexibility of the remote control function of the main control device.
  • computer storage medium includes volatile and nonvolatile, implemented in any method or technology for storing information, such as computer readable instructions, data structures, program modules or other data. Sex, removable and non-removable media.
  • Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disc (DVD) or other optical disc storage, magnetic cartridge, magnetic tape, magnetic disk storage or other magnetic storage device, or may Any other medium used to store the desired information and that can be accessed by the computer.
  • communication media typically includes computer readable instructions, data structures, program modules, or other data in a modulated data signal, such as a carrier wave or other transport mechanism, and can include any information delivery media. .
  • Embodiments of the present disclosure provide a control method and device, by establishing a first real-time transmission protocol
  • the RTP (Real-time Transport Protocol) connection channel establishes a Wi-Fi Display (WFD) connection with the controlled device, wherein the first RTP connection channel is used to negotiate between the main control device and the controlled device;
  • WFD Wi-Fi Display
  • a second RTP connection channel is established with the controlled device;
  • the control message is sent to the controlled device through the second RTP connection channel, and the control message carries the first remote control command, and the first remote control is performed.
  • the command is used to implement the remote control function for the controlled device.
  • the master device can establish an RTP connection channel based on the connection of the WFD in the environment of the peer-to-peer network, and control the controlled device through the RTP connection channel, the master device can be free from the distance.
  • Wi-Fi it is possible to remotely control the controlled device, avoiding the distance and connection limitation of the remote control function of the main control device, thereby improving the flexibility of the main control device to realize the remote control function.
  • the present disclosure therefore has industrial applicability.

Abstract

公开了一种控制方法，该方法包括：通过建立的第一实时传输协议(RTP，Real-time Transport Protocol)连接通道与被控设备建立无线投屏(WFD，Wi-Fi Display)连接，其中，第一RTP连接通道用于实现主控设备与被控设备的协商；基于第一RTP连接通道完成WFD连接时，与被控设备建立第二RTP连接通道；通过第二RTP连接通道发送控制消息至被控设备，控制消息中携带第一遥控控制指令，第一遥控控制指令用于对被控设备实现遥控功能。同时还公开了一种控制设备。

Description

一种控制方法及设备 技术领域
本公开涉及通信领域中的无线传输技术，尤其涉及一种控制方法及设备。
背景技术
随着智能终端的高速发展，智能电视、智能盒子和智能投影仪等被控设备的使用越来越普及。而上述被控设备都是通过遥控器进行控制，完成各种应用和功能。
发明内容
以下是对本文详细描述的主题的概述。本概述并非是为了限制权利要求的保护范围。
本公开实施例提供一种控制方法及设备。
本公开的方案是这样实现的：
本公开实施例提供了一种控制方法，应用于主控设备中，包括：
通过建立的第一实时传输协议RTP连接通道，与被控设备建立无线投屏WFD连接，其中，所述第一RTP连接通道用于实现所述主控设备与所述被控设备的协商；
基于所述第一RTP连接通道完成所述WFD连接时，与所述被控设备建立第二RTP连接通道，所述第二RTP连接通道用于传输所述主控设备控制所述被控设备的遥控控制指令；
通过所述第二RTP连接通道发送控制消息至所述被控设备，所述控制消息中携带第一遥控控制指令，所述第一遥控控制指令用于对所述被控设备实现遥控功能。
在上述方案中，所述通过所述第二RTP连接通道发送控制消息至所述被 控设备，包括：
基于所述第二RTP连接通道的建立完成，触发预设的第一用户控制界面进行显示；
基于用户在所述预设的第一用户控制界面的第一操作生成所述控制消息，并通过所述第二RTP连接通道发送所述控制消息至所述被控设备。
在上述方案中，所述触发预设的第一用户控制界面进行显示，包括：
触发所述预设的第一用户控制界面的悬浮窗口进行显示。
本公开实施例提供了一种控制方法，应用于被控设备中，包括：
通过建立的第一实时传输协议RTP连接通道与主控设备建立无线投屏WFD连接，其中，所述第一RTP连接通道用于实现所述主控设备与所述被控设备的协商；
基于所述第一RTP连接通道完成所述WFD连接时，与所述主控设备建立第二RTP连接通道，所述第二RTP连接通道用于传输所述主控设备控制所述被控设备的遥控控制指令；
接收所述主控设备发送的控制消息，并解析所述控制消息，得到解析出的第一遥控控制指令，所述第一遥控控制指令用于对所述被控设备实现遥控功能；
根据所述第一遥控控制指令，实现第一遥控功能。
在上述方案中，所述解析所述控制消息，得到解析出的第一遥控控制指令，包括：
解析所述控制消息的消息头；
当所述消息头为正向控制功能WCPC消息头时，对所述控制消息的消息本体进行解析，得到解析出的所述第一遥控控制指令。
在上述方案中，所述解析所述控制消息的消息头之后，所述方法还包括：
当所述消息头为非WCPC消息头时，丢弃所述控制消息。
本公开实施例提供了一种主控设备，包括：
第一连接单元，配置为通过建立的第一实时传输协议RTP连接通道与被 控设建立无线投屏WFD会话连接，其中，所述第一RTP连接通道用于实现所述主控设备与所述被控设备的协商；
第一建立单元，配置为基于所述第一RTP连接通道完成所述WFD连接时，与所述被控设备建立第二RTP连接通道，所述第二RTP连接通道用于传输所述主控设备控制所述被控设备的遥控控制指令；
发送单元，配置为通过所述第二RTP连接通道发送控制消息至所述被控设备，所述控制消息中携带第一遥控控制指令，所述第一遥控控制指令用于对所述被控设备实现遥控功能。
在上述方案中，还包括显示单元，配置为基于所述第二RTP连接通道的建立完成，触发预设的第一用户控制界面进行显示；
生成单元，配置为基于所述用户在所述预设的第一用户控制界面的所述第一操作，生成所述控制消息；
所述发送单元配置为通过所述第二RTP连接通道发送所述控制消息至所述被控设备。
在上述方案中，所述显示单元配置为触发所述预设的第一用户控制界面的悬浮窗口进行显示。
本公开实施例提供了一种被控设备，包括：
第二连接单元，配置为通过建立的第一实时传输协议RTP连接通道与主控设备建立无线投屏WFD会话连接，其中，所述第一RTP连接通道用于实现所述主控设备与所述被控设备的协商；
第二建立单元，配置为基于所述第一RTP连接通道完成所述WFD连接时，与所述主控设备建立第二RTP连接通道，所述第二RTP连接通道用于传输所述主控设备控制所述被控设备的遥控控制指令；
接收单元，配置为接收所述主控设备发送的控制消息；
解析单元，配置为解析所述控制消息，得到解析出的第一遥控控制指令，所述第一遥控控制指令用于对所述被控设备实现遥控功能；
遥控单元，配置为根据所述第一遥控控制指令，实现第一遥控功能。
在上述方案中，所述解析单元配置为解析所述控制消息的消息头；当所述消息头为正向控制功能WCPC消息头时，对所述控制消息的消息本体进行解析，得到解析出的所述第一遥控控制指令。
在上述方案中，所述解析单元还配置为所述解析所述控制消息的消息头之后，当所述消息头为非WCPC消息头时，丢弃所述控制消息。
本公开实施例还提供了一种计算机可读存储介质，存储有计算机可执行指令，所述计算机可执行指令被处理器执行时实现以上描述的任一方法。
本公开实施例提供了一种控制方法及设备，通过建立的第一实时传输协议(RTP，Real-time Transport Protocol)连接通道与被控设备建立无线投屏(WFD，Wi-Fi Display)连接，其中，第一RTP连接通道用于实现主控设备与被控设备的协商；基于第一RTP连接通道完成WFD连接时，与被控设备建立第二RTP连接通道；通过第二RTP连接通道发送控制消息至被控设备，控制消息中携带第一遥控控制指令，第一遥控控制指令用于对被控设备实现遥控功能。采用上述方案，由于主控设备可以基于对等网络的环境下的WFD的连接，建立一个RTP连接通道，并通过该RTP连接通道实现对被控设备的控制，因此，主控设备可以不受距离和Wi-Fi的限制，就可以进行对被控设备的遥控，避免主控设备实现遥控功能的距离和连接的局限性，从而提高主控设备实现遥控功能的灵活性。
在阅读并理解了附图和详细描述后，可以明白其他方面。
附图说明
图1为本公开实施例提供的一种控制系统的架构图；
图2为本公开实施例提供的一种控制方法的流程图一；
图3为本公开实施例提供的Miracast的连接过程的流程示意图；
图4为本公开实施例提供的主控设备的预设的第一用户控制界面的示例图；
图5为本公开实施例还提供的一种控制方法的流程图；
图6为本公开实施例提供的一种控制方法的交互图；
图7为本公开实施例提供的一种主控设备的结构示意图一；
图8为本公开实施例提供的一种主控设备的结构示意图二；
图9为本公开实施例提供的一种主控设备的结构示意图三；
图10为本公开实施例提供的一种主控设备的结构示意图四；
图11为本公开实施例提供的一种被控设备的结构示意图一；
图12为本公开实施例提供的一种被控设备的结构示意图二。
具体实施方式
目前，采用智能终端(即主控设备)对上述被控设备进行控制，实现遥控功能。例如，主控设备与被控设备通过蓝牙连接，并通过蓝牙进行控制指令的交互，从而实现遥控功能；或者，主控设备与被控设备通过Wi-Fi连接，在主控设备侧模拟遥控器界面，然后将控制指令通过网络传输到被控设备上，实现遥控的功能。
然而，采用蓝牙实现遥控功能时，要进行主控设备和被控设备的蓝牙配对，占用蓝牙资源，且主控设备控制被控设备的距离是有限制的；采用Wi-Fi实现遥控功能时，主控设备与被控设备要在同一个局域网中才能实现遥控功。也就是说目前的通过主控设备实现遥控功能的方式都存在一定的局限性，不灵活。
下面将结合本公开实施例中的附图，对本公开实施例中的方案进行清楚、完整地描述。
如图1所示为一种控制系统的架构图，本公开实施例提供的控制方法基于该控制系统的架构上实现。本公开实施例中的控制系统1包括：主控设备2和被控设备3。其中，主控设备2上设置有用户操作界面模块和客户端模块(client模块)，被控设备3上设置有服务端模块(service模块)和指令解析模块。主控设备2与被控终端3之间建立有第一RTP连接通道和第二RTP连接通道，该第一RTP连接通道主要传输多媒体数据，该第二RTP连接通道用于传输主控设备控制被控设备的控制指令。第一RTP连接通道和第二RTP连接通道连接了service模块和client模块。
下面的实施例都是基于图1的系统架构实现的。
示例一
本公开实施例提供了一种控制方法，应用于主控设备中，如图2所示，该方法可以包括：
S101、通过建立的第一RTP连接通道与被控设备建立WFD连接，其中，该第一RTP连接通道用于实现主控设备与被控设备的协商。
本公开实施例提供的一种控制方法适用于进行对等网络(P2P网络，Peer-to-peer networking)的环境下，例如，基于miracast(即WFD)协议的source即传送端(Miracast源端)与sink即接收端(Miracast目的端)的控制过程。其中，Miracast又称为Wi-Fi Display，其是由Wi-Fi联盟制定的一种点到点的多媒体分享协议，其主要目的在于通过无线传输的方式将主控设备的多媒体数据传输到被控设备进行播放显示。
在主控设备和被控设备P2P连接成功后，被控设备启动service模块，主控设备启动client模块。
本领域技术人员可以知道的是，miracast支持Channel，用户接入反向通道(UIBC，User Input Back Channel)，该UIBC定义了如何将接收端控制信号回送到传送端，即让用户通过接收端的输入设备回控传送端，例如通过触控、鼠标、键盘、游戏杆等输入设备回控传送端。其中，接收端可以为投影仪、智能电视等接收传输来的多媒体数据(例如，音视频数据)的电子设备，传送端可以为手机、电脑等存储有待传输的多媒体数据的终端，本公开实施例不作具体限制。
在本公开实施例中，可以将传送端作为主控设备，将接收端作为被控设备进行说明。
包括建立连接、建立会话与操作三个阶段。图3示出了现有的Miracast的连接流程。如图3所示，建立连接阶段(即阶段1)包括：设备发现和WFD连接建立两项操作；在建立会话阶段(即阶段2)包括建立RTP连接、功能协商和会话建立等操作；而操作阶段(即阶段3)则包括多媒体数据流传输的暂停与恢复以及断开会话两项操作。本公开实施例就是在进行到阶段 2的时候，主控设备与被控设备之间建立了第一RTP连接通道，即在service模块和client模块之间建立了第一RTP连接通道，该主控设备在进行WFD的会话连接时，通过建立的第一RTP连接通道，进行与被控设备的能力协商，实现主控设备与被控设备的WFD会话连接，该第一RTP连接通道用于实现主控设备与被控设备的协商。
第一RTP通道还用于从主控设备传输多媒体数据至被控设备。在本公开实施例实现的控制方法中，主控设备与被控设备之间还可以进行多媒体数据的传输。
S102、基于第一RTP连接通道完成WFD连接时，与被控设备建立第二RTP连接通道，该第二RTP连接通道用于传输主控设备控制被控设备的遥控控制指令。
当主控设备与被控设备的WFD会话连接成功之后，该主控设备可以实现与被控设备建立第二RTP连接通道的过程。例如，主控设备可以主动发送第二RTP的建立请求至被控设备，该被控设备响应该建立请求，并发送同意建立响应至主控设备，从而完成了主控设备与被控设备的第二RTP连接通道的建立。在主控设备与被控设备的WFD会话连接成功的同时，基于第二RTP连接通道的建立完成，触发预设的第一用户控制界面进行显示，即该主控设备的显示界面上显示了预设的第一用户界面，该预设的第一用户界面用作主控设备对被控设备的遥控的操作界面。预设的第一用户界面主要是由用户操作界面模块控制的。
例如，如图4所示，主控设备可以显示预设的第一用户控制界面的悬浮窗口。预设的第一用户控制界面上可以设置有用户触控界面，物理按键或传感器输入等多种形式的控制操作平台。图4中显示了触控方向键形式的用户控制界面。其中，示例性的，可以定义上下键用例调节被控设备的音量大小，左右键用来调节被控设备的焦点对焦，中间键定义为自动对焦和手动对焦的切换。
S103、通过第二RTP连接通道发送控制消息至被控设备，该控制消息中携带第一遥控控制指令，该第一遥控控制指令用于对被控设备实现遥控功能。
主控设备建立第二RTP连接通道并且显示了预设的第一用户控制界面之后，用户可以通过显示在主控设备上的预设的第一用户控制界面获取用户的第一操作，例如点击上键的操作等，这时，该主控设备基于第一操作，通过第二RTP连接通道发送控制消息给被控设备。
例如，基于用户在预设的第一用户控制界面的第一操作生成控制消息，并通过第二RTP连接通道发送控制消息至被控设备。例如，基于用户在预设的第一用户控制界面的第一操作，生成第一遥控控制指令，及将第一控制指令进行封装，得到控制消息。
Client模块接收或获取到用户的第一操作后，进行遥控控制信息或数据进行打包，然后将数据包封装一定的消息头通过第二RTP连接通道发送给service模块。
也就是说，主控设备发送的控制消息中携带有第一遥控控制指令。
示例性的，图4中显示了触控方向键形式的用户控制界面。其中，定义上下键用来调节被控设备的音量大小，左右键用来调节被控设备的焦点对焦，中间键定义为自动对焦和手动对焦的切换。假设上下键定位为00010001和00010002，左右键定位为00020001和00020002，中间键定位为00020003。当用户按上下按键的时候，主控设备(例如，手机)的用户操作界面模块将产生一个按键指令，该按键指令为00010001，该主控设备的用户操作界面模块将该按键指令封装为volume00010001，即第一遥控控制指令，并发送该第一遥控控制指令给主控设备的client模块，client模块将该第一遥控控制指令进行封装为WCPC：volume00010001，即控制消息。然后由主控设备的client模块将该控制消息通过第二RTP连接通道发送给被控设备的service模块，以实现对被控设备的音量的调节(第一遥控功能)。
可以理解的是，由于主控设备可以基于对等网络的环境下的WFD的连接，建立一个RTP连接通道，并通过该RTP连接通道实现对被控设备的控制，因此，主控设备可以不受距离和Wi-Fi的限制，就可以进行对被控设备的遥控，避免主控设备实现遥控功能的距离和连接的局限性，从而提高主控设备实现遥控功能的适用性及灵活性。
示例二
本公开实施例提供了一种控制方法，应用于被控设备中，如图5所示，该方法可以包括：
S201、通过建立的第一RTP连接通道与主控设备建立WFD连接，其中，该第一RTP连接通道用于实现主控设备与被控设备的协商。
本公开实施例提供的一种控制方法适用于进行P2P网络的环境下，例如，基于miracast(即WFD)协议的传送端与接收端的控制过程。其中，Miracast又称为Wi-Fi Display，其是由Wi-Fi联盟制定的一种点到点的多媒体分享协议，其主要目的在于通过无线传输的方式将主控设备的多媒体数据传输到被控设备进行播放显示。
本领域技术人员可以知道的是，miracast支持UIBC，该UIBC定义了如何将接收端控制信号回送到传送端，即让用户通过接收端的输入设备回控传送端，例如通过触控、鼠标、键盘、游戏杆等输入设备回控传送端。其中，接收端可以为投影仪、智能电视等接收传输来的多媒体数据(例如，音视频数据)的电子设备，传送端可以为手机、电脑等存储有待传输的多媒体数据的终端，本公开实施例不作具体限制。
在本公开实施例中，可以将传送端作为主控设备，将接收端作为被控设备进行说明。
Miracast的连接过程包括建立连接、建立会话与操作三个阶段。图3示出了现有的Miracast的连接流程。如图3所示，建立连接阶段(即阶段1)包括：设备发现和WFD连接建立两项操作；在建立会话阶段(即阶段2)包括建立RTP连接、功能协商和会话建立等操作；而操作阶段(即阶段3)则包括多媒体数据流传输的暂停与恢复以及断开会话两项操作。本公开实施例就是在进行到阶段2的时候，主控设备与被控设备之间建立了第一RTP连接通道，该主控设备与被控设备在进行WFD的会话连接时，被控设备通过建立的第一RTP连接通道，进行与被控设备的能力协商，实现主控设备与被控设备的WFD会话连接，该第一RTP连接通道用于实现主控设备与被控设备的协商。
第一RTP通道还用于从主控设备传输多媒体数据至被控设备。在本公开实施例实现的控制方法中，主控设备与被控设备之间还可以进行多媒体数 据的传输。
S202、基于第一RTP连接通道完成WFD连接时，与主控设备建立第二RTP连接通道，该第二RTP连接通道用于传输主控设备控制被控设备的遥控控制指令。
当主控设备与被控设备的WFD会连接成功之后，该被控设备可以实现与主控设备建立第二RTP连接通道的过程。例如，被控设备接收主控设备的第二RTP的建立请求，该被控设备响应该建立请求，并发送同意建立响应至主控设备，从而完成了主控设备与被控设备的第二RTP连接通道的建立。
service模块在P2P连接成功后，监控协议定义端口(连接通道的端口)，接收client模块发送过来的数据包或控制消息。
在本公开实施例中，可以定义创建连接通道的端口号为3002，在service模块中，进行对端口3002进行监听；同步在client模块创建连接通道的数据发送接口。
S203、接收主控设备发送的控制消息，并解析该控制消息，得到解析出的第一遥控控制指令，该第一遥控控制指令用于对被控设备实现遥控功能。
被控设备在与主控设备建立了第二RTP连接通道之后，该被控设备可以通过第二RTP接收主控设备发送的控制消息，该控制消息中携带或封装有第一遥控控制指令，被控设备解析该控制消息，得到解析出的第一遥控控制指令。
例如，控制消息包括消息头和消息本体，被控设备可以解析控制消息的消息头，当消息头为正向控制功能(WCPC，Wifi-display User positive Channel)消息头时，表征是本公开实施例实施的遥控控制消息，于是，该被控设备继续对控制消息的消息本体进行解析，得到解析出的第一遥控控制指令；相反的，当消息头为非WCPC消息头时，表征不是本公开实施例实施的遥控控制消息，于是，该控制消息为错误的消息，被控设备丢弃控制消息。
在本公开实施例中，由于第一遥控控制指令是在主控设备的用户操作界 面模块和client模块进行了两次封装，因此，被控设备解析出消息头为WCPC是在被控终端的service模块实现的，然后service模块将控制消息的消息本体发送至被控设备的指令解析模块继续进行解析，得到第一遥控控制指令。
在本公开实施例中，指令解析模块解析service模块接收到的数据包或控制消息后，进行指令解析。
示例性的，被控终端的service模块解析出控制消息的消息头为WCPC消息头，然后将控制消息的消息本体volume00010001发送至指令解析模块，该指令解析模块解析出该控制消息的消息头为volume，则判断出该控制消息为音量控制消息，第一遥控控制指令为00010001。
S204、根据第一遥控控制指令，实现第一遥控功能。
被控设备在得到第一遥控控制指令之后，就可以根据该第一遥控控制指令实现第一遥控功能，具体的遥控功能对应的遥控控制指令是不同的，遥控功能和遥控控制指令的对应关系是可以自行设置的，本公开实施例不做限制。
第一遥控控制指令为用户的第一操作产生的键值或功能形式的转换表示，在本公开实施例中，被控设备将第一遥控控制指令转换为自己的对应的功能事件，并执行该功能事件，完成第一遥控功能。其中，指令解析模块将解析到的遥控控制指令转换为被控设备的按键事件或动作操作行为，执行控制被控设备的遥控功能。
本公开实施例中的第一遥控功能可以为音量的调节、焦点对焦及对焦方式的切换等功能，本公开实施例不作限制。
示例性的，第一遥控控制指令为00010001，主控设备将00010001转换为key49(投影仪的音量加按键消息)消息，模拟真实的被控设备按键事件，实现被控设备执行音量加的功能。
可以理解的是，由于主控设备可以基于对等网络的环境下的WFD的连接，建立一个RTP连接通道，并通过该RTP连接通道实现对被控设备的控制，因此，主控设备可以不受距离和Wi-Fi的限制，就可以进行对被控设备的遥控，避免主控设备实现遥控功能的距离和连接的局限性，从而提高主控 设备实现遥控功能的适用性及灵活性。
示例三
本公开实施例提供了一种控制方法，以基于Miracast的连接为例进行说明，如图6所示，该方法可以包括：
S301、主控设备与被控设备进行P2P连接。
本公开实施例提供的一种控制方法适用于进行对等网络(P2P网络，Peer-to-peer networking)的环境下，例如，基于miracast(即WFD)协议的source即传送端(Miracast源端)与sink即接收端(Miracast目的端)的控制过程。其中，Miracast又称为Wi-Fi Display，其是由Wi-Fi联盟制定的一种点到点的多媒体分享协议，其主要目的在于通过无线传输的方式将主控设备的多媒体数据传输到被控设备进行播放显示。
本领域技术人员可以知道的是，miracast支持Channel，用户接入反向通道(UIBC，User Input Back Channel)，该UIBC定义了如何将接收端控制信号回送到传送端，即让用户通过接收端的输入设备回控传送端，例如通过触控、鼠标、键盘、游戏杆等输入设备回控传送端。其中，接收端可以为投影仪、智能电视等接收传输来的多媒体数据(例如，音视频数据)的电子设备，传送端可以为手机、电脑等存储有待传输的多媒体数据的终端，本公开实施例不作具体限制。
在本公开实施例中，可以将传送端作为主控设备，将接收端作为被控设备进行说明。
S302、主控设备通过建立的第一RTP连接通道与被控设备建立WFD连接，其中，该第一RTP连接通道用于实现主控设备与被控设备的协商。
主控设备与被控设备进行了P2P连接，即点对点的配对之后，进行主控设备与被控设备的WFD连接(即Miracast的连接)。
Miracast的连接过程包括建立连接、建立会话与操作三个阶段。图3示出了现有的Miracast的连接流程。如图3所示，建立连接阶段(即阶段1)包括：设备发现和WFD连接建立两项操作；在建立会话阶段(即阶段2)包括建立RTP连接、功能协商和会话建立等操作；而操作阶段(即阶段3) 则包括多媒体数据流传输的暂停与恢复等遥控功能以及断开会话两项操作。
本公开实施例就是在进行到阶段2的时候，主控设备与被控设备之间已经建立了第一RTP连接通道，该主控设备在进行WFD的会话连接时，通过建立的第一RTP连接通道，进行与被控设备的能力协商，实现主控设备与被控设备的WFD会话连接，该第一RTP连接通道用于实现主控设备与被控设备的协商。
S303、基于所述第一RTP连接通道完成所述WFD连接时，主控设备与被控设备建立第二RTP连接通道，基于该第二RTP连接通道的建立完成，触发预设的第一用户控制界面进行显示。
在本公开实施例中，S303的描述与示例一中的S102的描述一致，此处不再赘述。
S304、基于用户在预设的第一用户控制界面的第一操作生成控制消息，主控设备通过第二RTP连接通道发送该控制消息至被控设备，该控制消息中携带第一遥控控制指令，该第一遥控控制指令用于对被控设备实现遥控功能。
在本公开实施例中，S304的描述与示例一中的S103的描述一致，此处不再赘述。
S305、被控设备解析控制消息的消息头。
S306、当消息头为WCPC消息头时，对控制消息的消息本体进行解析，得到解析出的第一遥控控制指令。
在本公开实施例中，S305-S306的描述与示例二中的S203的描述一致，此处不再赘述。
S307、被控设备根据第一遥控控制指令，实现第一遥控功能。
在本公开实施例中，S307的描述与示例二中的S204的描述一致，此处不再赘述。
S308、当消息头为非WCPC消息头时，被控设备丢弃控制消息。
被控设备解析控制消息的消息头之后，当消息头为非WCPC消息头时，表征不是本公开实施例实施的遥控控制消息，于是，该控制消息为错误的消 息，被控设备丢弃控制消息。
S309、当断开WFD连接时，主控设备退出预设的第一用户控制界面的显示。
在主控设备对被控设备进行遥控，实现了第一遥控功能之后，该主控设备就完成了遥控功能。因此，主控设备不对被控设备进行遥控或数据传输时，该主控设备就可以与被控设备断开WFD的连接，而当断开WFD的连接时，就不在主控设备上实现对被控设备进行控制的控制界面，因此，这时，该主控设备退出预设的第一用户控制界面的显示。
可以理解的是，由于主控设备可以基于对等网络的环境下的WFD的连接，建立一个RTP连接通道，并通过该RTP连接通道实现对被控设备的控制，因此，主控设备可以不受距离和Wi-Fi的限制，就可以进行对被控设备的遥控，避免主控设备实现遥控功能的距离和连接的局限性，从而提高主控设备实现遥控功能的适用性及灵活性。
示例四
如图7所示，本公开实施例提供了一种主控设备2，对应于主控设备侧的控制方法，该主控设备2可以包括：
第一连接单元20，配置为通过建立的第一RTP连接通道与被控设备建立WFD连接，其中，所述第一RTP连接通道用于实现所述主控设备与所述被控设备的协商。
第一建立单元21，配置为基于所述第一RTP连接通道完成所述WFD连接时，与所述被控设备建立第二RTP连接通道，所述第二RTP连接通道用于传输所述主控设备控制所述被控设备的遥控控制指令。
发送单元23，配置为通过所述第二RTP连接通道发送控制消息至所述被控设备，所述控制消息中携带第一遥控控制指令，所述第一遥控控制指令用于对所述被控设备实现遥控功能。
如图8所示，所述主控设备2可以还包括：显示单元22、生成单元24和封装单元25。
显示单元22，配置为基于所述第二RTP连接通道的建立完成，触发预 设的第一用户控制界面进行显示。
所述生成单元24，配置为基于所述用户在所述预设的第一用户控制界面的所述第一操作，生成所述控制消息。
所述发送单元23，配置为通过所述第二RTP连接通道发送所述控制消息至所述被控设备。
所述生成单元24，配置为基于所述用户在所述预设的第一用户控制界面的所述第一操作，生成所述第一遥控控制指令。
所述封装单元25，配置为将所述第一遥控控制指令进行封装，得到所述控制消息。
所述显示单元22可以配置为触发所述预设的第一用户控制界面的悬浮窗口进行显示。
如图9所示，所述主控设备2可以还包括：退出单元26。
所述退出单元26，配置为所述通过所述第二RTP连接通道发送控制消息至所述被控设备之后，当断开所述WFD的连接时，退出所述预设的第一用户控制界面的显示。
如图10所示，在实际应用中，上述第一建立单元21，生成单元24、封装单元25和退出单元26可由位于主控设备上的处理器27实现，例如由中央处理器(CPU)、微处理器(MPU)、数字信号处理器(DSP)或现场可编程门阵列(FPGA)等实现，显示单元22由显示器28实现，第一连接单元20由接收器29和发送器210实现，发送单元23由发送器210实现，该主控设备还包括存储介质211，显示器28、存储介质211、接收器29和发送器210可以通过系统总线212与处理器27连接，其中，存储介质211用于存储可执行程序代码，该程序代码包括计算机操作指令，存储介质211可能包含高速RAM存储器，也可能还包括非易失性存储器，例如，至少一个磁盘存储器。
本公开实施例中的主控设备可以为手机、电脑等存储有待传输的多媒体数据的终端，本公开实施例不作具体限制。
如图11所示，本公开实施例提供了一种被控设备3，对应于被控设备 侧的控制方法，该被控设备3可以包括：
第二连接单元30，配置为通过建立的第一RTP连接通道与主控设备建立WFD连接，其中，所述第一RTP连接通道用于实现所述主控设备与所述被控设备的协商。
第二建立单元31，配置为基于所述第一RTP连接通道完成所述WFD连接时，与所述主控设备建立第二RTP连接通道，所述第二RTP连接通道用于传输所述主控设备控制所述被控设备的遥控控制指令。
接收单元32，配置为接收所述主控设备发送的控制消息。
解析单元33，配置为解析所述控制消息，得到解析出的第一遥控控制指令，所述第一遥控控制指令用于对所述被控设备实现遥控功能。
遥控单元34，配置为根据所述第一遥控控制指令，实现第一遥控功能。
所述解析单元33可以配置为解析所述控制消息的消息头；当所述消息头为WCPC消息头时，对所述控制消息的消息本体进行解析，得到解析出的所述第一遥控控制指令。
所述解析单元33还可以配置为所述解析所述控制消息的消息头之后，当所述消息头为非WCPC消息头时，丢弃所述控制消息。
如图12所示，在实际应用中，上述第二建立单元31、解析单元33和遥控单元34可由位于被控设备上的处理器35实现，例如由中央处理器(CPU)、微处理器(MPU)、数字信号处理器(DSP)或现场可编程门阵列(FPGA)等实现，第二连接单元30由接收器36和发送器37实现，接收单元32由接收器36实现，该被控设备还包括存储介质38，该存储介质38、接收器36和发送器37可以通过系统总线39与处理器35连接，其中，存储介质38用于存储可执行程序代码，该程序代码包括计算机操作指令，存储介质38可能包含高速RAM存储器，也可能还包括非易失性存储器，例如，至少一个磁盘存储器。
本公开实施例中的被控设备可以为投影仪、智能电视等接收传输来的多媒体数据(例如，音视频数据)的电子设备，本公开实施例不作具体限制。
本公开实施例还提供了一种计算机可读存储介质，存储有计算机可执行 指令，所述计算机可执行指令被处理器执行时实现以上描述的方法。
可以理解的是，由于主控设备可以基于对等网络的环境下的WFD的连接，建立一个RTP连接通道，并通过该RTP连接通道实现对被控设备的控制，因此，主控设备可以不受距离和Wi-Fi的限制，就可以进行对被控设备的遥控，避免主控设备实现遥控功能的距离和连接的局限性，从而提高主控设备实现遥控功能的适用性及灵活性。
本领域普通技术人员可以理解，上文中所公开方法中的全部或某些步骤、系统、装置中的功能模块/单元可以被实施为软件、固件、硬件及其适当的组合。在硬件实施方式中，在以上描述中提及的功能模块/单元之间的划分不一定对应于物理组件的划分；例如，一个物理组件可以具有多个功能，或者一个功能或步骤可以由若干物理组件合作执行。某些组件或所有组件可以被实施为由处理器，如数字信号处理器或微处理器执行的软件，或者被实施为硬件，或者被实施为集成电路，如专用集成电路。这样的软件可以分布在计算机可读介质上，计算机可读介质可以包括计算机存储介质(或非暂时性介质)和通信介质(或暂时性介质)。如本领域普通技术人员公知的，术语计算机存储介质包括在用于存储信息(诸如计算机可读指令、数据结构、程序模块或其他数据)的任何方法或技术中实施的易失性和非易失性、可移除和不可移除介质。计算机存储介质包括但不限于RAM、ROM、EEPROM、闪存或其他存储器技术、CD-ROM、数字多功能盘(DVD)或其他光盘存储、磁盒、磁带、磁盘存储或其他磁存储装置、或者可以用于存储期望的信息并且可以被计算机访问的任何其他的介质。此外，本领域普通技术人员公知的是，通信介质通常包含计算机可读指令、数据结构、程序模块或者诸如载波或其他传输机制之类的调制数据信号中的其他数据，并且可包括任何信息递送介质。
以上所述，仅为本公开的示例性实施例而已，并非用于限定本公开的保护范围。
工业实用性
本公开实施例提供了一种控制方法及设备，通过建立的第一实时传输协 议(RTP，Real-time Transport Protocol)连接通道与被控设备建立无线投屏(WFD，Wi-Fi Display)连接，其中，第一RTP连接通道用于实现主控设备与被控设备的协商；基于第一RTP连接通道完成WFD连接时，与被控设备建立第二RTP连接通道；通过第二RTP连接通道发送控制消息至被控设备，控制消息中携带第一遥控控制指令，第一遥控控制指令用于对被控设备实现遥控功能。采用上述方案，由于主控设备可以基于对等网络的环境下的WFD的连接，建立一个RTP连接通道，并通过该RTP连接通道实现对被控设备的控制，因此，主控设备可以不受距离和Wi-Fi的限制，就可以进行对被控设备的遥控，避免主控设备实现遥控功能的距离和连接的局限性，从而提高主控设备实现遥控功能的灵活性。因此本公开具有工业实用性。

Claims (14)

  1. 一种控制方法，应用于主控设备中，包括：
    通过建立的第一实时传输协议RTP连接通道，与被控设备建立无线投屏WFD连接，其中，所述第一RTP连接通道用于实现所述主控设备与所述被控设备的协商(S101)；
    基于所述第一RTP连接通道完成所述WFD连接时，与所述被控设备建立第二RTP连接通道，所述第二RTP连接通道用于传输所述主控设备控制所述被控设备的遥控控制指令(S102)；
    通过所述第二RTP连接通道发送控制消息至所述被控设备，所述控制消息中携带第一遥控控制指令，所述第一遥控控制指令用于对所述被控设备实现遥控功能(S103)。
  2. 根据权利要求1所述的方法，其中，所述通过所述第二RTP连接通道发送控制消息至所述被控设备，包括：
    基于所述第二RTP连接通道的建立完成，触发预设的第一用户控制界面进行显示；
    基于用户在所述预设的第一用户控制界面的第一操作生成所述控制消息，并通过所述第二RTP连接通道发送所述控制消息至所述被控设备。
  3. 根据权利要求1所述的方法，其中，所述触发预设的第一用户控制界面进行显示，包括：
    触发所述预设的第一用户控制界面的悬浮窗口进行显示。
  4. 一种控制方法，应用于被控设备中，包括：
    通过建立的第一实时传输协议RTP连接通道，与主控设备建立无线投屏WFD连接，其中，所述第一RTP连接通道用于实现所述主控设备与所述被控设备的协商(S201)；
    基于所述第一RTP连接通道完成所述WFD连接时，与所述主控设备建立第二RTP连接通道，所述第二RTP连接通道用于传输所述主控设备控制所述被控设备的遥控控制指令(S202)；
    接收所述主控设备发送的控制消息，并解析所述控制消息，得到解析出的第一遥控控制指令，所述第一遥控控制指令用于对所述被控设备实现遥控功能(S203)；
    根据所述第一遥控控制指令，实现第一遥控功能(S204)。
  5. 根据权利要求4所述的方法，其中，所述解析所述控制消息，得到解析出的第一遥控控制指令，包括：
    解析所述控制消息的消息头；
    当所述消息头为正向控制功能WCPC消息头时，对所述控制消息的消息本体进行解析，得到解析出的所述第一遥控控制指令。
  6. 根据权利要求5所述的方法，其中，所述解析所述控制消息的消息头之后，所述方法还包括：
    当所述消息头为非WCPC消息头时，丢弃所述控制消息。
  7. 一种主控设备(2)，包括：
    第一连接单元(20)，配置为通过建立的第一实时传输协议RTP连接通道，与被控设建立无线投屏WFD会话连接，其中，所述第一RTP连接通道用于实现所述主控设备与所述被控设备的协商；
    第一建立单元(21)，配置为基于所述第一RTP连接通道完成所述WFD连接时，与所述被控设备建立第二RTP连接通道，所述第二RTP连接通道用于传输所述主控设备控制所述被控设备的遥控控制指令；
    发送单元(23)，配置为通过所述第二RTP连接通道发送控制消息至所述被控设备，所述控制消息中携带第一遥控控制指令，所述第一遥控控制指令用于对所述被控设备实现遥控功能。
  8. 根据权利要求7所述的主控设备(2)，还包括
    显示单元(22)，配置为基于所述第二RTP连接通道的建立完成，触发预设的第一用户控制界面进行显示；
    生成单元(24)，配置为基于所述用户在所述预设的第一用户控制界面的所述第一操作，生成所述控制消息；
    所述发送单元(23)配置为通过所述第二RTP连接通道发送所述控制消息至所述被控设备。
  9. 根据权利要求7所述的主控设备(2)，其中，
    所述显示单元(22)配置为触发所述预设的第一用户控制界面的悬浮窗口进行显示。
  10. 一种被控设备(3)，包括：
    第二连接单元(30)，配置为通过建立的第一实时传输协议RTP连接通道，与主控设备建立无线投屏WFD会话连接，其中，所述第一RTP连接通道用于实现所述主控设备与所述被控设备的协商；
    第二建立单元(31)，配置为基于所述第一RTP连接通道完成所述WFD连接时，与所述主控设备建立第二RTP连接通道，所述第二RTP连接通道用于传输所述主控设备控制所述被控设备的遥控控制指令；
    接收单元(32)，配置为接收所述主控设备发送的控制消息；
    解析单元(33)，配置为解析所述控制消息，得到解析出的第一遥控控制指令，所述第一遥控控制指令用于对所述被控设备实现遥控功能；
    遥控单元(34)，配置为根据所述第一遥控控制指令，实现第一遥控功能。
  11. 根据权利要求10所述的被控设备(3)，其中，
    所述解析单元(33)配置为解析所述控制消息的消息头；当所述消息头为正向控制功能WCPC消息头时，对所述控制消息的消息本体进行解析，得到解析出的所述第一遥控控制指令。
  12. 根据权利要求11所述的被控设备(3)，其中，
    所述解析单元(33)还配置为所述解析所述控制消息的消息头之后，当所述消息头为非WCPC消息头时，丢弃所述控制消息。
  13. 一种计算机可读存储介质，存储有计算机可执行指令，所述计算机可执行指令被处理器执行时实现权利要求1-3中任一项所述的方法。
  14. 一种计算机可读存储介质，存储有计算机可执行指令，所述计算机 可执行指令被处理器执行时实现权利要求4-6中任一项所述的方法。
PCT/CN2017/115166 2016-12-09 2017-12-08 一种控制方法及设备 WO2018103733A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP17878171.2A EP3557877A4 (en) 2016-12-09 2017-12-08 CONTROL METHOD AND DEVICE
US16/611,630 US20200169774A1 (en) 2016-12-09 2017-12-08 Control method and device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201611127277.6 2016-12-09
CN201611127277.6A CN108616764A (zh) 2016-12-09 2016-12-09 一种控制方法及设备

Publications (1)

Publication Number Publication Date
WO2018103733A1 true WO2018103733A1 (zh) 2018-06-14

Family

ID=62491489

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/115166 WO2018103733A1 (zh) 2016-12-09 2017-12-08 一种控制方法及设备

Country Status (4)

Country Link
US (1) US20200169774A1 (zh)
EP (1) EP3557877A4 (zh)
CN (1) CN108616764A (zh)
WO (1) WO2018103733A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023217188A1 (zh) * 2022-05-11 2023-11-16 北京字节跳动网络技术有限公司 一种直播数据传输方法、装置、系统、设备和介质

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109996097B (zh) * 2019-03-12 2022-01-04 广州虎牙信息科技有限公司 一种投屏方法、系统及存储装置
CN111629240B (zh) * 2020-05-06 2021-08-10 上海幻电信息科技有限公司 多屏互动显示方法及装置
CN111405259B (zh) * 2020-05-20 2022-05-06 成都极米科技股份有限公司 投影设备的对焦方法、对焦装置、遥控器及可读存储介质
CN112788646B (zh) * 2021-03-16 2023-07-25 北京字节跳动网络技术有限公司 网络质量监测方法、装置、设备和存储介质
CN113852848B (zh) * 2021-09-18 2024-04-05 Vidaa(荷兰)国际控股有限公司 一种虚拟遥控器控制方法、显示设备及终端设备
CN114281288A (zh) * 2021-12-10 2022-04-05 海宁奕斯伟集成电路设计有限公司 投屏处理方法、装置及电子设备
CN114666447B (zh) * 2022-03-11 2024-03-01 深圳市宝泽科技有限公司 物理按键远程控制音量方法、装置、存储介质及智能终端

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103702436A (zh) * 2013-12-11 2014-04-02 东软集团股份有限公司 Miracast反向控制方法及系统
CN104618793A (zh) * 2015-02-28 2015-05-13 联想(北京)有限公司 一种信息处理方法及电子设备
CN105264926A (zh) * 2013-06-07 2016-01-20 高通股份有限公司 用于使用wi-fi显示传输机制来实现语音和数据通信的方法和系统
CN105898463A (zh) * 2015-12-14 2016-08-24 乐视移动智能信息技术（北京）有限公司 一种设备控制方法、相关设备和系统
CN106165368A (zh) * 2014-04-10 2016-11-23 高通股份有限公司 实时传输协议的流送控制

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100565328B1 (ko) * 2004-06-02 2006-03-30 엘지전자 주식회사 Ｒｔｓｐ 프로토콜을 이용한 원격 제어 시스템 및 방법
KR101732057B1 (ko) * 2009-11-02 2017-05-02 삼성전자주식회사 Ａｖ 시스템에서 사용자 입력 백 채널을 제공하는 방법 및 기기
US8966131B2 (en) * 2012-01-06 2015-02-24 Qualcomm Incorporated System method for bi-directional tunneling via user input back channel (UIBC) for wireless displays
WO2016084485A1 (ja) * 2014-11-27 2016-06-02 ソニー株式会社 情報処理装置および情報処理方法
CN106161619A (zh) * 2016-07-05 2016-11-23 上海斐讯数据通信技术有限公司 一种基于移动终端的远程控制方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105264926A (zh) * 2013-06-07 2016-01-20 高通股份有限公司 用于使用wi-fi显示传输机制来实现语音和数据通信的方法和系统
CN103702436A (zh) * 2013-12-11 2014-04-02 东软集团股份有限公司 Miracast反向控制方法及系统
CN106165368A (zh) * 2014-04-10 2016-11-23 高通股份有限公司 实时传输协议的流送控制
CN104618793A (zh) * 2015-02-28 2015-05-13 联想(北京)有限公司 一种信息处理方法及电子设备
CN105898463A (zh) * 2015-12-14 2016-08-24 乐视移动智能信息技术（北京）有限公司 一种设备控制方法、相关设备和系统

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023217188A1 (zh) * 2022-05-11 2023-11-16 北京字节跳动网络技术有限公司 一种直播数据传输方法、装置、系统、设备和介质

Also Published As

Publication number Publication date
EP3557877A1 (en) 2019-10-23
CN108616764A (zh) 2018-10-02
EP3557877A4 (en) 2020-07-22
US20200169774A1 (en) 2020-05-28

Similar Documents

Publication Publication Date Title
WO2018103733A1 (zh) 一种控制方法及设备
US11388453B2 (en) Method for processing live-streaming interaction video and server
US9913301B2 (en) Content sharing method and device
JP6017731B2 (ja) 音声通信およびデータ通信を遂行するためのＷｉ−Ｆｉディスプレイ移送機構を使用するための方法およびシステム
EP3130127B1 (en) Streaming control for real-time transport protocol
CN112218271A (zh) 车内无线通信
KR20140011969A (ko) 디스플레이 세션에서 오프라인 참여를 위한 무선 통신 시스템 및 방법
KR20150102747A (ko) 무선 통신 시스템에서 어플리케이션 데이터를 디스플레이하기 위한 방법 및 장치
WO2016110169A1 (zh) 一种显示处理方法及装置
US10104153B2 (en) Method and device for processing information
WO2019019032A1 (zh) 下行数据包配置方法及装置
KR20140081172A (ko) 싱크 장치, 소스 장치, 이들을 포함하는 무선랜 시스템 및 싱크 장치를 제어하는 방법
CN108667871B (zh) 基于p2p的传输方法和装置
WO2015131454A1 (zh) 一种投影方法及终端、系统
WO2019129125A1 (zh) 智能眼镜与智能设备交互的方法、系统及存储介质
KR20160132049A (ko) 통신 시스템에서 콘텐츠를 제공하는 방법 및 장치
CN103414867B (zh) 多媒体通话控制方法、终端及系统
WO2016082107A1 (zh) 一种共享界面的方法及终端设备
JP2018521549A (ja) 逆方向チャネルオーディオセッションを管理するための技法
WO2022042592A1 (zh) 投屏方法、装置、电子设备及计算机可读介质
JP2019213180A (ja) 無線画像音声送受信システム及び方法
WO2015169005A1 (zh) 共享屏幕和操作控制的方法、系统和主共享端
CN113691790A (zh) 多媒体数据处理方法及装置、电子设备及存储介质
CN112653925B (zh) 媒体播放的跨设备转移方法、系统、设备及存储介质
CN109661040B (zh) 电子设备及其无线连接方法和具有存储功能的装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17878171

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2017878171

Country of ref document: EP

Effective date: 20190709