CN105763552B

CN105763552B - Transmission method, device and system in remote control

Info

Publication number: CN105763552B
Application number: CN201610153227.9A
Authority: CN
Inventors: 林形省; 毛良瑾; 葛旭东
Original assignee: Beijing Xiaomi Mobile Software Co Ltd
Current assignee: Beijing Xiaomi Mobile Software Co Ltd
Priority date: 2016-03-17
Filing date: 2016-03-17
Publication date: 2020-09-08
Anticipated expiration: 2036-03-17
Also published as: CN105763552A

Abstract

The disclosure relates to a transmission method, a device and a system in remote control, and belongs to the technical field of terminal remote control. The method comprises the following steps: the master control terminal receives an interface identifier of a current display interface of the controlled terminal from the controlled terminal; searching an interface image of the current display interface from a pre-stored interface image library according to the interface identifier of the current display interface; and when the interface image of the current display interface exists in the interface image library, displaying the interface image of the current display interface.

Description

Transmission method, device and system in remote control

Technical Field

The present disclosure relates to the field of terminal remote control technologies, and in particular, to a transmission method, device, and system in remote control.

Background

Currently, the remote control technology is widely applied due to the advantages of simple operation, convenient and fast transaction processing and the like.

In the related art, there is provided a remote control method between terminals, the method including: taking remote control of the controlled terminal by the master control terminal as an example, the controlled terminal generates a video of a current display interface in real time and sends the video to the master control terminal in real time; the master control terminal receives and displays the video sent by the controlled terminal, acquires an operation signal triggered by a user and corresponding to the video picture, and then the master control terminal generates a remote control instruction according to the operation signal and sends the remote control instruction to the controlled terminal, so that the controlled terminal executes corresponding operation according to the remote control instruction.

However, in the remote control method provided by the above related art, the controlled terminal needs to transmit the video of the current display interface to the master control terminal in real time in the process of remote control. Since the data size of the video is large, the related art at least has the following technical problems: on one hand, under the condition of poor network signals, video data are transmitted slowly, so that remote control is not smooth, and the operation efficiency is influenced; on the other hand, more network transmission resources are required to be occupied for transmitting video data.

Disclosure of Invention

In order to overcome the problems in the related art, embodiments of the present disclosure provide a transmission method, apparatus, and system in remote control. The technical scheme is as follows:

according to a first aspect of the embodiments of the present disclosure, a transmission method in remote control is provided, which is applied to a master control terminal, and the method includes:

receiving an interface identifier of a current display interface of a controlled terminal from the controlled terminal;

searching an interface image of the current display interface from a pre-stored interface image library according to the interface identifier of the current display interface;

and when the interface image of the current display interface exists in the interface image library, displaying the interface image of the current display interface.

According to a second aspect of the embodiments of the present disclosure, there is provided a transmission method in remote control, which is applied to a controlled terminal, the method including:

acquiring an interface identifier of a current display interface;

sending the interface identification of the current display interface to a master control terminal; the interface identifier of the current display interface is used for indicating the main control terminal to search the interface image of the current display interface from a pre-stored interface image library, and displaying the interface image of the current display interface under the condition that the interface image of the current display interface exists in the interface image library.

According to a third aspect of embodiments of the present disclosure, there is provided a remote control apparatus, the apparatus including:

the first receiving module is configured to receive an interface identifier of a current display interface of a controlled terminal from the controlled terminal;

the searching module is configured to search the interface image of the current display interface from a pre-stored interface image library according to the interface identifier of the current display interface;

the display module is configured to display the interface image of the current display interface when the interface image of the current display interface exists in the interface image library.

Optionally, the apparatus further comprises:

the first acquisition module is configured to acquire an operation signal corresponding to the interface image of the current display interface;

and the first sending module is configured to send a remote control instruction to the controlled terminal according to the operation signal, wherein the remote control instruction is used for instructing the controlled terminal to execute corresponding operation.

Optionally, the first sending module includes:

the acquisition submodule is configured to acquire position information and action information corresponding to the operation signal;

and the sending submodule is configured to send the remote control instruction to the controlled terminal, and the remote control instruction comprises the position information and the action information.

Optionally, the apparatus further comprises:

the second sending module is configured to send an image obtaining request to the controlled terminal when the interface image of the current display interface does not exist in the interface image library, wherein the image obtaining request is used for requesting to obtain the interface image of the current display interface;

and the second receiving module is configured to receive the interface image of the current display interface from the controlled terminal.

Optionally, the apparatus further comprises:

and the storage module is configured to correspondingly store the interface image of the current display interface and the interface identifier of the current display interface into the interface image library.

According to a fourth aspect of embodiments of the present disclosure, there is provided a remote control apparatus, the apparatus including:

the acquisition module is configured to acquire an interface identifier of a current display interface;

the first sending module is configured to send the interface identifier of the current display interface to the master control terminal; the interface identifier of the current display interface is used for indicating the main control terminal to search the interface image of the current display interface from a pre-stored interface image library, and displaying the interface image of the current display interface under the condition that the interface image of the current display interface exists in the interface image library.

Optionally, the apparatus further comprises:

a first receiving module configured to receive a remote control instruction from the main control terminal, where the remote control instruction is generated by the main control terminal according to an operation signal corresponding to an interface image of the current display interface;

and the execution module is configured to execute corresponding operation according to the remote control instruction.

Optionally, the remote control instruction includes position information and action information corresponding to the operation signal;

the execution module includes:

the determining submodule is configured to determine an operation object in the current display interface according to the position information;

and the execution sub-module is configured to execute the operation corresponding to the action information on the operation object.

Optionally, the apparatus further comprises:

a second receiving module, configured to receive an image obtaining request from the master control terminal, where the image obtaining request is used to request to obtain an interface image of the current display interface, and the image obtaining request is sent by the master control terminal when the interface image of the current display interface does not exist in the interface image library;

and the second sending module is configured to send the interface image of the current display interface to the main control terminal. According to a fifth aspect of embodiments of the present disclosure, there is provided a remote control system, the system including: the system comprises a main control terminal and a controlled terminal;

the master control terminal comprises the remote control device according to the third aspect;

the controlled terminal comprises the remote control device according to the fourth aspect.

According to a sixth aspect of embodiments of the present disclosure, there is provided a remote control apparatus, the apparatus including:

a processor;

a memory for storing executable instructions of the processor;

wherein the processor is configured to:

According to a seventh aspect of the embodiments of the present disclosure, there is provided a remote control apparatus, the apparatus including:

a processor;

a memory for storing executable instructions of the processor;

wherein the processor is configured to:

acquiring an interface identifier of a current display interface;

The technical scheme provided by the embodiment of the disclosure at least has the following beneficial effects:

receiving an interface identifier of a current display interface of a controlled terminal from the controlled terminal through a master control terminal, and searching and displaying an interface image of the current display interface from a pre-stored interface image library; the method solves the problems that the remote control is not smooth and more network transmission resources are occupied due to the fact that the video of the current display interface of the controlled terminal needs to be transmitted to the main control terminal in real time by the method provided by the related technology; compared with the real-time transmission of videos, the method has the advantages that the current display interface of the controlled terminal can be displayed to the user at the master control terminal side only by transmitting the interface identification, and the interface identification is much smaller than the data volume of the videos, so that the technical effects of improving remote control fluency and reducing occupied network transmission resources are achieved.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.

FIG. 1 is a schematic diagram of an implementation environment shown in accordance with an exemplary embodiment;

FIG. 2 is a flow chart illustrating a method of transmission in a remote control according to an example embodiment;

FIG. 3 is a flow chart illustrating a method of transmission in a remote control according to another exemplary embodiment;

FIG. 4 is a flow chart illustrating a method of transmission in a remote control according to another exemplary embodiment;

FIG. 5 is a block diagram illustrating a remote control device according to an exemplary embodiment;

FIG. 6 is a block diagram illustrating a remote control device according to another exemplary embodiment;

FIG. 7 is a block diagram illustrating a remote control system in accordance with an exemplary embodiment;

FIG. 8 is a block diagram illustrating an apparatus in accordance with an example embodiment.

Detailed Description

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.

FIG. 1 is a schematic illustration of an implementation environment in accordance with an example embodiment. The implementation environment includes: a master terminal 110 and a controlled terminal 120.

The master control terminal 110 is used for remotely controlling the controlled terminal 120. The master terminal 110 and the controlled terminal 120 may be electronic devices such as a mobile phone, a tablet Computer, a PC (Personal Computer), and the like. The master control terminal 110 and the controlled terminal 120 establish a communication connection through a network. Taking the master control terminal 110 and the controlled terminal 120 as two mobile phones as an example, the two mobile phones can establish communication connection through a wireless network.

Optionally, as shown in fig. 1, the implementation environment further includes: a server 130. The server 130 is used for forwarding data transmitted between the master terminal 110 and the controlled terminal 120. Optionally, in this embodiment of the present disclosure, the server 130 is further configured to store an interface image library, where the interface image library includes interface images of each display interface of the terminal. The server 130 may be a server, a server cluster composed of several servers, or a cloud computing service center. The master terminal 110 and the controlled terminal 120 can respectively establish communication connection with the server 130 through the network.

Fig. 2 is a flow chart illustrating a transmission method in a remote control according to an example embodiment. The method can be applied to the master control terminal 110 in the implementation environment shown in fig. 1. The method may include several steps as follows.

In step 201, an interface identifier of a current display interface of the controlled terminal is received from the controlled terminal.

In step 202, according to the interface identifier of the current display interface, the interface image of the current display interface is searched from a pre-stored interface image library.

In step 203, when the interface image of the current display interface exists in the interface image library, the interface image of the current display interface is displayed.

In summary, in the method provided in this embodiment, the interface identifier of the current display interface of the controlled terminal is received from the controlled terminal through the master control terminal, so that the interface image of the current display interface is searched and displayed from the pre-stored interface image library; the method solves the problems that the remote control is not smooth and more network transmission resources are occupied due to the fact that the video of the current display interface of the controlled terminal needs to be transmitted to the main control terminal in real time by the method provided by the related technology; compared with the real-time transmission of videos, the method has the advantages that the current display interface of the controlled terminal can be displayed to the user at the master control terminal side only by transmitting the interface identification, and the interface identification is much smaller than the data volume of the videos, so that the technical effects of improving remote control fluency and reducing occupied network transmission resources are achieved.

Fig. 3 is a flow chart illustrating a transmission method in a remote control according to another exemplary embodiment. The method can be applied to the controlled terminal 120 in the implementation environment shown in fig. 1. The method may include several steps as follows.

In step 301, an interface identifier of a current display interface is obtained.

In step 302, an interface identifier of a current display interface is sent to the master control terminal; the interface identifier of the current display interface is used for indicating the main control terminal to search the interface image of the current display interface from a pre-stored interface image library and display the interface image of the current display interface under the condition that the interface image of the current display interface exists in the interface image library.

In summary, in the method provided in this embodiment, the controlled terminal obtains the interface identifier of the current display interface and sends the interface identifier of the current display interface to the main control terminal, so that the main control terminal searches for and displays the interface image of the current display interface from the pre-stored interface image library according to the interface identifier of the current display interface; the method solves the problems that the remote control is not smooth and more network transmission resources are occupied due to the fact that the video of the current display interface of the controlled terminal needs to be transmitted to the main control terminal in real time by the method provided by the related technology; compared with the real-time transmission of videos, the method has the advantages that the current display interface of the controlled terminal can be displayed to the user at the master control terminal side only by transmitting the interface identification, and the interface identification is much smaller than the data volume of the videos, so that the technical effects of improving remote control fluency and reducing occupied network transmission resources are achieved.

Fig. 4 is a flowchart illustrating a transmission method in a remote control according to another exemplary embodiment. This embodiment is illustrated with the method applied to the implementation environment shown in fig. 1. The method may include several steps as follows.

In step 401, the controlled terminal obtains an interface identifier of a current display interface.

The interface identifier refers to an identifier for uniquely identifying the display interface of the terminal device. Different display interfaces correspond to different interface identifications. The interface identifier may be a name of the display interface, or a label pre-assigned to each display interface, or another unique identifier.

The corresponding relation between each display interface and the interface identification is stored in the controlled terminal in advance. For example, the interface identification of the screen home interface is 1. And after the controlled terminal allows the master control terminal to remotely control the controlled terminal, assuming that the current display interface of the controlled terminal is the screen main interface, the controlled terminal inquires the corresponding relation to obtain the interface identifier '1' of the screen main interface.

In step 402, the controlled terminal sends the interface identifier of the current display interface of the controlled terminal to the master control terminal.

For example, the controlled terminal sends the interface identifier "1" of the screen main interface to the master control terminal.

Correspondingly, the master control terminal receives the interface identifier of the current display interface of the controlled terminal from the controlled terminal.

In step 403, the main control terminal searches the interface image of the current display interface from a pre-stored interface image library according to the interface identifier of the current display interface.

The interface image library is used for storing interface images of a plurality of display interfaces of the controlled terminal. And the interface image library takes the interface identification as an index and correspondingly stores the interface identifications of a plurality of display interfaces of the controlled terminal and the interface images. For example, the interface image library stores interface identifiers and interface images of a screen main interface of the controlled terminal, interface identifiers and interface images of a setting interface, interface identifiers and interface images of an address list interface, and the like.

In consideration of the difference of the display interfaces of the terminal devices of different device models, the controlled terminal can also send the device identifier to the main control terminal. The device identifier is used for uniquely identifying the device model of the terminal device, or is used for uniquely identifying the terminal device. And the main control terminal correspondingly stores corresponding interface image libraries aiming at different equipment models. After receiving the device identifier of the controlled terminal from the controlled terminal, the master control terminal determines the device model of the controlled terminal according to the device identifier of the controlled terminal, further selects a corresponding interface image library according to the device model of the controlled terminal, and then searches the interface image of the current display interface from the selected interface image library according to the interface identifier of the current display interface of the controlled terminal. In addition, considering that the storage capacity of the terminal device is limited, in order to avoid occupying too much storage capacity of the terminal device, some interface images of the display interface commonly used by the user in the remote control process, that is, interface images of the display interface with the use frequency/frequency greater than a predetermined value in the remote control process, can be stored in the interface image library.

In step 404, when the interface image of the current display interface exists in the interface image library, the master control terminal displays the interface image of the current display interface.

In step 405, the main control terminal acquires an operation signal corresponding to an interface image of the current display interface.

The operation signal is triggered by a user of the main control terminal. For example, after the master control terminal displays the interface image of the screen main interface of the controlled terminal, the user needs to remotely control the controlled terminal to open the setting interface, and then clicks the setting icon included in the interface image of the screen main interface. Correspondingly, the main control terminal acquires an operation signal triggered by the user through the single-click operation.

In step 406, the master control terminal sends a remote control command to the controlled terminal according to the operation signal.

After the master control terminal acquires the operation signal, a remote control instruction for remotely controlling the controlled terminal is generated according to the operation signal, and the remote control instruction is sent to the controlled terminal. The remote control instruction is used for indicating the controlled terminal to execute corresponding operation. In one possible embodiment, step 406 includes the following two substeps:

1. the main control terminal acquires position information and action information corresponding to the operation signal;

2. and the master control terminal sends a remote control instruction to the controlled terminal, wherein the remote control instruction comprises the position information and the action information.

The position information comprises a trigger position of the operation signal in the interface image of the current display interface, and the trigger position can be represented by corresponding coordinates of the operation signal in the interface image. The position information is used for the controlled terminal to determine the operation object in the current display interface. The action information includes a user operation corresponding to the operation signal. The action information is used for the controlled terminal to determine the operation executed on the operation object. For example, the user operation is a click operation, a slide operation, or the like. Still taking the example that the user clicks the setting icon, the position information corresponding to the operation signal is the coordinates of the clicking operation in the interface image of the screen main interface (assuming that the coordinates are (a, b)), and the action information is the clicking operation.

Accordingly, the controlled terminal receives the remote control instruction from the main control terminal.

In step 407, the controlled terminal performs a corresponding operation according to the remote control instruction.

And the controlled terminal determines an operation object in the current display interface according to the position information included in the remote control instruction, and executes the operation corresponding to the action information on the operation object. For example, the controlled terminal can determine that the operation object is the setting icon in the currently displayed screen main interface according to the coordinates (a, b), open the setting interface according to the action information "click operation", and display the setting interface. And then, the controlled terminal can execute the steps 401 and 402 again, and sends the interface identifier of the setting interface to the main control terminal, so that the main control terminal can obtain and display the interface image of the setting interface according to the interface identifier of the setting interface, and the user of the main control terminal can perform the next remote control operation accordingly.

The point to be supplemented is that, when the interface image library pre-stored by the master control terminal does not have the interface image of the current display interface of the controlled terminal, the master control terminal sends an image acquisition request to the controlled terminal, where the image acquisition request is used to request to acquire the interface image of the current display interface. Correspondingly, the controlled terminal receives the image acquisition request from the main control terminal and sends the interface image of the current display interface to the main control terminal. For example, when the controlled terminal prestores the interface image of the current display interface, the interface image of the current display interface is directly sent to the main control terminal; and when the interface image of the current display interface is not prestored in the controlled terminal, screenshot is carried out on the current display interface to generate the interface image of the current display interface, and the interface image is sent to the master control terminal. Correspondingly, the master control terminal receives the interface image of the current display interface of the controlled terminal from the controlled terminal, and then displays the interface image so that a user can complete remote control operation. Optionally, after receiving the interface image of the current display interface from the controlled terminal, the main control terminal correspondingly stores the interface image of the current display interface and the interface identifier into an interface image library, so as to ensure that the interface image of the display interface can be directly obtained from local subsequently.

Optionally, the master control terminal may dynamically update its locally stored interface image library according to the interface image library stored in the server. For example, the main control terminal downloads the interface image and the interface identifier of the target display interface from the server, and correspondingly stores the interface image and the interface identifier of the target display interface into a local interface image library of the main control terminal. The target display interface refers to an interface image which is stored in the server but not stored in the main control terminal. The downloading operation can be triggered and executed manually by a user or automatically by the main control terminal according to preset time. Of course, after receiving the interface image of the current display interface from the controlled terminal, the main control terminal may also send the interface image and the interface identifier of the current display interface to the server, and the server is configured to receive and store the interface image and the interface identifier of the current display interface. By the method, the interface images stored in the server can be more complete and comprehensive, so that other terminals can download the interface images from the server, and the integrity of the interface images in the interface image library locally pre-stored by other terminals is improved.

In addition, considering that the screen sizes of the master control terminal and the controlled terminal may be different, when the master control terminal displays the interface image of the current display interface of the controlled terminal, the interface image may be zoomed and then displayed. Therefore, in order to ensure that the controlled terminal accurately determines the operation object of the operation signal triggered by the user, in a possible implementation manner, the main control terminal determines the trigger position of the operation signal in the un-zoomed interface image according to the trigger position and the zoom scale of the operation signal in the zoomed interface image, and the position information carried in the remote control instruction includes the trigger position of the operation signal in the un-zoomed interface image; or, in another possible implementation, the position information carried in the remote control instruction includes a trigger position and a scaling ratio of the operation signal in the zoomed interface image, the controlled terminal determines the trigger position of the operation signal in the non-zoomed interface image according to the trigger position and the scaling ratio of the operation signal in the zoomed interface image, and further determines the operation object in the current display interface according to the trigger position of the operation signal in the non-zoomed interface image. By the method, the controlled terminal can accurately determine the operation object corresponding to the operation signal triggered by the user, the remote control between terminals of different models is adapted, and the applicability of the technical scheme provided by the embodiment is improved.

In summary, in the method provided in this embodiment, the controlled terminal sends the interface identifier of the current display interface to the master control terminal, and the master control terminal searches and displays the interface image of the current display interface from the pre-stored interface image library according to the interface identifier; the method solves the problems that the remote control is not smooth and more network transmission resources are occupied due to the fact that the video of the current display interface of the controlled terminal needs to be transmitted to the main control terminal in real time by the method provided by the related technology; compared with the real-time transmission of videos, the method has the advantages that the current display interface of the controlled terminal can be displayed to the user at the master control terminal side only by transmitting the interface identification, and the interface identification is much smaller than the data volume of the videos, so that the technical effects of improving remote control fluency and reducing occupied network transmission resources are achieved.

It should be noted that, in the above embodiment, the steps related to the master terminal side may be implemented separately as the transmission method in the remote control of the master terminal side, and the steps related to the controlled terminal side may be implemented separately as the transmission method in the remote control of the controlled terminal side.

The following are embodiments of the disclosed apparatus that may be used to perform embodiments of the disclosed methods. For details not disclosed in the embodiments of the apparatus of the present disclosure, refer to the embodiments of the method of the present disclosure.

FIG. 5 is a block diagram illustrating a remote control device according to an exemplary embodiment. In an embodiment, the apparatus may be a master control terminal, or may be used in a master control terminal, which is not limited in the embodiments of the present invention.

In one embodiment, the apparatus may comprise: a first receiving module 501, a searching module 502 and a displaying module 503.

The first receiving module 501 is configured to receive an interface identifier of a current display interface of the controlled terminal from the controlled terminal.

The searching module 502 is configured to search the interface image of the current display interface from a pre-stored interface image library according to the interface identifier of the current display interface received by the first receiving module 501.

The display module 503 is configured to display the interface image of the current display interface found by the finding module 502 when the interface image of the current display interface exists in the interface image library.

In summary, in the apparatus provided in this embodiment, the interface identifier of the current display interface of the controlled terminal is received from the controlled terminal through the master control terminal, so that the interface image of the current display interface is searched and displayed from the pre-stored interface image library; the method solves the problems that the remote control is not smooth and more network transmission resources are occupied due to the fact that the video of the current display interface of the controlled terminal needs to be transmitted to the main control terminal in real time by the method provided by the related technology; compared with the real-time transmission of videos, the method has the advantages that the current display interface of the controlled terminal can be displayed to the user at the master control terminal side only by transmitting the interface identification, and the interface identification is much smaller than the data volume of the videos, so that the technical effects of improving remote control fluency and reducing occupied network transmission resources are achieved.

Fig. 6 is a block diagram illustrating a remote control device according to another exemplary embodiment. In an embodiment, the apparatus may be, for example, a controlled terminal, or may be used in a controlled terminal, which is not limited in this embodiment of the present invention.

In one embodiment, the apparatus may comprise: an acquisition module 601 and a first sending module 602.

The obtaining module 601 is configured to obtain an interface identifier of a current display interface.

A first sending module 602, configured to send the interface identifier of the current display interface acquired by the acquiring module 601 to the main control terminal; the interface identifier of the current display interface is used for indicating the main control terminal to search the interface image of the current display interface from a pre-stored interface image library, and displaying the interface image of the current display interface under the condition that the interface image of the current display interface is summarized in the interface image library.

In summary, in the apparatus provided in this embodiment, the controlled terminal obtains the interface identifier of the current display interface and sends the interface identifier of the current display interface to the main control terminal, so that the main control terminal searches for and displays the interface image of the current display interface from the pre-stored interface image library according to the interface identifier of the current display interface; the method solves the problems that the remote control is not smooth and more network transmission resources are occupied due to the fact that the video of the current display interface of the controlled terminal needs to be transmitted to the main control terminal in real time by the method provided by the related technology; compared with the real-time transmission of videos, the method has the advantages that the current display interface of the controlled terminal can be displayed to the user at the master control terminal side only by transmitting the interface identification, and the interface identification is much smaller than the data volume of the videos, so that the technical effects of improving remote control fluency and reducing occupied network transmission resources are achieved.

FIG. 7 is a block diagram illustrating a remote control system in accordance with an exemplary embodiment. The system comprises: a master control terminal 500 and a controlled terminal 600.

In an embodiment, the master terminal 500 may include or may be a first remote control device, for example, and the first remote control device may include: a first receiving module 501, a searching module 502 and a displaying module 503.

The first receiving module 501 is configured to receive, from the controlled terminal 600, an interface identifier of a currently displayed interface of the controlled terminal 600.

Optionally, the first remote control device may further include: an acquisition module 504 and a first sending module 505.

An obtaining module 504 configured to obtain an operation signal corresponding to the interface image of the current display interface displayed by the display module 503.

The first sending module 505 is configured to send a remote control instruction to the controlled terminal 600 according to the operation signal obtained by the obtaining module 504, where the remote control instruction is used to instruct the controlled terminal 600 to execute a corresponding operation.

Optionally, the first sending module 505 includes: an acquisition submodule 505a and a sending submodule 505 b.

The obtaining sub-module 505a is configured to obtain the position information and the action information corresponding to the operation signal obtained by the obtaining module 504.

And the sending sub-module 505b is configured to send a remote control instruction to the controlled terminal 600, where the remote control instruction includes the position information and the action information acquired by the acquiring sub-module 505 a.

Optionally, the first remote control device may further include: a second sending module 506 and a second receiving module 507.

The second sending module 506 is configured to send an image obtaining request to the controlled terminal 600 when the interface image of the current display interface does not exist in the interface image library, where the image obtaining request is used to request to obtain the interface image of the current display interface.

And a second receiving module 507 configured to receive an interface image of the currently displayed interface from the controlled terminal 600.

Optionally, the first remote control device may further include: a storage module 508.

The storing module 508 is configured to correspondingly store the interface image of the current display interface received by the second receiving module 507 and the interface identifier of the current display interface into the interface image library.

In an embodiment, the controlled terminal 600 may include or may be a second remote control device, for example, the second remote control device may include: an acquisition module 601 and a first sending module 602.

A first sending module 602, configured to send the interface identifier of the current display interface acquired by the acquiring module 601 to the main control terminal 500; the interface identifier of the current display interface is used to instruct the main control terminal 500 to search for the interface image of the current display interface from a pre-stored interface image library, and display the interface image of the current display interface when the interface image of the current display interface exists in the interface image library.

Optionally, the second remote control device further comprises: a first receiving module 603 and an executing module 604.

A first receiving module 603 configured to receive a remote control instruction from the main control terminal 500, the remote control instruction being generated according to an operation signal corresponding to an interface image of a currently displayed interface.

An executing module 604 configured to execute corresponding operations according to the remote control instruction received by the first receiving module 603.

Optionally, the remote control instruction includes position information and motion information corresponding to the operation signal.

Accordingly, the execution module 604 includes: a determination sub-module 604a and an execution sub-module 604 b.

The determining sub-module 604a is configured to determine an operation object in the current display interface according to the position information.

An execution sub-module 604b configured to execute an operation corresponding to the action information on the operation object determined by the determination sub-module 604 a.

Optionally, the second remote control device further comprises: a second receiving module 605 and a second sending module 606.

A second receiving module 605, configured to receive an image obtaining request from the main control terminal 500, where the image obtaining request is used to request to obtain an interface image of the current display interface, and the image obtaining request is sent by the main control terminal 500 when the interface image of the current display interface does not exist in the interface image library.

A second sending module 606 configured to send the interface image of the current display interface to the master control terminal 500 according to the image obtaining request received by the second receiving module 605.

In summary, in the system provided in this embodiment, the controlled terminal sends the interface identifier of the current display interface to the master control terminal, the master control terminal searches and displays the interface image of the current display interface from a pre-stored interface image library according to the interface identifier, and after obtaining the operation signal corresponding to the interface image, sends the remote control instruction to the controlled terminal according to the operation signal, so that the controlled terminal executes the corresponding operation according to the remote control instruction; the method solves the problems that the remote control is not smooth and more network transmission resources are occupied due to the fact that the video of the current display interface of the controlled terminal needs to be transmitted to the main control terminal in real time by the method provided by the related technology; compared with the real-time transmission of videos, the method has the advantages that the current display interface of the controlled terminal can be displayed to the user at the master control terminal side only by transmitting the interface identification, and the interface identification is much smaller than the data volume of the videos, so that the technical effects of improving remote control fluency and reducing occupied network transmission resources are achieved.

It should be noted that, when the apparatus provided in the foregoing embodiment implements the functions thereof, only the division of the above functional modules is illustrated, and in practical applications, the functions may be distributed by different functional modules according to actual needs, that is, the content structure of the device may be divided into different functional modules to implement all or part of the functions described above.

With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.

An exemplary embodiment of the present disclosure further provides a remote control apparatus, which can implement the transmission method in the remote control on the master control terminal side provided in the embodiment of the present disclosure. The device includes: a processor, and a memory for storing executable instructions for the processor.

Wherein the processor is configured to:

Optionally, the processor is further configured to:

acquiring an operation signal corresponding to an interface image of a current display interface;

and sending a remote control instruction to the controlled terminal according to the operation signal, wherein the remote control instruction is used for indicating the controlled terminal to execute corresponding operation.

Optionally, the processor is configured to:

acquiring position information and action information corresponding to the operation signal;

and sending the remote control instruction to the controlled terminal, wherein the remote control instruction comprises the position information and the action information.

Optionally, the processor is further configured to:

when the interface image of the current display interface does not exist in the interface image library, sending an image acquisition request to the controlled terminal, wherein the image acquisition request is used for requesting to acquire the interface image of the current display interface;

and receiving the interface image of the current display interface from the controlled terminal.

Optionally, the processor is further configured to:

and correspondingly storing the interface image of the current display interface and the interface identifier of the current display interface into the interface image library.

Another exemplary embodiment of the present disclosure further provides a remote control apparatus, which is capable of implementing the transmission method in the remote control on the controlled terminal side provided in the embodiments of the present disclosure. The device includes: a processor, and a memory for storing executable instructions for the processor.

Wherein the processor is configured to:

acquiring an interface identifier of a current display interface;

sending an interface identifier of a current display interface to a master control terminal; the interface identifier of the current display interface is used for indicating the main control terminal to search the interface image of the current display interface from a pre-stored interface image library and display the interface image of the current display interface under the condition that the interface image of the current display interface exists in the interface image library.

Optionally, the processor is further configured to:

receiving a remote control instruction from a master control terminal, wherein the remote control instruction is generated by the master control terminal according to an operation signal of an interface image corresponding to the current display interface;

and executing corresponding operation according to the remote control instruction.

accordingly, the processor is configured to:

determining an operation object in the current display interface according to the position information;

and executing the operation corresponding to the action information on the operation object.

Optionally, the processor is further configured to:

receiving an image acquisition request from the master control terminal, wherein the image acquisition request is used for requesting to acquire an interface image of the current display interface, and the image acquisition request is sent by the master control terminal under the condition that the interface image of the current display interface does not exist in the interface image library;

and sending the interface image of the current display interface to the master control terminal.

Fig. 8 is a block diagram illustrating an apparatus 800 according to an example embodiment. For example, the apparatus 800 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, and the like.

Referring to fig. 8, the apparatus 800 may include one or more of the following components: a processing component 802, a memory 804, a power component 806, a multimedia component 808, an audio component 810, an input/output (I/O) interface 812, a sensor component 814, and a communication component 816.

The processing component 802 generally controls overall operation of the device 800, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing components 802 may include one or more processors 820 to execute instructions to perform all or a portion of the steps of the methods described above. Further, the processing component 802 can include one or more modules that facilitate interaction between the processing component 802 and other components. For example, the processing component 802 can include a multimedia module to facilitate interaction between the multimedia component 808 and the processing component 802.

The memory 804 is configured to store various types of data to support operations at the apparatus 800. Examples of such data include instructions for any application or method operating on device 800, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 804 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.

Power components 806 provide power to the various components of device 800. The power components 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the apparatus 800.

The multimedia component 808 includes a screen that provides an output interface between the device 800 and the user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the device 800 is in an operating mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

The audio component 810 is configured to output and/or input audio signals. For example, the audio component 810 includes a Microphone (MIC) configured to receive external audio signals when the apparatus 800 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 804 or transmitted via the communication component 816. In some embodiments, audio component 810 also includes a speaker for outputting audio signals.

The I/O interface 812 provides an interface between the processing component 802 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.

The sensor assembly 814 includes one or more sensors for providing various aspects of state assessment for the device 800. For example, the sensor assembly 814 may detect the open/closed status of the device 800, the relative positioning of the components, such as a display and keypad of the device 800, the sensor assembly 814 may also detect a change in the position of the device 800 or a component of the device 800, the presence or absence of user contact with the device 800, the orientation or acceleration/deceleration of the device 800, and a change in the temperature of the device 800. Sensor assembly 814 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 816 is configured to facilitate communications between the apparatus 800 and other devices in a wired or wireless manner. The device 800 may access a wireless network based on a communication standard, such as Wi-Fi, 2G, or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, communications component 816 further includes a Near Field Communications (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the apparatus 800 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.

In an exemplary embodiment, a non-transitory computer-readable storage medium comprising instructions, such as the memory 804 comprising instructions, executable by the processor 820 of the device 800 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

A non-transitory computer readable storage medium, wherein instructions in the storage medium, when executed by a processor of an apparatus 800, enable the apparatus 800 to perform the transmission method in the remote control of the master terminal side or the slave terminal side described above.

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A transmission method in remote control is applied to a main control terminal, and the method comprises the following steps:

receiving an interface identifier and a device identifier of a current display interface of a controlled terminal from the controlled terminal, wherein the interface identifier is an identifier for uniquely identifying the display interface of the terminal device, different display interfaces correspond to different interface identifiers, the interface identifier is a name of the display interface, or a mark number pre-allocated to each display interface, or other unique identifiers, and the device identifier is used for uniquely identifying a device model of the terminal device, or is used for uniquely identifying the terminal device;

determining the equipment model of the controlled terminal according to the equipment identifier of the current display interface, selecting a corresponding interface image library according to the equipment model, searching the interface image of the current display interface from a pre-stored interface image library according to the interface identifier of the current display interface, and storing the interface image of the display interface with the use frequency/frequency greater than a preset value in the remote control process in the interface image library;

when the interface image of the current display interface exists in the interface image library, displaying the interface image of the current display interface;

acquiring an operation signal corresponding to the interface image of the current display interface;

sending a remote control instruction to the controlled terminal according to the operation signal, where the remote control instruction is used to instruct the controlled terminal to execute a corresponding operation, the screen sizes of the master control terminal and the controlled terminal are different, the remote control instruction carries position information and action information, the position information includes a trigger position and a zoom ratio of the operation signal in a zoomed interface image, or the position information includes a trigger position of the operation signal in an un-zoomed interface image, the controlled terminal determines the trigger position of the operation signal in the un-zoomed interface image according to the position information, determines an operation object in a current display interface according to the trigger position, and the action information is used for the controlled terminal to determine an operation to be executed on the operation object;

when the interface image of the current display interface of the controlled terminal does not exist in the interface image library, sending an image acquisition request to the controlled terminal, wherein the image acquisition request is used for requesting to acquire the interface image of the current display interface of the controlled terminal; and receiving and displaying an interface image of a current display interface of the controlled terminal, and correspondingly storing the interface image of the current display interface and the interface identifier of the current display interface into the interface image library.

2. The method according to claim 1, wherein the sending a remote control command to the controlled terminal according to the operation signal includes:

and sending the remote control instruction to the controlled terminal.

3. A transmission method in remote control is applied to a controlled terminal, and the method comprises the following steps:

acquiring an interface identifier and an equipment identifier of a current display interface, wherein the interface identifier refers to an identifier for uniquely identifying the display interface of terminal equipment, different display interfaces correspond to different interface identifiers, the interface identifier is the name of the display interface, or a mark number pre-allocated to each display interface, or other unique identifiers, and the equipment identifier is used for uniquely identifying the equipment model of the terminal equipment, or uniquely identifying the terminal equipment;

sending the interface identifier and the equipment identifier of the current display interface to a master control terminal; the device identifier is used for determining a device model of the controlled terminal to select an interface image library, the interface identifier of the current display interface is used for indicating the main control terminal to search for an interface image of the current display interface from a pre-stored interface image library, and the interface image of the current display interface is displayed under the condition that the interface image of the current display interface exists in the interface image library, and the interface image of the display interface with the use frequency/frequency greater than a preset value in the remote control process is stored in the interface image library;

receiving a remote control instruction from the master control terminal, wherein the remote control instruction is generated according to an operation signal of an interface image corresponding to the current display interface;

executing corresponding operation according to the remote control instruction, wherein the screen sizes of the master control terminal and the controlled terminal are different, the remote control instruction carries position information and action information, the position information comprises a trigger position and a scaling ratio of the operation signal in a scaled interface image, or the position information comprises a trigger position of the operation signal in an un-scaled interface image, the trigger position of the operation signal in the un-scaled interface image is determined according to the position information, an operation object in a current display interface is determined according to the trigger position, and the action information is used for the controlled terminal to determine the operation executed on the operation object;

receiving an image acquisition request sent by the master control terminal, wherein the image acquisition request is used for requesting to acquire an interface image of a current display interface of the controlled terminal, and the image acquisition request is sent by the master control terminal under the condition that the interface image of the current display interface does not exist in the interface image library; and sending the interface image of the current display interface to the master control terminal so that the master control terminal receives and displays the interface image of the current display interface from the controlled terminal, and correspondingly storing the interface image of the current display interface and the interface identifier of the current display interface into the interface image library by the master control terminal.

4. The method of claim 3, wherein performing the corresponding operation according to the remote control instruction comprises:

5. A remote control apparatus, characterized in that the apparatus comprises:

the first receiving module is configured to receive, from a controlled terminal, an interface identifier and a device identifier of a current display interface of the controlled terminal, where the interface identifier is an identifier for uniquely identifying a display interface of a terminal device, different display interfaces correspond to different interface identifiers, the interface identifier is a name of the display interface, or a label pre-assigned to each display interface, or another unique identifier, and the device identifier is used for uniquely identifying a device model of the terminal device, or is used for uniquely identifying the terminal device;

the searching module is configured to determine the equipment model of the controlled terminal according to the equipment identifier of the current display interface, select a corresponding interface image library according to the equipment model, search the interface image of the current display interface from a pre-stored interface image library according to the interface identifier of the current display interface, and store the interface image of the display interface with the use frequency/frequency greater than a preset value in the interface image library in the remote control process;

the display module is configured to display the interface image of the current display interface when the interface image of the current display interface exists in the interface image library;

the acquisition module is configured to acquire an operation signal corresponding to the interface image of the current display interface;

a first sending module configured to send a remote control instruction to the controlled terminal according to the operation signal, the remote control instruction is used for instructing the controlled terminal to execute corresponding operation, the screen sizes of the main control terminal and the controlled terminal are different, the remote control instruction carries position information and action information, the position information comprises a trigger position and a scaling of the operation signal in the interface image after scaling, or the position information comprises a trigger position of the operation signal in the interface image which is not zoomed, the controlled terminal determines the trigger position of the operation signal in the un-zoomed interface image according to the position information, determining an operation object in the current display interface according to the trigger position, wherein the action information is used for the controlled terminal to determine the operation executed on the operation object; when the interface image of the current display interface of the controlled terminal does not exist in the interface image library, sending an image acquisition request to the controlled terminal, wherein the image acquisition request is used for requesting to acquire the interface image of the current display interface of the controlled terminal; and receiving and displaying an interface image of a current display interface of the controlled terminal, and correspondingly storing the interface image of the current display interface and the interface identifier of the current display interface into the interface image library.

6. The apparatus of claim 5, wherein the first sending module comprises:

and the sending submodule is configured to send the remote control instruction to the controlled terminal.

7. A remote control apparatus, characterized in that the apparatus comprises:

the system comprises an acquisition module, a display module and a display module, wherein the acquisition module is configured to acquire an interface identifier and a device identifier of a current display interface, the interface identifier is an identifier for uniquely identifying the display interface of the terminal device, different display interfaces correspond to different interface identifiers, the interface identifier is a name of the display interface, or a mark number pre-allocated to each display interface, or other unique identifiers, and the device identifier is used for uniquely identifying the device model of the terminal device, or uniquely identifying the terminal device;

the first sending module is configured to send the interface identifier and the equipment identifier of the current display interface to the master control terminal; the device identifier is used for determining a device model of a controlled terminal to select an interface image library, the interface identifier of the current display interface is used for indicating the master control terminal to search for an interface image of the current display interface from a pre-stored interface image library, and the interface image of the current display interface is displayed under the condition that the interface image of the current display interface exists in the interface image library, and the interface image of the display interface with the use frequency/frequency greater than a preset value in the remote control process is stored in the interface image library;

a first receiving module configured to receive a remote control instruction from the main control terminal, the remote control instruction being generated according to an operation signal corresponding to an interface image of the current display interface;

an execution module, configured to execute a corresponding operation according to the remote control instruction, where the screen sizes of the master control terminal and the controlled terminal are different, the remote control instruction carries location information and action information, the location information includes a trigger location and a scaling ratio of the operation signal in a scaled interface image, or the location information includes a trigger location of the operation signal in an un-scaled interface image, the trigger location of the operation signal in the un-scaled interface image is determined according to the location information, an operation object in a current display interface is determined according to the trigger location, and the action information is used for the controlled terminal to determine an operation performed on the operation object; receiving an image acquisition request sent by the master control terminal, wherein the image acquisition request is used for requesting to acquire an interface image of a current display interface of the controlled terminal, and the image acquisition request is sent by the master control terminal under the condition that the interface image of the current display interface does not exist in the interface image library; and sending the interface image of the current display interface to the master control terminal so that the master control terminal receives and displays the interface image of the current display interface from the controlled terminal, and correspondingly storing the interface image of the current display interface and the interface identifier of the current display interface into the interface image library by the master control terminal.

8. The apparatus of claim 7, wherein the execution module comprises:

9. A remote control system, the system comprising: the system comprises a main control terminal and a controlled terminal;

the master terminal comprises a remote control apparatus according to any one of claims 5 to 6;

the controlled terminal comprises a remote control device according to any one of claims 7 to 8.

10. A remote control apparatus, characterized in that the apparatus comprises:

a processor;

a memory for storing executable instructions of the processor;

wherein the processor is configured to:

sending a remote control instruction to the controlled terminal according to the operation signal, where the remote control instruction is used to instruct the controlled terminal to execute corresponding operations, and the screen sizes of the master control terminal and the controlled terminal are different, where the remote control instruction carries position information and action information, where the position information includes a trigger position and a scaling ratio of the operation signal in a scaled interface image, or the position information includes a trigger position of the operation signal in an un-scaled interface image, and the controlled terminal determines the trigger position of the operation signal in the un-scaled interface image according to the position information, and determines an operation object in a current display interface according to the trigger position, and the action information is used for the controlled terminal to determine the operations executed on the operation object; when the interface image of the current display interface of the controlled terminal does not exist in the interface image library, sending an image acquisition request to the controlled terminal, wherein the image acquisition request is used for requesting to acquire the interface image of the current display interface of the controlled terminal; and receiving and displaying an interface image of a current display interface of the controlled terminal, and correspondingly storing the interface image of the current display interface and the interface identifier of the current display interface into the interface image library.

11. A remote control apparatus, characterized in that the apparatus comprises:

a processor;

a memory for storing executable instructions of the processor;

wherein the processor is configured to:

sending the interface identifier and the equipment identifier of the current display interface to a master control terminal; the device identifier is used for determining a device model of a controlled terminal to select an interface image library, the interface identifier of the current display interface is used for indicating the master control terminal to search for an interface image of the current display interface from a pre-stored interface image library, and the interface image of the current display interface is displayed under the condition that the interface image of the current display interface exists in the interface image library, and the interface image of the display interface with the use frequency/frequency greater than a preset value in the remote control process is stored in the interface image library;

executing corresponding operation according to the remote control instruction, wherein the screen sizes of the master control terminal and the controlled terminal are different, the remote control instruction carries position information and action information, the position information comprises a trigger position and a scaling ratio of the operation signal in a scaled interface image, or the position information comprises a trigger position of the operation signal in an un-scaled interface image, the trigger position of the operation signal in the un-scaled interface image is determined according to the position information, an operation object in a current display interface is determined according to the trigger position, the action information is used for the controlled terminal to determine the operation executed on the operation object, and an image acquisition request sent by the master control terminal is received, and the image acquisition request is used for requesting to acquire the interface image of the current display interface of the controlled terminal, the image acquisition request is sent by the main control terminal under the condition that the interface image of the current display interface does not exist in the interface image library; and sending the interface image of the current display interface to the master control terminal so that the master control terminal receives and displays the interface image of the current display interface from the controlled terminal, and correspondingly storing the interface image of the current display interface and the interface identifier of the current display interface into the interface image library by the master control terminal.

12. A computer-readable storage medium comprising at least one instruction which, when executed by a processor, implements a transmission method in a remote control of any of claims 1-2 or claims 3-4.