WO2017020523A1

WO2017020523A1 - Method and apparatus for remote control of terminal

Info

Publication number: WO2017020523A1
Application number: PCT/CN2015/099896
Authority: WO
Inventors: 赫卫卿; 卜翔; 武恒
Original assignee: 安一恒通（北京）科技有限公司
Priority date: 2015-07-31
Filing date: 2015-12-30
Publication date: 2017-02-09
Also published as: CN105072171A

Abstract

Disclosed are a method and apparatus for remote control of a terminal. A specific implementation manner of the method comprises: obtaining connection information from a controlled terminal, the connection information comprising a session parameter, the session parameter being a session parameter of a session established by the controlled terminal with a session server; establishing a connection to the session server; sending, to the session server, a request for establishing a transfer connection to the controlled terminal, the request comprising the session parameter; receiving interaction information input by a user, and generating a control command on the basis of the interaction information; and sending the control command to the controlled terminal by using the established transfer connection. The implementation manner realizes cross-network remote control of a terminal.

Description

Method and apparatus for remotely controlling a terminal

Cross-reference to related applications

The present application claims priority to Chinese Patent Application No. 201510463492.2, filed on Jul. 31, 2015, the entire disclosure of which is incorporated herein in its entirety.

Technical field

The present application relates to the field of communications technologies, and in particular, to the field of remote control technologies, and in particular, to a method and apparatus for remotely controlling a terminal.

Background technique

The operation of the local terminal can be controlled by means of a computer keyboard or a mouse, but this control mode limits the range of motion when the user operates the terminal, and must be kept at a short distance from the computer to complete the corresponding control. Currently, this solution can be alleviated by an external Bluetooth controller solution. In addition, the smart phone can also remotely control the PC by connecting to a local area network hotspot established by a PC (personal computer). However, remote control across the network is also required, reducing the dependence of remote control on additional communication devices and simplifying network setup.

Summary of the invention

The purpose of the present application is to propose an improved method and apparatus for remotely controlling a terminal to solve the technical problems mentioned in the background section above.

In one aspect, the application provides a method for remotely controlling a terminal, the method comprising: obtaining connection information from a controlled terminal, the connection information including a session parameter, the session parameter being the controlled terminal and the session a session parameter of a session established by the server; establishing a connection with the session server; sending a request to the session server to establish a transit connection to the controlled terminal, the request including the session parameter; receiving interaction information input by the user And generating a control command based on the interaction information; through the established transit connection And sending the control command to the controlled terminal.

In some embodiments, the obtaining the connection information from the controlled terminal comprises: acquiring a two-dimensional code from the controlled terminal in response to a scanning action on the controlled terminal, the two-dimensional code being according to the The connection information is encoded; and the connection information is obtained according to the two-dimensional code.

In some embodiments, the establishing a connection with the session server includes establishing a connection with the session server through a pre-installed application.

In some embodiments, the connection information further includes an address of a web server, the web server storing an HTML5 control page for establishing a connection with the session server; and the establishing a connection with the session server, including: Accessing the web server according to the address of the web server, downloading the control page from the web server, and connecting the session server through the control page.

In some embodiments, after the sending the control command to the controlled terminal by using the relay connection, the method further comprises: receiving, by the controlled terminal, the controlled terminal returned by the relay connection status information.

In some embodiments, the control command is an operational command for a document presentation application.

In a second aspect, the present application provides an apparatus for remotely controlling a terminal, the apparatus comprising: a connection information acquiring unit configured to acquire connection information from a controlled terminal, the connection information including a session parameter, the session The parameter is a session parameter of the session established by the controlled terminal and the session server; the session establishing unit is configured to establish a connection with the session server; the transit connection establishing unit is configured to send the establishment arrival to the session server a request for a transit connection of the controlled terminal, the request including the session parameter; a control command generating unit configured to receive interaction information input by the user, generate a control command based on the interaction information; and a control command sending unit configured to be configured to: The control command is sent to the controlled terminal through the established transit connection.

In some embodiments, the connection information obtaining unit includes:

a two-dimensional code acquisition sub-unit, configured to acquire a two-dimensional code from the controlled terminal in response to a scanning action on the controlled terminal, where the two-dimensional code is coded according to the connection information; a code decoding subunit configured to acquire the connection letter according to the two-dimensional code interest.

In some embodiments, the session establishing unit is configured to establish a connection with the session server through a pre-installed application.

In some embodiments, the connection information further includes an address of a web server, the web server stores an HTML5 control page for establishing a connection with the session server; and the session establishing unit is configured to: according to the The address of the web server accesses the web server, downloads the control page from the web server, and connects the session server through the control page.

In some embodiments, the apparatus further includes a return information receiving unit configured to receive the controlled terminal through the relay connection after the sending the control command to the controlled terminal by the relay connection Status information of the controlled terminal returned.

The method and device for remotely controlling a terminal provided by the present application, because the control terminal and the controlled terminal establish a transit connection through a session server in the public network, and the control terminal can forward the control command by using the session server, and can perform the control terminal on the controlled terminal. Remote control across the network. At the same time, this remote control method does not require additional communication equipment on the terminal, and does not require complicated network configuration, thereby reducing the cost and time of the user.

DRAWINGS

Other features, objects, and advantages of the present application will become more apparent from the detailed description of the accompanying drawings.

1 is a flow chart of one embodiment of a method for remotely controlling a terminal in accordance with the present application;

2 is a flow diagram of establishing a connection with a session server in accordance with the present application;

3 is a flow chart of obtaining connection information from a controlled terminal by scanning a two-dimensional code according to the present application;

4 is a schematic diagram of establishing a connection with a session server according to an address of a web server according to the present application;

Figure 5 is a diagram of one embodiment of an apparatus for remotely controlling a terminal in accordance with the present application Schematic diagram.

detailed description

The present application will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention, rather than the invention. It is also to be noted that, for the convenience of description, only the parts related to the related invention are shown in the drawings.

It should be noted that the embodiments in the present application and the features in the embodiments may be combined with each other without conflict. The present application will be described in detail below with reference to the accompanying drawings.

Please refer to FIG. 1, which illustrates a flow 100 of one embodiment of a method for remotely controlling a terminal. This embodiment is mainly illustrated by the method being applied to a control terminal including a display screen, which may include a smart phone, a tablet computer, a laptop portable computer, a desktop computer, and the like. The method for controlling a terminal includes the following steps:

Step 101: Acquire connection information from the controlled terminal.

In this embodiment, the control terminal (for example, a smart phone for controlling the remote terminal) acquires connection information from the controlled terminal (for example, a personal computer), and the connection information includes a session parameter, which is a pre-control of the controlled terminal and the session server. The session parameters corresponding to the established session, and the unique session can be determined through the session parameters.

The session parameters may include an identifier of the controlled terminal in the session, a timestamp of the session, and the like. The identifier of the controlled terminal may be the machine ID (identification number) of the controlled terminal. The identifier of the controlled terminal corresponds to the unique session of the session.

In addition, the connection information may also include a download address corresponding to an application that remotely controls the controlled terminal.

The control terminal and the controlled terminal end can directly access the session server through the public network without using a local area network hotspot or relying on Bluetooth.

Step 102, establishing a connection with the session server.

The control terminal can establish a connection with the session server through the public network. The control terminal can obtain the address of the session server according to some parameters in the connection information, and the control terminal can also advance Store the address of the session server. For example, when the connection information includes a download address corresponding to an application that remotely controls the controlled terminal, the control terminal may download and install a corresponding application according to the download address, where the application includes the address of the session server, and the control terminal is installed and Once the app is launched, you can connect to the session server.

It should be noted that the control terminal may need to connect multiple times when connecting to the session server. As shown in the flowchart 200 in FIG. 2, after the control terminal sends a connection request to the session server, it determines whether the connection is successfully established with the session server through the connection state information returned by the session server. If it is connected, proceed to the next step for subsequent operations. If it is not connected, it determines whether the number of connections has reached the maximum number of connections: if the maximum number of connections is not reached, then continue to connect to the session server; if the maximum number of connections has been reached, the connection between the control terminal and the session server fails.

Step 103: Send a request to the session server to establish a transit connection to the controlled terminal.

In this embodiment, after the control terminal establishes a connection with the session server, the control terminal sends a request for establishing a transit connection to the controlled terminal to the session server. Among them, the request includes a session parameter. After transmitting the above request, the control terminal waits for the session server to establish a transit connection.

The session server matches the received session parameters with the session parameters received from the controlled terminal in advance. When the parameters are consistent, the control terminal establishes a transit connection with the controlled terminal, and the control terminal can implement communication by receiving and forwarding data through the session server. .

Step 104: Receive interaction information input by a user, and generate a control command based on the interaction information.

In this embodiment, the control terminal may present a control interface, which may be the same as the interface of the controlled terminal, or may be an interface having only a few control components. The receiving terminal may receive the user's input of the interactive information by receiving the touch signal on the control interface, or receiving the user input information through the keyboard, or receiving the mobile information of the mouse. Those skilled in the art will appreciate that the interactive information is not limited to the ones listed above.

In this embodiment, the control terminal may establish a matching relationship between the different interaction information and the control command. After receiving the interaction information, the interaction information may be converted into the interaction information according to the matching relationship. Corresponding control commands.

Step 105: Send a control command to the controlled terminal through the established transit connection.

After the control terminal establishes the request for the transit connection to be accepted by the session server, the session server establishes a transit connection between the control terminal and the controlled terminal according to the session parameter to establish the control terminal to reach the controlled terminal session parameter. The control terminal can send the above control command to the controlled terminal through the established transit connection.

In an optional implementation manner of this embodiment, obtaining connection information from the controlled terminal, as shown in the process 300 in FIG. 3, includes:

Step 301: Acquire a two-dimensional code from the controlled terminal in response to the scanning action on the controlled terminal.

When the control terminal scans the controlled terminal, the control terminal responds to the scanning action. Thereafter, the control terminal can start a scanning device such as a scanner or a camera to read the two-dimensional code image displayed by the controlled terminal.

A 2-dimensional bar code is a black-and-white graphic that records data symbol information in a plane (two-dimensional direction) with a certain geometric pattern. The code is used skillfully to construct a computer. The concept of the "0" and "1" bitstreams of the internal logic base uses a number of geometric shapes corresponding to the binary to represent the literal value information, and is automatically read by the image input device or the photoelectric scanning device to realize automatic information processing. The two-dimensional code in the optional implementation is that the control terminal is coded according to the connection information, and the two-dimensional barcode/two-dimensional code may be a stacked/row row two-dimensional barcode, or may be a matrix two-dimensional barcode, The code system of the code can be any one of Data Matrix, Maxi Code, Aztec, QR Code, Vericode, PDF417, Ultracode, Code 49, and Code 16K. Those skilled in the art should understand that the coding manner of the two-dimensional code in the optional implementation is not limited to the ones listed above.

In this way, the control terminal can acquire the two-dimensional code including the above connection information from the controlled terminal.

Step 302: Acquire connection information according to the two-dimensional code.

After acquiring the two-dimensional code, the control terminal decodes the two-dimensional code image by using a decoding algorithm, and the decoding algorithm used corresponds to the encoding algorithm of the controlled terminal. After the control terminal decodes the two-dimensional code image, the connection information corresponding to the two-dimensional code can be obtained.

By reading the two-dimensional code, the connection information can be quickly obtained, which helps to establish a connection quickly and quickly, and reduces the operation time of the user.

In some optional implementations of this embodiment, establishing a connection with the session server includes establishing a connection with the session server through the pre-installed application. The control terminal and the controlled terminal can be pre-installed with an application that can be remotely controlled before the connection is made. The application installed in the control terminal contains the address of the session server, and the control terminal only needs to start the application, and the application can be used to establish a connection with the session server. The control terminal directly establishes a connection with the session server through the pre-installed application, and the control terminal has fewer connection steps, and does not need to perform operations such as downloading, thereby reducing the waiting time of the user.

In some optional implementation manners of the embodiment, the connection information further includes an address of the web server, where the web server stores an HTML5 control page, the control page is used to establish a connection with the session server, and the session server Establishing the connection comprises: accessing the web server according to the address of the web server; downloading the control page from the web server; and connecting the session server through the control page.

The connection information obtained by the control terminal from the controlled terminal further includes an address of the web server, and the web server stores an HTML5 control page that can be used to connect to the session server. Web Server is commonly referred to as a Web server. Its main function is to provide online information browsing services. In this alternative implementation, the web server is used to store control pages. HTML5 is the fifth major revision of HyperText Markup Language (HTML), the core language of the World Wide Web and the standard universal markup language. WebSocket (Web Sockets) provided by HTML5 is a new protocol that enables two-way communication between the browser and the server. In the optional implementation manner, the address of the session server may be stored in the HTML5 control page. When the control terminal loads the control page by using the browser, the control terminal can be used to implement communication between the control terminal and the session server.

FIG. 4 shows a schematic diagram of the control terminal establishing a connection with the session server according to the address of the web server. The control terminal can access the web server according to the address of the web server in the connection information, and download the above control page from the web server. The control terminal can load the downloaded control page through the browser, and can use the session server address stored in the page to locate the session server, and simultaneously use the HTML5 WebSocket protocol. The session server establishes a connection.

By connecting the HTML5 page through the browser to establish a connection with the session server, the connection can be established directly by means of a universal browser, so that the user does not have to install additional applications in the control terminal, and the storage space of the control terminal is reduced.

In some optional implementation manners of this embodiment, after the control command is sent to the controlled terminal by using the transit connection, the method further includes: receiving status information of the controlled terminal returned by the controlled terminal through the transit connection.

The control terminal sends the control command to the controlled terminal through the transit connection, and can wait for feedback from the controlled terminal. After receiving the control command, the controlled terminal performs corresponding operations according to the control command. These operations may cause the state of the controlled terminal to change. The controlled terminal may send its own state information back to the control terminal through the relay connection. The control terminal can receive status information of the controlled terminal returned through the relay connection. The control terminal may also display the status information of the controlled terminal on the control interface, so as to use the user of the control terminal to know the current state of the controlled terminal, and also enable the user to know whether the controlled terminal completes the execution of the control command.

In some optional implementations of this embodiment, the control command is an operation instruction for a document presentation application.

In this embodiment, an optional control command is used for the operation of the document presentation application. Taking PPT (Microsoft Office PowerPoint, Microsoft's presentation application) as an example, the control commands for the PPT may be an auto play command, a pause command, an instruction to play the next slide, an instruction to play the previous slide, a slide show. Slice positioning command, end projection command, and the like. Those skilled in the art will appreciate that the control instructions are not limited to the ones listed above. The above document presentation application is not limited to PPT.

For the embodiment, the application scenario may be that the user can use the smart phone as the control terminal to control the PC as the controlled terminal. Because the control terminal and the controlled terminal can access the session through the public network in this embodiment. The server establishes a connection and forwards the control command through the session server, and the control terminal can implement remote control of the controlled terminal across the network, and is no longer limited to the internal area of the local area network. At the same time, this remote control method does not require installation of additional communication devices on the terminal, nor does it require complicated network configuration, reducing the cost and time of the user.

With further reference to FIG. 5, as an implementation of the method shown in the above figures, the present application provides An embodiment of a device for remotely controlling a terminal, the device embodiment corresponding to the method embodiment shown in FIG. 1, the device being specifically applicable to a terminal device.

As shown in FIG. 5, the apparatus 500 for remotely controlling a terminal according to this embodiment includes: a connection information acquiring unit 501, a session establishing unit 502, a relay connection establishing unit 503, a control command generating unit 504, and a control command sending unit 505. . The connection information obtaining unit 501 is configured to acquire connection information from the controlled terminal, where the connection information includes a session parameter, the session parameter is a session parameter of the session established by the controlled terminal and the session server, and the session establishing unit 502 is configured to use Establishing a connection with the session server; the transit connection establishing unit 503 is configured to send a request to the session server to establish a transit connection to the controlled terminal, the request includes the session parameter; and the control command generating unit 504 is configured And receiving the interaction information input by the user, and generating a control command based on the interaction information; the control command sending unit 505 is configured to send the control command to the controlled terminal by using the established transit connection.

In this embodiment, the connection information acquiring unit 501 of the device 500 acquires connection information from a controlled terminal (for example, a PC), where the connection information includes a session parameter, where the session parameter corresponds to a session established in advance by the controlled terminal and the session server. Session parameters, through the session parameters to determine a unique session.

In this embodiment, the session establishing unit 502 can establish a connection with the session server through the public network. The session establishing unit 502 can obtain the address of the session server according to some parameters in the connection information, and can also obtain the address of the pre-stored session server from the control terminal.

In this embodiment, after the session establishing unit 502 establishes a connection with the session server, the relay connection establishing unit 503 may send a request for establishing a transit connection to the controlled terminal to the session server, and wait for the session server after sending the request. Verify and match. Among them, the request includes a session parameter.

In this embodiment, the control command generating unit 504 may present a control interface, which may be the same as the interface of the controlled terminal, or may be an interface having only a few control components. The receiving of the interaction information input by the user by the control command generating unit 504 may be receiving a touch signal of the user on the control interface, or receiving input information that the user taps through the keyboard, or may be receiving movement information of the mouse. Control command generation unit 504 can establish a matching relationship between different interaction information and the control command. After receiving the interaction information, the interaction information can be converted into a control command according to the corresponding matching relationship.

In this embodiment, the control command sending unit 505 can send the above control command to the controlled terminal by establishing a good transit connection.

In an optional implementation manner of the embodiment, the connection information acquiring unit 501 includes: a two-dimensional code acquiring subunit (not shown) configured to obtain a two-dimensional code from the controlled terminal in response to a scanning action of the user. The two-dimensional code is encoded according to the connection information; the two-dimensional code decoding subunit (not shown) is configured to acquire connection information according to the two-dimensional code.

It will be understood by those skilled in the art that the above-mentioned apparatus 500 for remotely controlling a terminal further includes some other well-known structures, such as a processor, a memory, etc., in order to unnecessarily obscure the embodiments of the present disclosure, these well-known structures are not shown in FIG. Out.

The units involved in the embodiments of the present application may be implemented by software or by hardware. The described unit may also be provided in the processor, for example, as a processor including a connection information acquisition unit, a session establishment unit, a relay connection establishment unit, a control command generation unit, and a control command transmission unit. The name of these units does not constitute a limitation on the unit itself in some cases. For example, the connection information acquisition unit may also be described as "a unit configured to acquire connection information from a controlled terminal".

In another aspect, the present application further provides a computer readable storage medium, which may be a computer readable storage medium included in the apparatus in the above embodiment; or may exist separately, not assembled Computer readable storage medium into the terminal. The computer readable storage medium stores one or more programs that are used by one or more processors to perform the methods for remotely controlling a terminal as described herein.

The above description is only a preferred embodiment of the present application and a description of the principles of the applied technology. It should be understood by those skilled in the art that the scope of the invention referred to in the present application is not limited to the specific combination of the above technical features, and should also be covered by the above technical features or without departing from the inventive concept. Other technical solutions formed by arbitrarily combining the equivalent features. For example, the above features are combined with the technical features disclosed in the present application, but are not limited to the technical features having similar functions.

Claims

A method for remotely controlling a terminal, the method comprising:

Acquiring the connection information from the controlled terminal, where the connection information includes a session parameter, where the session parameter is a session parameter of the session established by the controlled terminal and the session server;

Establishing a connection with the session server;

Sending, to the session server, a request to establish a transit connection to the controlled terminal, the request including the session parameter;

Receiving interaction information input by the user, and generating a control command based on the interaction information;

The control command is sent to the controlled terminal through the established transit connection.
The method according to claim 1, wherein the obtaining the connection information from the controlled terminal comprises:

Retrieving a two-dimensional code from the controlled terminal in response to a scanning action on the controlled terminal, the two-dimensional code being encoded according to the connection information;

Obtaining the connection information according to the two-dimensional code.
The method of claim 2, wherein the establishing a connection with the session server comprises:

A connection is established with the session server through a pre-installed application.
The method according to claim 2, wherein said connection information further comprises an address of a web server, said web server storing an HTML5 control page for establishing a connection with said session server;

The establishing a connection with the session server includes:

Accessing the web server according to an address of the web server;

Downloading the control page from the web server;

The session server is connected through the control page.
Method according to one of claims 1 to 4, characterized in that the passage After the relay connection sends the control command to the controlled terminal, the method further includes:

Receiving status information of the controlled terminal returned by the controlled terminal through a relay connection.
The method according to any one of claims 1 to 4, wherein the control command is an operation instruction for a document presentation application.
A device for remotely controlling a terminal, the device comprising:

a connection information obtaining unit, configured to acquire connection information from the controlled terminal, where the connection information includes a session parameter, where the session parameter is a session parameter of a session established by the controlled terminal and the session server;

a session establishing unit, configured to establish a connection with the session server;

a transit connection establishing unit, configured to send, to the session server, a request to establish a transit connection to the controlled terminal, where the request includes the session parameter;

a control command generating unit configured to receive interaction information input by the user, and generate a control command based on the interaction information;

And a control command sending unit configured to send the control command to the controlled terminal by using the established transit connection.
The device according to claim 7, wherein the connection information acquiring unit comprises:

a two-dimensional code acquisition subunit, configured to obtain a two-dimensional code from the controlled terminal in response to a scanning action on the controlled terminal, where the two-dimensional code is encoded according to the connection information;

And a two-dimensional code decoding subunit configured to acquire the connection information according to the two-dimensional code.
The apparatus according to claim 8, wherein said session establishing unit is configured to establish a connection with said session server through a pre-installed application.
The device according to claim 8, wherein said connection information is further Included as an address of a web server, the web server storing an HTML5 control page for establishing a connection with the session server;

The session establishing unit is configured to:

Accessing the web server according to an address of the web server;

Downloading the control page from the web server;

The session server is connected through the control page.
The apparatus according to any one of claims 7 to 10, further comprising a return information receiving unit configured to receive the control command after transmitting the control command to the controlled terminal through the relay connection The status information of the controlled terminal returned by the controlled terminal through the relay connection.
The apparatus according to any one of claims 7 to 10, wherein the control command is an operation instruction for a document presentation application.
A device that includes:

Processor; and

Memory,

The memory stores computer readable instructions executable by the processor, the processor executing the method of any one of claims 1 to 6 when the computer readable instructions are executed.
A non-volatile computer storage medium storing computer readable instructions executable by a processor, the processor executing claim 1 to when the computer readable instructions are executed by a processor The method of any of 6.