WO2016015671A1

WO2016015671A1 - Communication and remote control system and method based on mobile terminal

Info

Publication number: WO2016015671A1
Application number: PCT/CN2015/085614
Authority: WO
Inventors: 李博
Original assignee: 李博
Priority date: 2014-08-01
Filing date: 2015-07-30
Publication date: 2016-02-04
Also published as: CN104181880A; CN104181880B

Abstract

The present invention provides a communication and remote control system and method based on a mobile terminal. The communication and remote control system and method are used for realizing a simple robot formed by connecting a mobile terminal with an external electronic mechanical device and controlling the robot through other distal mobile terminals or PCs. The system comprises: the mobile terminal capable of logging on a server, receiving an interface control instruction sent by a control terminal via the server, connected with the external electronic mechanical device through a universal interface of itself, and driving the external electronic mechanical device to operate; the external electronic mechanical device connected with the mobile terminal through the universal interface, receiving the control instruction of the mobile terminal and operating according to the instruction; the server responsible for logon, authentication, session establishment, maintenance, release and user information maintenance of the mobile terminal and the control terminal; and the control terminal logging on the server through a telecommunication network and sending the interface control instruction to the mobile terminal through the server.

Description

Mobile terminal-based communication remote control system and method

Technical field

The present invention relates to the field of mobile communications and automatic control, and in particular, to a communication and remote control system and method based on a mobile terminal.

Background technique

With the development of technology, the configuration and capabilities of mobile terminals including mobile phones, tablets, PDAs, etc. are constantly improving, and they have strong capabilities in terms of CPU, memory, camera, positioning, etc., and the more intelligent The higher the mobile terminal is equivalent to a computer to a certain extent, the mobile terminal is connected to other external electronic mechanical devices through its universal interface, and can be combined into a simple robot device. According to the external electronic mechanical device, Different robot functions can be implemented. The mobile terminal can be used as a computer of a robot, and its microphone, speaker, touch screen, camera, etc. can all be used as input and output devices of the robot, and the external electronic mechanical device itself can also have other input and output devices. At the same time, since the mobile terminal itself has a wireless communication function, another remote mobile terminal or PC can communicate with the robot through an intermediate server and send a signaling message thereto to realize remote control thereof.

Utilizing the popularity of mobile terminals, interface versatility and software can be customized, using mobile terminal system to replace the computer of the robot, the cost of the robot is reduced, the degree of customization is greatly improved, the interface is universal, the software is easy to develop, and the extended mobile terminal Functional use, while exploring the civilian population of the future robot industry.

Summary of the invention

The invention provides a mobile terminal-based communication and remote control system and method, which is used for realizing a simple robot composed of a mobile terminal and an external electronic mechanical device, and controls the robot through other remote mobile terminals or PCs.

The technical solution provided by the present invention is as follows:

A communication and remote control system based on a mobile terminal, wherein the system comprises:

a mobile terminal, configured to receive, by using a WLAN and a telecommunication network including a WI-FI, an interface control command sent by the control terminal via a server, where the mobile terminal is connected to an external electronic mechanical device through its universal interface, according to the received The interface control instruction drives the operation of the external electromechanical device; the mobile terminal uses the server to establish a session connection with the control terminal to perform various types of communication, including: voice, video call, and text information;

The external electromechanical device is connected to the mobile terminal through a universal interface USB interface, a headphone interface and/or a Bluetooth interface, receives a control instruction of the mobile terminal, operates according to the instruction, and returns relevant data to the mobile terminal through the universal interface;

The server is responsible for login, authentication, session establishment, maintenance, release, and maintenance of user information of the mobile terminal and the control terminal;

The control terminal sends the interface control command to the mobile terminal through the WLAN and the telecommunication network including the WI-FI, and the control terminal can use the server to establish a session connection with the mobile terminal to perform various types of communication, including voice and video calls. Text information.

The system, wherein the universal interface of the mobile terminal itself includes:

USB interface, headphone jack, Bluetooth interface.

The system, wherein the mobile terminal comprises:

The communication module is configured to log in to the server through the WLAN and the telecommunication network including the WI-FI, establish a session connection with the control terminal, receive control commands or data such as voice, video, text, etc., and send voice, video, text and other data thereto.

The system, wherein the mobile terminal further comprises:

a message parsing and classification module, configured to parse the received message, and determine that the message is an interface control instruction, voice, video, text data, or data sent by an external electromechanical device, and if it is an interface control instruction, The processing is handled by the interface message processing and forwarding module; if it is voice, video, text data, or data sent by an external electromechanical device, it is processed by the application control module.

The system, wherein the mobile terminal further comprises:

The interface message processing and forwarding module converts the interface control command sent by the message parsing and classification module and forwards it to the external electromechanical device through the USB interface, the earphone interface and/or the Bluetooth interface to drive the operation; the module is also used for receiving external electronic Other data sent by the mechanical device, including: the result of the instruction execution, the data collected by the sensor, and the current operating state of the device.

The system, wherein the mobile terminal further comprises:

The application control module can be an application, a software sub-module or a software process for processing voice, video, text data acquired by the message parsing module, or data sent by an external electromechanical device, and performing various types of data through corresponding applications. Processed or displayed on the screen of the mobile terminal.

The system, wherein the external electromechanical device returns related data to the mobile terminal through a universal interface, and the method includes:

The result of the instruction execution, the data collected by the sensor on the external electromechanical device, and the current operating state of the device.

The system, wherein the form of the external electromechanical device may be different according to functional requirements, including one or a combination of the following: a tracked trolley, a motor-driven mechanical arm, a robot, a mechanical shaft, an axle, Sensors, cameras, speakers, lights, displays.

The system, wherein the server is located in an operator core network or in a public Internet; if the server is located in the public Internet, there is an identifiable network address.

A communication terminal-based communication and remote control method, comprising the steps of:

A. The mobile terminal and the external electromechanical device are connected through a universal interface of the mobile terminal, and the universal interface includes a USB interface, a headphone interface and/or a Bluetooth interface of the mobile terminal;

B. The mobile terminal and the control terminal log in to the server, and establish a session connection through the server;

C. The control terminal sends an interface control instruction or communication data to the mobile terminal, where the communication data includes voice, video, and text information;

D, the mobile terminal determines that the received content is an interface control command or communication data, if it is an interface control instruction, step E is performed; if it is voice, video, text information and other communication data, step F is performed;

E. Processing and forwarding control instructions to an external electromechanical device to drive its operation;

F. The data is processed by the application control module.

DRAWINGS

1 is a schematic structural diagram of a communication and remote control system based on a mobile terminal according to an embodiment of the present invention;

2 is a schematic block diagram of a mobile terminal according to an embodiment of the present invention;

3 is a flow chart of a method in accordance with an embodiment of the present invention.

detailed description

The present invention will be further described in detail below with reference to the accompanying drawings. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

A communication and remote control system based on a mobile terminal provided by an embodiment of the present invention, as shown in FIG. 1, includes the following parts:

The mobile terminal 101 receives the interface control command sent by the control terminal 104 via the server 103 through the WLAN and telecommunication network login server 103 including the WI-FI; meanwhile, the mobile terminal 101 communicates with the external electronic device through its own universal interface such as USB and/or headphones. The mechanical device 102 is connected, and drives the external electromechanical device according to the received interface control command. The mobile terminal 101 can also establish a session connection with the control terminal 104 through the server 103 to perform various types of communication, such as voice, video call, text information, and the like.

The external electronic mechanical device 102, the universal interface such as USB, headphone interface and/or Bluetooth interface is connected with the mobile terminal 101, receives the control command of the mobile terminal 101 and operates according to the instruction, and returns relevant data to the mobile terminal 101 through the universal interface, such as The result of the instruction execution, the data collected by the sensor on the external electromechanical device, and so on. The form of external electromechanical equipment can be different according to functional requirements, and it can be a trolley with a track, or an electromechanical device with a mechanical arm, a robot, a shaft, a sensor, and the like.

The server 103 is located in the operator's core network or in the public Internet; if the server is located in the public Internet, there is an identifiable network address. The server is responsible for login, authentication, session establishment, maintenance, release, and maintenance of user information of the mobile terminal and the control terminal.

The control terminal 104 sends an interface control command to the mobile terminal 101 through the server 103 through the WLAN and telecommunication network including the WI-FI. The control terminal 104 can establish a session connection with the mobile terminal 101 through the server 103 to perform various types of communication. Such as voice, video call, text information, etc.

The interface control command refers to command information for controlling an external electronic mechanical device through a universal interface of the mobile terminal, which is distinguished from the communication link control signaling.

Based on the mobile terminal-based communication and remote control system of the above embodiment, the embodiment of the present invention further provides a mobile terminal, wherein the mobile terminal of the embodiment, in addition to the communication function of the general mobile terminal, also has a universal interface and Customized software connects to and drives external electromechanical devices.

As shown in FIG. 2, when connected to an external electromechanical device, the mobile terminal of the embodiment of the present invention includes:

The communication module 201 is configured to log in to the server through the WLAN and the telecommunication network including the WI-FI, establish a session connection with the control terminal, receive control commands or data such as voice, video, text, etc., and send voice, video, text and other data thereto. .

The message parsing and classification module 202 is configured to parse the received message, and determine that the message is an interface control instruction, voice, video, text data, or data sent by an external electromechanical device, and if it is an interface control instruction, It is processed by the interface message processing and forwarding module 203; if it is voice, video, text data, or data sent by an external electromechanical device, it is processed by the application control module 204.

The interface message processing and forwarding module 203 converts the interface control command sent by the message parsing and classification module and forwards it to the external electromechanical device through the USB interface, the earphone interface and/or the Bluetooth interface to drive the operation; the module also receives the external electronic machinery. Other data sent by the device, such as the result of the instruction execution, the data collected by the sensor, the current operating status of the device, and so on.

The application control module 204 can be an application, a software sub-module or a software process for processing voice, video, text data acquired by the message parsing module, or data sent by an external electromechanical device, and passing various types of data through the corresponding application. Process it or display it on the screen of the mobile terminal.

Based on the mobile terminal-based communication and remote control system of the above embodiment, the communication and remote control based on the mobile terminal provided by the embodiment of the present invention, as shown in FIG. 3, includes the following steps:

Step 301: The mobile terminal and the external electronic mechanical device are connected through a universal interface of the mobile terminal, and the universal interface includes a USB interface, a headphone interface and/or a Bluetooth interface of the mobile terminal.

Step 302: The mobile terminal and the control terminal log in to the server and establish a session connection.

Step 303: The control terminal sends an interface control instruction or communication data to the mobile terminal.

Step 304: The mobile terminal determines that the received content is an interface control command or communication data. In a specific implementation, a corresponding flag bit may be added in a header or other field of the message to distinguish different types of messages, and identify the Interface control instructions, or voice, video, text data. If it is an interface control instruction, step 305 is performed. If it is data such as voice, video, text, etc., step 306 is performed.

Step 305: Process and forward the control instructions to an external electromechanical device to drive its operation.

Step 306: The data is processed by the application control module of the mobile terminal.

In summary, the mobile terminal-based communication and remote control system and method proposed by the present invention connect the mobile terminal to other external electronic mechanical devices through a universal interface, and drive the operation thereof, and simultaneously pass the WLAN and the telecommunication including WI-FI. The network establishes a session with the remote control terminal via the server. In addition to general voice, video, and text communication, it can also accept the interface control command of the control terminal, and forward the control terminal to the external electronic mechanical device interface control command to control its operation. Thus, a simple and easy-to-operate remote control robot and communication system is realized, which expands the functions of the mobile terminal and provides an easy-to-implement solution for the popularization of the robot.

It is to be understood that the application of the present invention is not limited to the above-described examples, and those skilled in the art can make modifications and changes in accordance with the above description, all of which are within the scope of the appended claims.

Claims

A communication and remote control system based on a mobile terminal, characterized in that the system comprises:

a mobile terminal, configured to receive, by using a WLAN and a telecommunication network including a WI-FI, an interface control command sent by the control terminal via a server, where the mobile terminal is connected to an external electronic mechanical device through its universal interface, according to the received The interface control instruction drives the external electronic mechanical device to operate; the mobile terminal establishes a session connection with the control terminal through the server, performs various types of communication, including: voice, video call, text information; external electronic mechanical device, through a universal interface USB interface The headset interface and/or the Bluetooth interface are connected to the mobile terminal, receive the control command of the mobile terminal and operate according to the instruction, and return relevant data to the mobile terminal through the universal interface; the server is responsible for login, authentication, and session of the mobile terminal and the control terminal. Establishment, maintenance, release, maintenance of user information;

The control terminal sends the interface control command to the mobile terminal through the WLAN and the telecommunication network including the WI-FI, and the control terminal can use the server to establish a session connection with the mobile terminal to perform various types of communication, including voice and video calls. Text information.
The system of claim 1 further characterized in that the universal interface of the mobile terminal itself comprises: a USB interface, a headphone interface, and a Bluetooth interface.
The system according to claim 1, wherein the mobile terminal comprises: a communication module, configured to log in to the server through a WLAN and a telecommunication network including WI-FI, establish a session connection with the control terminal, and receive a control instruction thereof or Voice, video, text and other data, send voice, video, text and other data to it.
The system according to claim 1, wherein the mobile terminal further comprises: a message parsing and classification module, configured to parse the received message, and determine that the message is an interface control instruction, a voice, a video, or a text. Data, or data sent by an external electromechanical device, if it is an interface control instruction, it is handed over to the interface message processing and forwarding module; if it is voice, video, text data, or data sent by an external electromechanical device, then Processed by the application control module.
The system according to claim 1, wherein the mobile terminal further comprises: an interface message processing and forwarding module, wherein the interface control command sent by the message parsing and classification module is converted and then passed through a USB interface, a headphone interface, and/or Bluetooth. The interface is forwarded to the external electromechanical device to drive its operation; the module is also used to receive other data sent by the external electromechanical device, including: the execution result of the instruction, the data collected by the sensor, and the current operating state of the device.
The system according to claim 1, wherein the mobile terminal further comprises: an application control module, which is an application program, a software sub-module or a software process, configured to process voice, video, and text data acquired by the message parsing module. , or data sent by an external electromechanical device, processing various types of data through a corresponding application, or displaying on the screen of the mobile terminal.
The system according to claim 1, wherein the external electromechanical device returns relevant data to the mobile terminal through a universal interface, comprising: an instruction execution result, data collected by the sensor on the external electromechanical device, and current operating state of the device. .
The system of claim 1 wherein said external electromechanical device is in a form that can vary according to functional requirements, including one or more of the following: a tracked trolley, a motorized robotic arm, a robot , mechanical shaft, axle, sensor, camera, speaker, lantern, display.
The system of claim 1 further characterized in that said server is located in an operator core network or in a public Internet; if said server is located in the public Internet, there is an identifiable network address.
A mobile terminal-based communication and remote control method, characterized in that it comprises the steps of:

A. The mobile terminal and the external electromechanical device are connected through a universal interface of the mobile terminal, and the universal interface includes a USB interface, a headphone interface and/or a Bluetooth interface of the mobile terminal;

B. The mobile terminal and the control terminal log in to the server, and establish a session connection through the server;

C. The control terminal sends an interface control instruction or communication data to the mobile terminal, where the communication data includes voice, video, and text information;

D, the mobile terminal determines that the received content is an interface control command or communication data, if it is an interface control instruction, step E is performed; if it is voice, video, text information and other communication data, step F is performed;

E. Process the control instructions and forward them to an external electromechanical device to drive their operation.