WO2015024466A1

WO2015024466A1 - Remote control method and mobile terminal using same

Info

Publication number: WO2015024466A1
Application number: PCT/CN2014/084073
Authority: WO
Inventors: Jian Yi
Original assignee: Tencent Technology (Shenzhen) Company Limited
Priority date: 2013-08-22
Filing date: 2014-08-11
Publication date: 2015-02-26
Also published as: CN104093048A

Abstract

A remote control method is provided for use in a mobile terminal. The remote control method includes establishing a communication connection with an object to be controlled via a wireless access point; receiving a control command inputted by a user; and sending the control command to the object to be controlled via the established communication connection.

Description

REMOTE CONTROL METHOD AND MOBILE TERMINAL USING SAME

CROSS REFERENCE TO RELATED APPLICATIONS

[0001] This international application claims priority to Chinese Patent Application No.

201310369861.2, filed August 22, 2013, the entire contents of which are incorporated herein by reference.

TECHNICAL FIELD

[0002] This disclosure generally relates to the field of communication technology and, more particularly, to a remote control method and a mobile terminal using the remote control method.

BACKGROUND

[0003] Remote control refers to the technology that remotely controls an object to be controlled via a communication media.

[0004] Remote control may be realized using one or more of an operating device, a coding device, a sending device, a signal channel, a receiving device, a decoding device and actuators, etc. Remote control may be classified based on the signal channel media type, such as wired remote control, wireless remote control, optical remote control, etc. The control signal may be transmitted using transmission modes such as single-channel remote control, multi-channel remote control, etc.

[0005] Various remote control technologies exist and are widely used. For example, conventional remote control techniques can be used to effect remote control of a television, and such systems generally include, for example, a mobile terminal, a wireless router, a set-top box (STB), and a television. In this example, the mobile terminal establishes a communication connection with the wireless router, the STB establishes a wired or wireless communication connection with the wireless router, and the television establishes a wired communication connection with the STB. The mobile terminal sends, via the wireless router, a control command to the STB, the STB sends the control command to the television, and the television decodes the control command and executes it. The final implementation results will be displayed on the TV screen.

[0006] In the above-described conventional remote control method and system, the STB must be connected to the TV and, thus, the application scope is narrow. SUMMARY

[0007] According to a first aspect of the present disclosure, there is provided a remote control method for use in a mobile terminal, comprising: establishing a communication connection with an object to be controlled via a wireless access point; receiving a control command inputted by a user; and sending the control command to the object to be controlled via the established communication connection.

[0008] According to a second aspect of the present disclosure, there is provided a mobile terminal, comprising: a processor; and a memory for storing instructions executable by the processor. The processor is configured to: establish a communication connection with an object to be controlled via a wireless access point; receive a control command inputted by a user; and send the control command to the object to be controlled via the established communication connection.

[0009] According to a third aspect of the present disclosure, there is provided a

non-transitory storage medium having stored therein instructions that, when executed by a processor of a mobile terminal, cause the mobile terminal to perform a remote control method, the method comprising: establishing a communication connection with an object to be controlled via a wireless access point; receiving a control command inputted by a user; and sending the control command to the object to be controlled via the established communication connection.

[0010] It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention, as claimed.

BRIEF DESCRIPTION OF THE DRAWINGS

[0011] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.

[0012] Figure 1 is a flowchart of a remote control method, according to an exemplary embodiment.

[0013] Figure 2 is a block diagram of a network 200 for a remote control method, according to an exemplary embodiment.

[0014] Figure 3 is a diagram of a remote control method, according to an exemplary embodiment.

[0015] Figure 4 is a flowchart of a remote control method, according to an exemplary embodiment.

[0016] Figure 5 is a diagram of an application interface, according to an exemplary embodiment.

[0017] Figure 6 is a block diagram of a mobile terminal, according to an exemplary embodiment.

[0018] Figure 7 is a block diagram of a mobile terminal, according to an exemplary embodiment.

[0019] Figure 8 is a block diagram of a mobile terminal, according to an exemplary embodiment.

DETAILED DESCRIPTION OF THE EMBODIMENTS

[0020] Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. The following description refers to the

accompanying drawings in which the same numbers in different drawings represent the same or similar elements unless otherwise represented. The implementations set forth in the following description of exemplary embodiments do not represent all implementations consistent with the inventions. Instead, they are merely examples of apparatuses and methods consistent with aspects related to the inventions as recited in the appended claims.

[0021] Figure 1 a flowchart of a remote control method 100 for use in a mobile terminal, according to an exemplary embodiment. Referring to Figure 1, the method 100 includes the following steps.

[0022] In step 101, the mobile terminal establishes a communication connection with an object to be controlled via a wireless access point.

[0023] In at least one exemplary embodiment, the communication connection is a communication link. In another exemplary embodiment, the mobile terminal and the object to be controlled have access to the wireless access point and are in the condition for communication, but a communication link does not necessarily exist between the mobile terminal and the object. In this embodiment, it is needed that the mobile terminal and the object use the wireless access point as a medium, and are capable of communication. It is not necessary that there exists a communication link between the mobile terminal and the object.

[0024] In at least one exemplary embodiment, the mobile terminal is a mobile phone, and the access point is a wireless router. The mobile terminal establishes a communication connection with the object to be controlled via the wireless access point, e.g., based on a wireless (WiFi) signal or other modes.

[0025] In exemplary embodiments, the mobile terminal determines, via a port scan, whether a controllable object exists in a local area network (LAN) where the wireless access point is located. If so, the mobile terminal establishes the communication connection with the object.

[0026] In step 102, the mobile terminal receives a control command inputted by a user.

[0027] In exemplary embodiments, the mobile terminal also provides prompt information. After the establishment of the communication connection, the mobile terminal displays the identified object to be controlled.

[0028] In exemplary embodiments, the mobile terminal displays a virtual control button to receive the control command. Accordingly, the mobile terminal receiving the control command inputted by the user includes the mobile terminal receiving the control command inputted by the user via the virtual control button.

[0029] In step 103, the mobile terminal sends the control command to the object via the established communication connection.

[0030] In at least one exemplary embodiment, the object to be controlled is a TV, but the invention is not so limited. In addition, no set-top box (STB) is needed in the method 100, which saves hardware resources.

[0031] In exemplary embodiments, sending the control command to the object to be controlled via the communication connection includes sending the control command to the object via an address and a port of the object acquired in the process of establishing the communication connection, or sending the control command to the object via a user datagram protocol or a transmission control protocol.

[0032] The control command may have different formats. For example, the control command can be a command word used to indicate a type of an operation, a field used to indicate a number of bytes of a keyword, and a keyword used to indicate a mode of the operation.

[0033] In exemplary embodiments, the control command can be a video control command or other control commands. If the control command is a video control command, the control command can include selection and return of a video, directional control, and confirmation, playback control, volume control, window control, etc.

[0034] In the following embodiments, an application (APP) installed on a mobile phone is used as an example to illustrated the method 100 (Fig. 1). In these embodiments, the access point is a wireless router, and the object to be controlled is a personal computer (PC) for video playback control.

[0035] Figure 2 is a block diagram of a network 200 for the remote control method 100 (Figure 1), according to an exemplary embodiment. A mobile phone 201 and a PC 202 establish a communication connection via a wireless router 203. In this case, the wireless router 203 serves as a forwarding device to forward messages between the mobile phone 201 and the PC 203.

[0036] The mobile phone 201 and the PC 202 can access a network via the wireless router 203, and WiFi can be used as the access technology. The PC 202 serves as a server, and the mobile phone 201 serves as a client. The mobile phone 201 and the PC 202 are interconnected via a User Datagram Protocol (UDP) / Transmission Control Protocol (TCP). The PC server 202 can also provide an interface for configuring a service port, and also provide a default port value, e.g., 9999. The mobile client 201 provides an IP address and port interface of the PC server 202 to be remotely controlled, and supports an automatic scan mode to obtain the IP address of the PC server 202.

[0037] Figure 3 is a diagram of a remote control method 300 for use in a mobile phone, according to an exemplary embodiment. Referring to Figure 3, a new APP service module 301 is added to a main module 302 of PC video software, and an independent thread is used to provide a UDP service. In operation, a mobile phone APP 303 firstly finds an APP service (an APP server of the PC) in the same LAN via the port scan. Next, the mobile phone issues a control command to the APP service module 301 of the PC, according to the control command by the user. After receiving the control command, the APP service module 301 calls a corresponding interface of the main module 302 to implement controlling of the PC video software.

[0038] Figure 4 is a diagram of a remote control method 400 for use in a mobile phone, according to an exemplary embodiment. Referring to Fig. 4, the method 400 includes the following steps.

[0039] In step 401, after the startup of a wireless router, a PC, and a mobile phone, the mobile phone finds, via a port scan, an APP service of the PC in the same LAN and establishes a communication connection with the PC. [0040] In step 402, the mobile phone displays on an APP interface a virtual control button, and also displays prompt information regarding scanned PC. The mobile phone receives a selection of the virtual control button from the user.

[0041] Figure 5 is a diagram of an APP interface 500, according to an exemplary

embodiment. Referring to Figure 5, a circle 501 serves as the prompt for whether an APP service is scanned. The APP interface 500 also includes a video selection 502, a directional control and confirmation 503, a playback control 504, a volume control 505, a window control 506, etc. For example,

Video selection 502: Previous, Next;

Directional control 503 : Up, down, left and right;

Playback control 504: Play, pause, stop;

Volume control 505: Volume +, Volume -;

Window control 506: Full screen, normal.

[0042] Further, the APP can control the mobile phone whether or not to start to scan. A "scan" control button can be set.

[0043] The APP interface 500 can be designed according to the actual demands, and is limited by this embodiment.

[0044] Referring back to Fig. 4, in step 403, the APP on the mobile phone sends, via the UDP/TCP, a control command to the video software.

[0045] In exemplary embodiment, UDP is preferably applied as the communication protocol between the APP on the mobile phone and the PC, because no pre-establishment of communication link is needed between mobile phone APP and the video software in the UDP protocol, and no resource for the connection of a communication link is needed.

[0046] In exemplary embodiments, the control command includes three fields as follows:

Command word: used to indicate a type of an operation, e.g., a play or pause operation;

Number of bytes of keyword: used to indicate a number of bytes of a keyword; and

Keyword: used to support video search based on titles.

[0047] In at least one exemplary embodiment, the above fields can be defined in C language as follows:

#program pack (4)

struct {

uintl6_t command; / / command word, two bytes in size, support for up to 65,535 operating commands

uintl6_t keyword_size; // byte count of keyword

char keyword[0]; // search keywords

};

#program pack()

Command word:

// Confirmation

#define SET CONFIRM 0x00

// backspacing

#define SET BACK 0x01

// Playback control

#define CONTROL PLAY 0x11 // Playback

#define CONTROL STOP 0x12 // Stop

#define CONTROL RESUME 0x13 // Pause

#define CONTROL NEXT 0x14 // Next

#define CONTROL PREV 0x15 // Previous

// Up, down, left, right

#define DIRECTION LEFT 0x21 // Focus shift left

#define DIRECTION RIGHT 0x22 // Focus shift right

#define DIRECTION_UP 0x23 // Focus shift up

#define DIRECTION_DOWN 0x24 // Focus shift down

//Window size control

#define WINDOW_RESTORE 0x31 // Window recovery size

#define WINDOW FULLSCREEN 0x32 // Window maximization

#define VOLUME MUTE 0x40 // Mute

#define VOLUME_UP 0x41 // Volume up

#define VOLUME_DOWN 0x42 // Volume down

[0048] In step 404, after receiving the control command, the PC video software executes the control command. If the control command is invalid in the current state, a corresponding prompt tone can be issued.

[0049] Figure 6 is a block diagram of a mobile terminal 600, according to an exemplary embodiment. Referring to Figure 6, the mobile terminal 600 includes a connection establishment unit 601, a command receiving unit 602, and a command transmitting unit 603.

[0050] The connection establishment unit 601 is configured to establish a communication connection with an object to be controlled via a wireless access point.

[0051] In at least one exemplary embodiment, the communication connection is a communication link. In another exemplary embodiment, the mobile terminal and the object to be controlled have access to the wireless access point, and are in the condition for communication, but a communication link does not necessarily exist between the mobile terminal and the object. In this embodiment, it is needed that the mobile terminal and the object take the wireless access point as a medium, and are in the condition for communication. It is not necessary that there exists a communication link between the mobile terminal and the object.

[0052] The command receiving unit 602 is configured to receive a control command inputted by the user.

[0053] The command transmitting unit 603 is configured to send the control command received by the command receiving unit 602 to the object to be controlled, via the communication connection established by the connection establishment unit 601.

[0054] In exemplary embodiments, the mobile terminal may be a mobile phone, and the wireless access point may be a wireless router. The mobile terminal establishes a communication connection with the object to be controlled via the wireless access point, e.g., based on a WiFi signal or other modes.

[0055] In exemplary embodiments, the connection establishment unit 601 determines, via a port scan, whether a controllable object exists in a local area network (LAN) where the wireless access point is located. If so, the mobile terminal establishes the communication connection with the object.

[0056] In exemplary embodiments, the command transmission unit 603 is configured to send the control command to the object via an address and a port of the object acquired in the process of establishing the communication connection, or to send the control command to the object via a user datagram protocol or a transmission control protocol.

[0057] Figure 7 is a block diagram of a mobile terminal 700, according to an exemplary embodiment. Referring to Figure 7, the mobile terminal 700 further includes a display unit 701 configured to display the identified object to be controlled, after the communication connection is established by the connection establishment unit 601.

[0058] In at least one exemplary embodiment, the display unit 701 is also configured to display a virtual control button. The command receiving unit 602 is configured to receive, via the virtual control button, the control command inputted by the user.

[0059] In at least one exemplary embodiment, the command transmission unit 603 is configured to send the control command that includes a command word used to indicate a type of an operation, a numeric field used to indicate a number of bytes of a keyword, and a keyword used to indicate a mode of the operation.

[0060] In exemplary embodiments, the control command can be a video control command or other control commands. If the control command is a video control command, the control command can include selection and return of a video, directional control, and confirmation, playback control, volume control, window control, etc.

[0061] Figure 8 is a block diagram of a mobile terminal 800, according to an exemplary embodiment. The mobile terminal 800 can be any terminal device, such as a mobile phone, a tablet PC, a personal digital assistant (PDA), a point of sales (POS), a vehicle-carried computer.

[0062] Referring to Figure 8, the mobile terminal 800 includes one or more of a radio frequency (RF) circuit 810, a memory 820, an input unit 830, a display unit 840, a sensor 850, audio circuitry 860, a wireless (WiFi) module 870, a processor 880, a power supply 890 and other components. One of ordinary skill in the art will understand that the structure as shown in Figure 8 does not constitute limitations to the mobile terminal 800. The mobile terminal 800 may contain more or less components than those shown in Figure 8, or a combination of some of the components, or different arrangement of components.

[0063] The RF circuit 810 is configured to send and receive signals during sending and receiving of information or a process of calling. The RF circuit 810 may receive downlink information from a base station, and then send it to the processor 880 to process. In addition, the RF circuit 810 may transmit related uplink data to the base station. For example, the RF circuit 810 includes, but is not limited to, an antenna, an amplifier, a tuner, an oscillator, a subscriber identity module (SIM) card, a transceiver, a coupler, a low noise amplifier (LNA), a diplexer and the like. In addition, the RF circuit 810 may also communicate with a network and other equipment through wireless communication. The wireless communication may apply any one of the communication standards or protocols, which include but are not limited to global system of mobile communication (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), long term evolution (LTE), E-mail, short messaging service (SMS) or the like.

[0064] The memory 820 is configured to store software programs and modules, and the processor 880 executes various function applications and data processing through executing the software programs and modules stored in the memory 820. The memory 820 may mainly include a program storage area and a data storage area. The program storage area may store one or more operating systems, application programs required by at least one function, for example, a voice playing function, an image playing function, etc. The data storage area may store data created according to the applications of the mobile terminal 800, for example, audio data, contact data, etc. In addition, the memory 820 may include a high-speed random access memory, and may also include a nonvolatile storage such as a disk storage, a flash storage, or other volatile solid-state memories.

[0065] The input unit 830 is configured to receive input numerical or character information and generate signal inputs through a keypad, a mouse, an operation rod, optical or trackball related to user settings and function control. For example, the input unit 830 may include a touch- sensitive surface 831 and one or more other input devices 832. The touch sensitive surface 831, also known as a touch display screen or a track pad, may collect touch operations on or near it by the user (for example, the user operations on or near the touch sensitive surface 831 with any suitable object or attachment such as a finger, a touch pen, and the like), and drive a corresponding connection device according to a preset program.. Also for example, the touch sensitive surface 831 may include first and second parts, i.e., a touch detecting device and a touch controller. The touch detecting device may detect a touch orientation of the user, and detect a signal caused by the touch operation, and then transmit the signal to the touch controller. The touch controller may receive the touch information from the touch detecting device and convert it into touch point coordinates and then transmit the coordinates to the processor 880. The touch controller also receives and performs instructions from the processor 880. Additionally, the touch sensitive surface 831 may be in various types, such as resistive, capacitive, infrared, or surface acoustic wave and the like. The input unit 830 may also include one or more other input devices 832. For example, the other input devices 832 may include, without limitation, one or more of a physical keypad, functional buttons (such as a volume control button, a switch button and the like), a trackball, a mouse, a joystick and the like.

[0066] The display unit 840 is configured to display information input by the user or information provided to the user and various user image interfaces of the mobile terminal 800. The user image interfaces may consist of images, texts, icons, videos and any combinations thereof. The display unit 840 may include a display panel 841 configured by using a liquid crystal display (LCD), an organic light-emitting diode (LCD) and the like. Further, the touch-sensitive surface 831 may cover the display panel 841, and the touch-sensitive surface 831, when detecting a touch operation thereon or nearby, transmits it to the processor 880 to determine a type of the touch operation, for the processor 880 to provide a corresponding visual output on the display panel 841 according to the type of the touch operation. Although the touch- sensitive surface 831 and the display panel 841 are shown as two separated parts to implement input and input functions in Fig. 8, in some embodiments, the touch- sensitive surface 831 and the display panel 841 may be integrated to implement the input and output functions.

[0067] The sensor 850 may be an optical sensor, a motion sensor, or any other sensor. The optical sensor may include an environment optical sensor and an approaching sensor. The

environment optical sensor may adjust brightness of the display panel 841 according to the brightness of environment light, and the approaching sensor may turn off the display panel 841 and/or the backlight when the mobile terminal 800 moves to near an ear of the user. As an example of the motion sensor, a gravity acceleration sensor may detect magnitudes of an acceleration on respective directions, e.g., along three axes, and detect a value and a direction of the gravity when in stationary state. The gravity acceleration sensor is configured to recognize applications relating to an orientation of the mobile terminal 800 (for example, horizontal and vertical screen switching, related games, magnetometer gesture calibration), vibration-recognizing related functions (for example, a pedometer, knocking) and the like. The mobile terminal 800 may also be configured with other sensors such as a gyro, a barometer, a hygrometer, a thermometer, an infrared sensor and the like.

[0068] The audio circuit 860 is coupled to a loudspeaker 861 and a microphone 862, to provide an audio interface between the user and the mobile terminal 800. The audio circuit 860 may transmit an electrical signal converted from received audio data to the loudspeaker 861 to be converted into a voice signal output. On the other hand, the microphone 862 converts a collected voice signal into an electrical signal. The audio circuit 760 receives the electrical signal and converts the received electrical signal into audio data, and then outputs the audio data to the processor 880 to be processed and transmitted to another terminal, or outputs the audio data to the memory 820 to be further processed.

[0069] The WiFi module 870 provides the user with wireless broadband Internet access. For example, the WiFi module 870 may facilitate transmitting or receiving E-mails, browsing web pages, accessing streaming media and the like by the user.

[0070] The processor 880 is a control center of the mobile terminal 800 using various interfaces and wires to connect respective portions of the mobile terminal 800. By running or executing software programs and/or modules stored in the memory 820, calling data stored in the memory 820, and executing various functions of the mobile terminal 800 and processing data, the processor 880 handles overall monitoring of the mobile terminal 800. For example, the processor 880 may include one or more processing cores. Also for example, the processor 880 may integrate one or more application processors and one or more modem processors, wherein the application processors may mainly process the operating systems, the user interfaces, the application programs and the like, and the modem processors may mainly process wireless communications. In some embodiments, the modem processors are not integrated into the processor 880.

[0071] The power supply 890 is configured to supply power to respective parts of the mobile terminal 800. For example, the power supply 890 is logically connected with the processor 880 through a power supply management system, thereby realizing functions of managing charging, discharging, or power consumption through the power supply management system.

[0072] Although not shown, the mobile terminal 800 may also include a camera, a Bluetooth module, etc.

[0073] In exemplary embodiments, there is also provided a non-transitory computer readable storage medium including instructions, such as included in the memory 820, executable by the processor 880 in the mobile terminal 800, for performing the above-described methods. For example, the storage medium may be a read-only memory, a magnetic disc, an optical disc, etc.

[0074] One of ordinary skill in the art will understand that the above described units can each be implemented by hardware, or software, a combination of hardware and software. One of ordinary skill in the art will also understand that multiple ones of the above described units may be combined as one unit, and each of the above described units may be further divided into a plurality of sub-units.

[0075] Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed here. This application is intended to cover any variations, uses, or adaptations of the invention following the general principles thereof and including such departures from the present disclosure as come within known or customary practice in the art. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.

[0076] It will be appreciated that the present invention is not limited to the exact construction that has been described above and illustrated in the accompanying drawings, and that various modifications and changes can be made without departing from the scope thereof. It is intended that the scope of the invention only be limited by the appended claims.

Claims

1. A remote control method for use in a mobile terminal, comprising:

establishing a communication connection with an object to be controlled via a wireless access point;

receiving a control command inputted by a user; and

sending the control command to the object to be controlled via the established

communication connection.

2. The method of claim 1, wherein the establishing of the communication connection comprises: establishing the communication connection with the object to be controlled via a wireless router.

3. The method of claim 1, wherein the establishing of the communication connection comprises: determining, via a port scan, whether a controllable object exists in a local area network

(LAN) where the wireless access point is located; and

if it is determined that a controllable object exists, establishing the communication connection with the object.

4. The method of claim 3, wherein the sending of the control command comprises:

sending the control command to the object to be controlled via an address and a port of the object acquired during the establishing of the communication connection.

5. The method of claim 3, wherein the sending of the control command comprises:

sending the control command to the object to be controlled via a user datagram protocol or a transmission control protocol.

6. The method of claim 1, after the establishing of the communication connection, further comprising:

displaying an identified object to be controlled.

7. The method of claim 6, further comprising:

displaying a virtual control button for the mobile terminal to receive the control command inputted by the user.

8. The method of claim 1, wherein the control command comprises:

a command word to indicate a type of an operation, a field to indicate a number of bytes of a keyword, and the keyword to indicate a mode of the operation.

9. A mobile terminal, comprising:

a processor; and

a memory for storing instructions executable by the processor;

wherein the processor is configured to:

establish a communication connection with an object to be controlled via a wireless access point;

receive a control command inputted by a user; and

send the control command to the object to be controlled via the established communication connection.

10. The mobile terminal of claim 9, wherein the processor is further configured to:

establish the communication connection with the object to be controlled via a wireless router.

11. The mobile terminal of claim 9, wherein the processor is further configured to:

determine, via a port scan, whether a controllable object exists in a local area network (LAN) where the wireless access point is located; and

if it is determined that a controllable object exists, establish the communication connection with the object.

12. The mobile terminal of claim 11, wherein the processor is further configured to:

send the control command to the object to be controlled via an address and a port of the object acquired during the establishing of the communication connection.

13. The mobile terminal of claim 11, wherein the processor is further configured to:

send the control command to the object to be controlled via a user datagram protocol or a transmission control protocol.

14. The mobile terminal of claim 11, wherein after the establishing of the communication connection, the processor is further configured to:

display an identified object to be controlled.

15. The mobile terminal of claim 14, wherein the processor is further configured to:

display a virtual control button for the mobile terminal to receive the control command inputted by the user.

16. The mobile terminal of claim 9, wherein the processor is further configured to:

send the control command including a command word to indicate a type of an operation, a field to indicate a number of bytes of a keyword, and the keyword to indicate a mode of the operation.

17. A non-transitory storage medium having stored therein instructions that, when executed by a processor of a mobile terminal, cause the mobile terminal to perform a remote control method, the method comprising:

receiving a control command inputted by a user; and

sending the control command to the object to be controlled via the established

communication connection.