CN106603807B

CN106603807B - Method for controlling controlled equipment by mobile terminal, mobile terminal and controlled equipment

Info

Publication number: CN106603807B
Application number: CN201610890067.6A
Authority: CN
Inventors: 易晓柯; 王佰祥
Original assignee: WEIFANG CHUANGGAO INFORMATION TECHNOLOGY CO LTD
Current assignee: WEIFANG CHUANGGAO INFORMATION TECHNOLOGY Co.,Ltd.
Priority date: 2016-10-11
Filing date: 2016-10-11
Publication date: 2020-04-21
Anticipated expiration: 2036-10-11
Also published as: CN106603807A

Abstract

The invention discloses a method for controlling controlled equipment by a mobile terminal, the mobile terminal and the controlled equipment, wherein the mobile terminal comprises: the acquisition module is used for acquiring the information of the controlled equipment; the first connection module is used for establishing wireless local area network connection with the controlled equipment according to the controlled equipment information; the wireless local area network connection comprises: wifi direct connection, wifi network access connection or Bluetooth connection; and the sending module is used for sending a control instruction to the controlled equipment based on the wireless local area network connection so that the controlled equipment can execute corresponding operation according to the received control instruction. The invention solves the problem that the control distance and the posture of the controlled equipment by the mobile terminal are limited.

Description

Method for controlling controlled equipment by mobile terminal, mobile terminal and controlled equipment

Technical Field

The invention relates to the field of mobile terminal control, in particular to a method for controlling controlled equipment by a mobile terminal, the mobile terminal and the controlled equipment.

Background

With the rapid development of digital communication technology and network technology in recent years, people are increasingly eager to enjoy more convenient, faster, more intelligent and more comfortable digital intelligent home life.

In the prior art, when controlling many equipment, can only adopt the remote controller that its equipment corresponds, perhaps use mobile terminal to control through the synchronous back simulation remote controller of infrared mode with the remote controller that corresponds, the operation mode is comparatively complicated and single, but can only provide the switch and about the selection from top to bottom, can not bring better experience for the user. And the remote controller is used for controlling, the controlled device is necessarily in the sight line range, and the use distance of the user is limited. Meanwhile, the infrared control must be point-to-point, and once the operation angle of the user is incorrect, the control may fail, which brings inconvenience to the operation of the user.

Disclosure of Invention

The invention mainly aims to provide a method for controlling controlled equipment by a mobile terminal, the mobile terminal and the controlled equipment, and aims to solve the problem that the control distance and the posture of the controlled equipment by the mobile terminal are limited.

In order to achieve the above object, the present invention provides a mobile terminal, including:

the acquisition module is used for acquiring the information of the controlled equipment;

the first connection module is used for establishing wireless local area network connection with the controlled equipment according to the controlled equipment information; the wireless local area network connection comprises: wifi direct connection, wifi network access connection or Bluetooth connection;

and the sending module is used for sending a control instruction to the controlled equipment based on the wireless local area network connection so that the controlled equipment can execute corresponding operation according to the received control instruction.

Optionally, the obtaining module is configured to: acquiring controlled equipment information in a mode of carrying out image recognition on a set identifier of the controlled equipment or in a mode of searching through a wireless signal;

the setting of the identifier includes: two-dimensional codes, bar codes or set icons.

Optionally, under the condition that the obtaining module is configured to obtain the information of the controlled device in a manner of performing image recognition on the setting identifier of the controlled device, the first connecting module is configured to:

judging whether the controlled equipment information exists in an equipment library or not; the device library stores the controlled device information which has established the wireless local area network connection with the mobile terminal;

and if so, establishing wireless local area network connection with the controlled equipment based on the controlled equipment information, and loading an infrared control instruction set corresponding to the controlled equipment, otherwise, downloading a corresponding infrared control instruction set from an instruction library based on the controlled equipment information for loading, and adding the controlled equipment information into the equipment library after establishing wireless local area network connection with the controlled equipment.

Optionally, under the condition that the obtaining module is configured to obtain the controlled device information in a wireless signal search manner, the first connecting module is configured to:

if yes, establishing wireless local area network connection with the controlled equipment based on the controlled equipment information, and loading an infrared control instruction set corresponding to the controlled equipment.

Optionally, in the case that the mobile terminal starts the screen sending function of the controlled device,

the sending module is configured to:

receiving screen data sent by a controlled device and displaying the screen data on a screen of the mobile terminal;

and sending a corresponding control instruction to the controlled equipment based on the touch operation received by the screen of the mobile terminal.

Optionally, in the case that the wireless lan connection is a wifi direct connection or a wifi network access connection,

the sending module is configured to:

receiving each key image data of a control interface sent by a controlled device, and displaying each key image on a screen of the mobile terminal according to each key image data;

and sending a corresponding key area pressed event to the controlled equipment based on the touch operation received by the screen of the mobile terminal, so that the controlled equipment converts the key area pressed event into a corresponding control instruction.

Optionally, in the case that the wireless lan connection is a bluetooth connection,

the sending module is configured to:

receiving each key coordinate data of a control interface sent by a controlled device, and displaying each key area identification corresponding to each key coordinate data on a screen of the mobile terminal;

Optionally, in the case that the mobile terminal turns off the screen sending function of the controlled device,

the sending module is configured to:

providing a control interface on a screen of a mobile terminal, and receiving touch operation aiming at the control interface;

and finding a corresponding infrared control instruction in an infrared control instruction set according to the touch operation, and sending the infrared control instruction to the controlled equipment through wireless local area network connection.

The present invention also provides a controlled device, comprising:

the providing module is used for providing the controlled equipment information for the mobile terminal;

the second connection module is used for establishing wireless local area network connection with the intelligent equipment; the wireless local area network connection comprises: wifi direct connection, wifi network access connection or Bluetooth connection;

and the receiving module is used for receiving a control instruction sent by the mobile terminal based on the wireless local area network and executing corresponding operation according to the control instruction.

Optionally, the providing module is configured to provide the controlled device information to the mobile terminal in a manner of providing a setting identifier for image recognition of the mobile terminal or in a manner of transmitting a wireless signal for search by the mobile terminal;

Optionally, in the case that the screen sending function of the controlled device is turned on by the mobile terminal,

the receiving module is configured to:

sending screen data of controlled equipment to a mobile terminal so that the mobile terminal can display the screen data on the mobile terminal;

and receiving a control instruction which is sent by the mobile terminal and corresponds to the touch operation on the screen of the mobile terminal.

the receiving module is configured to:

sending each key image data of a controlled device control interface to a mobile terminal so that the mobile terminal can display each key image on a screen of the mobile terminal according to each key image data;

receiving a key area pressed event which is sent by the mobile terminal and corresponds to the touch operation received by the screen of the mobile terminal, and converting the key area pressed event into a corresponding control instruction.

the receiving module is configured to:

sending each key coordinate data of a controlled device control interface to a mobile terminal so that the mobile terminal can display each key area identification corresponding to each key coordinate data on a screen of the mobile terminal;

receiving a key area pressed event corresponding to touch operation sent by a mobile terminal, and converting the key area pressed event into a corresponding control instruction.

Optionally, in the case that the screen sending function of the controlled device is not turned on,

the receiving module is configured to:

and receiving an infrared control instruction sent by the mobile terminal through wireless local area network connection.

The invention also provides a method for controlling the controlled equipment by the mobile terminal, which comprises the following steps:

the mobile terminal acquires the controlled equipment information and establishes wireless local area network connection with the controlled equipment according to the controlled equipment information; the wireless local area network connection comprises: wifi direct connection, wifi network access connection or Bluetooth connection;

and the mobile terminal sends a control instruction to the controlled equipment based on the wireless local area network connection so that the controlled equipment can execute corresponding operation according to the received control instruction.

Optionally, the mobile terminal obtains the information of the controlled device through a mode of performing image recognition on the set identifier of the controlled device or a mode of searching through a wireless signal;

Optionally, when the mobile terminal obtains the controlled device information by performing image recognition on the set identifier of the controlled device, the establishing a wireless local area network connection with the controlled device according to the controlled device information includes:

the mobile terminal judges whether the controlled equipment information exists in an equipment library or not; the device library stores the controlled device information which has established the wireless local area network connection with the mobile terminal;

Optionally, when the mobile terminal obtains the controlled device information through a wireless signal search, the establishing a wireless local area network connection with the controlled device according to the controlled device information includes:

the mobile terminal sends a control instruction to the controlled equipment based on the wireless local area network connection, and the control instruction comprises the following steps:

the method comprises the following steps that a mobile terminal receives screen data sent by controlled equipment and displays the screen data on a screen of the mobile terminal;

and the mobile terminal sends a corresponding control instruction to the controlled equipment based on the touch operation received by the screen of the mobile terminal.

the method comprises the steps that a mobile terminal receives each key image data of a control interface sent by a controlled device, and each key image is displayed on a screen of the mobile terminal according to each key image data;

the mobile terminal sends a corresponding event that the key area is pressed to the controlled device based on the touch operation received by the screen of the mobile terminal, so that the controlled device converts the event that the key area is pressed into a corresponding control instruction.

the method comprises the steps that a mobile terminal receives key coordinate data of a control interface sent by controlled equipment, and key area identifications corresponding to the key coordinate data are displayed on a screen of the mobile terminal;

the mobile terminal provides a control interface and receives touch operation aiming at the control interface;

the controlled equipment provides the controlled equipment information for the mobile terminal and establishes wireless local area network connection with the intelligent equipment; the wireless local area network connection comprises: wifi direct connection, wifi network access connection or Bluetooth connection;

the controlled device receives a control instruction sent by the mobile terminal based on the wireless local area network, and executes corresponding operation according to the control instruction.

Optionally, the controlled device provides the controlled device information to the mobile terminal in a manner of providing a setting identifier for image recognition of the mobile terminal or in a manner of transmitting a wireless signal for search by the mobile terminal;

the controlled device receives a control instruction sent by a mobile terminal based on the wireless local area network, and the control instruction comprises the following steps:

the controlled equipment sends own screen data to the mobile terminal so that the mobile terminal can display the screen data on the own screen;

the controlled device receives a control instruction which is sent by the mobile terminal and corresponds to the touch operation on the screen of the mobile terminal.

the controlled equipment sends the image data of each key of a self control interface to the mobile terminal so that the mobile terminal can display the image of each key on a screen of the mobile terminal according to the image data of each key;

the controlled device receives a key area pressed event which is sent by the mobile terminal and corresponds to the touch operation received by the screen of the mobile terminal, and converts the key area pressed event into a corresponding control instruction.

the controlled equipment sends each key coordinate data of a self control interface to the mobile terminal so that the mobile terminal can display each key area identification corresponding to each key coordinate data on a screen of the mobile terminal;

the controlled device receives a key area pressed event corresponding to the touch operation sent by the mobile terminal, and converts the key area pressed event into a corresponding control instruction.

and the controlled equipment receives the infrared control instruction sent by the mobile terminal through the wireless local area network connection.

According to the method for controlling the controlled equipment by the mobile terminal, the mobile terminal and the controlled equipment, the controlled equipment is shot by the mobile terminal for the first time, the information of the controlled equipment is obtained, the corresponding infrared control instruction set is downloaded to the instruction library according to the information of the controlled equipment, the controlled equipment is stored in the local equipment library, and once the equipment in the equipment library is searched, the connection is directly initiated. After the connection is completed, the infrared control instruction in the instruction library is directly connected and sent through wifi direct for control, and the controlled device converts the control instruction into the infrared control instruction after receiving the control instruction packaged through wifi protocol. For the controlled device capable of supporting screen projection, the controlled device projects the screen of the controlled device onto the screen of the mobile terminal, and the mobile terminal controls the controlled device in a screen projection mode. The invention extends the control range of the user to the controlled equipment, provides different control modes according to different controlled equipment, is convenient for expanding the control function, does not limit the control distance and posture of the user any more, and improves the use experience of the user.

Drawings

Fig. 1 is a schematic hardware configuration diagram of an alternative mobile terminal implementing various embodiments of the present invention;

fig. 2 is a schematic diagram illustrating a situation in which a mobile terminal according to embodiments of the present invention is held by a user;

fig. 3 is a schematic structural diagram of a mobile terminal according to a first embodiment to a fourth embodiment of the present invention;

fig. 4 is a schematic structural diagram of the components of a controlled device according to fifth to seventh embodiments of the present invention;

fig. 5 is a flowchart of a method for controlling a controlled device by a mobile terminal according to an eighth embodiment to an eleventh embodiment of the present invention;

fig. 6 is a flowchart of a method for controlling a controlled device by a mobile terminal according to a twelfth to fifteenth embodiments of the present invention;

FIG. 7 is a block diagram of a mobile phone side according to a sixteenth embodiment of the present invention;

FIG. 8 is a schematic block diagram of a controlled device according to a sixteenth embodiment of the present invention;

the implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.

Detailed Description

It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

A mobile terminal implementing various embodiments of the present invention will now be described with reference to the accompanying drawings. In the following description, suffixes such as "module", "component", or "unit" used to denote elements are used only for facilitating the explanation of the present invention, and have no specific meaning in themselves. Thus, "module" and "component" may be used in a mixture.

The mobile terminal may be implemented in various forms. For example, the terminal described in the present invention may include a mobile terminal such as a mobile phone, a smart phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a navigation device, and the like, and a stationary terminal such as a digital TV, a desktop computer, and the like. In the following, it is assumed that the terminal is a mobile terminal. However, it will be understood by those skilled in the art that the configuration according to the embodiment of the present invention can be applied to a fixed type terminal in addition to elements particularly used for moving purposes.

Fig. 1 is a schematic hardware structure of an alternative mobile terminal implementing various embodiments of the present invention.

The mobile terminal 100 may include a wireless communication unit 110, an a/V (audio/video) input unit 120, a user input unit 130, a sensing unit 130, an output unit 150, a memory 160, an interface unit 170, a controller 180, and a power supply unit 190, etc. Fig. 1 illustrates a mobile terminal having various components, but it is to be understood that not all illustrated components are required to be implemented. More or fewer components may alternatively be implemented. Elements of the mobile terminal will be described in detail below.

The wireless communication unit 110 typically includes one or more components that allow radio communication between the mobile terminal 100 and a wireless communication system or network. For example, the wireless communication unit may include at least one of a broadcast receiving module 111, a mobile communication module 112, a wireless internet module 113, a short-range communication module 114, and a location information module 115.

The broadcast receiving module 111 receives a broadcast signal and/or broadcast associated information from an external broadcast management server via a broadcast channel. The broadcast channel may include a satellite channel and/or a terrestrial channel. The broadcast management server may be a server that generates and transmits a broadcast signal and/or broadcast associated information or a server that receives a previously generated broadcast signal and/or broadcast associated information and transmits it to a terminal. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and the like. Also, the broadcast signal may further include a broadcast signal combined with a TV or radio broadcast signal. The broadcast associated information may also be provided via a mobile communication network, and in this case, the broadcast associated information may be received by the mobile communication module 112. The broadcast signal may exist in various forms, for example, it may exist in the form of an Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB), an Electronic Service Guide (ESG) of digital video broadcasting-handheld (DVB-H), and the like. The broadcast receiving module 111 may receive a signal broadcast by using various types of broadcasting systems. In particular, the broadcast receiving module 111 mayTo use a multimedia broadcast-terrestrial (DMB-T), digital multimedia broadcast-satellite (DMB-S), digital video broadcast-handheld (DVB-H), forward link media (MediaFLO)^@) A digital broadcasting system of a terrestrial digital broadcasting integrated service (ISDB-T), etc. receives digital broadcasting. The broadcast receiving module 111 may be constructed to be suitable for various broadcasting systems that provide broadcast signals as well as the above-mentioned digital broadcasting systems. The broadcast signal and/or broadcast associated information received via the broadcast receiving module 111 may be stored in the memory 160 (or other type of storage medium).

The mobile communication module 112 transmits and/or receives radio signals to and/or from at least one of a base station (e.g., access point, node B, etc.), an external terminal, and a server. Such radio signals may include voice call signals, video call signals, or various types of data transmitted and/or received according to text and/or multimedia messages.

The wireless internet module 113 supports wireless internet access of the mobile terminal. The module may be internally or externally coupled to the terminal. The wireless internet access technology to which the module relates may include WLAN (wireless LAN) (Wi-Fi), Wibro (wireless broadband), Wimax (worldwide interoperability for microwave access), HSDPA (high speed downlink packet access), and the like.

The short-range communication module 114 is a module for supporting short-range communication. Some examples of short-range communication technologies include bluetooth^TMRadio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), zigbee^TMAnd so on.

The location information module 115 is a module for checking or acquiring location information of the mobile terminal. A typical example of the location information module is a GPS (global positioning system). According to the current technology, the GPS module 115 calculates distance information and accurate time information from three or more satellites and applies triangulation to the calculated information, thereby accurately calculating three-dimensional current location information according to longitude, latitude, and altitude. Currently, a method for calculating position and time information uses three satellites and corrects an error of the calculated position and time information by using another satellite. In addition, the GPS module 115 can calculate speed information by continuously calculating current position information in real time.

The a/V input unit 120 is used to receive an audio or video signal. The a/V input unit 120 may include a camera 121 and a microphone 122, and the camera 121 processes image data of still pictures or video obtained by an image capturing apparatus in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 151. The image frames processed by the cameras 121 may be stored in the memory 160 (or other storage medium) or transmitted via the wireless communication unit 110, and two or more cameras 121 may be provided according to the construction of the mobile terminal. The microphone 122 may receive sounds (audio data) via the microphone in a phone call mode, a recording mode, a voice recognition mode, or the like, and can process such sounds into audio data. The processed audio (voice) data may be converted into a format output transmittable to a mobile communication base station via the mobile communication module 112 in case of a phone call mode. The microphone 122 may implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated in the course of receiving and transmitting audio signals.

The user input unit 130 may generate key input data according to a command input by a user to control various operations of the mobile terminal. The user input unit 130 allows a user to input various types of information, and may include a keyboard, dome sheet, touch pad (e.g., a touch-sensitive member that detects changes in resistance, pressure, capacitance, and the like due to being touched), scroll wheel, joystick, and the like. In particular, when the touch pad is superimposed on the display unit 151 in the form of a layer, a touch screen may be formed.

The sensing unit 130 detects a current state of the mobile terminal 100 (e.g., an open or closed state of the mobile terminal 100), a position of the mobile terminal 100, presence or absence of contact (i.e., touch input) by a user with the mobile terminal 100, an orientation of the mobile terminal 100, acceleration or deceleration movement and direction of the mobile terminal 100, and the like, and generates a command or signal for controlling an operation of the mobile terminal 100. For example, when the mobile terminal 100 is implemented as a slide-type mobile phone, the sensing unit 130 may sense whether the slide-type phone is opened or closed. In addition, the sensing unit 130 can detect whether the power supply unit 190 supplies power or whether the interface unit 170 is coupled with an external device. The sensing unit 130 may include a proximity sensor 141 and the like.

The interface unit 170 serves as an interface through which at least one external device is connected to the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The identification module may store various information for authenticating a user using the mobile terminal 100 and may include a User Identity Module (UIM), a Subscriber Identity Module (SIM), a Universal Subscriber Identity Module (USIM), and the like. In addition, a device having an identification module (hereinafter, referred to as an "identification device") may take the form of a smart card, and thus, the identification device may be connected with the mobile terminal 100 via a port or other connection means. The interface unit 170 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the mobile terminal 100 or may be used to transmit data between the mobile terminal and the external device.

In addition, when the mobile terminal 100 is connected with an external cradle, the interface unit 170 may serve as a path through which power is supplied from the cradle to the mobile terminal 100 or may serve as a path through which various command signals input from the cradle are transmitted to the mobile terminal. Various command signals or power input from the cradle may be used as signals for recognizing whether the mobile terminal is accurately mounted on the cradle. The output unit 150 is configured to provide output signals (e.g., audio signals, video signals, alarm signals, vibration signals, etc.) in a visual, audio, and/or tactile manner.

The output unit 150 may include a display unit 151, an audio output module 152, and the like.

The display unit 151 may display information processed in the mobile terminal 100. For example, when the mobile terminal 100 is in a phone call mode, the display unit 151 may display a User Interface (UI) or a Graphical User Interface (GUI) related to a call or other communication (e.g., text messaging, multimedia file downloading, etc.). When the mobile terminal 100 is in a video call mode or an image capturing mode, the display unit 151 may display a captured image and/or a received image, a UI or GUI showing a video or an image and related functions, and the like.

Meanwhile, when the display unit 151 and the touch pad are overlapped with each other in the form of a layer to form a touch screen, the display unit 151 may serve as an input device and an output device. The display unit 151 may include at least one of a Liquid Crystal Display (LCD), a thin film transistor LCD (TFT-LCD), an Organic Light Emitting Diode (OLED) display, a flexible display, a three-dimensional (3D) display, and the like. Some of these displays may be configured to be transparent to allow a user to view from the outside, which may be referred to as transparent displays, and a typical transparent display may be, for example, a TOLED (transparent organic light emitting diode) display or the like. Depending on the particular desired implementation, the mobile terminal 100 may include two or more display units (or other display devices), for example, the mobile terminal may include an external display unit (not shown) and an internal display unit (not shown). The touch screen may be used to detect a touch input pressure as well as a touch input position and a touch input area.

The audio output module 152 may convert audio data received by the wireless communication unit 110 or stored in the memory 160 into an audio signal and output as sound when the mobile terminal is in a call signal reception mode, a call mode, a recording mode, a voice recognition mode, a broadcast reception mode, or the like. Also, the audio output module 152 may provide audio output related to a specific function performed by the mobile terminal 100 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output module 152 may include a speaker, a buzzer, and the like.

The memory 160 may store software programs and the like for processing and controlling operations performed by the controller 180, or may temporarily store data (e.g., a phonebook, messages, still images, videos, and the like) that has been or will be output. Also, the memory 160 may store data regarding various ways of vibration and audio signals output when a touch is applied to the touch screen.

The memory 160 may include at least one type of storage medium including a flash memory, a hard disk, a multimedia card, a card-type memory (e.g., SD or DX memory, etc.), a Random Access Memory (RAM), a Static Random Access Memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, an optical disk, and the like. Also, the mobile terminal 100 may cooperate with a network storage device that performs a storage function of the memory 160 through a network connection.

The controller 180 generally controls the overall operation of the mobile terminal. For example, the controller 180 performs control and processing related to voice calls, data communications, video calls, and the like. In addition, the controller 180 may include a multimedia module 181 for reproducing (or playing back) multimedia data, and the multimedia module 181 may be constructed within the controller 180 or may be constructed separately from the controller 180. The controller 180 may perform a pattern recognition process to recognize a handwriting input or a picture drawing input performed on the touch screen as a character or an image.

The power supply unit 190 receives external power or internal power and provides appropriate power required to operate various elements and components under the control of the controller 180.

The various embodiments described herein may be implemented in a computer-readable medium using, for example, computer software, hardware, or any combination thereof. For a hardware implementation, the embodiments described herein may be implemented using at least one of an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Digital Signal Processing Device (DSPD), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a processor, a controller, a microcontroller, a microprocessor, an electronic unit designed to perform the functions described herein, and in some cases, such embodiments may be implemented in the controller 180. For a software implementation, the implementation such as a process or a function may be implemented with a separate software module that allows performing at least one function or operation. The software codes may be implemented by software applications (or programs) written in any suitable programming language, which may be stored in the memory 160 and executed by the controller 180.

Up to this point, mobile terminals have been described in terms of their functionality. Hereinafter, a slide-type mobile terminal among various types of mobile terminals, such as a folder-type, bar-type, swing-type, slide-type mobile terminal, and the like, will be described as an example for the sake of brevity. Accordingly, the present invention can be applied to any type of mobile terminal, and is not limited to a slide type mobile terminal.

The mobile terminal 100 as shown in fig. 1 may be configured to operate with communication systems such as wired and wireless communication systems and satellite-based communication systems that transmit data via frames or packets.

Taking a mobile terminal of a mobile phone as an example, a situation that a user holds the mobile terminal is shown in fig. 2.

Based on the above-described mobile terminal hardware structure, various embodiments of the present invention are proposed.

As shown in fig. 3, a first embodiment of the present invention provides a mobile terminal, including:

1) an obtaining module 301, configured to obtain controlled device information;

2) a first connection module 302, configured to establish a wireless local area network connection with a controlled device according to the controlled device information; the wireless local area network connection comprises: wifi direct connection, wifi network access connection or Bluetooth connection;

specifically, the wifi direct connection is a point-to-point wifi direct connection, and the wifi network access connection refers to a connection that accesses the internet through the AP.

3) A sending module 303, configured to send a control instruction to a controlled device based on the wireless local area network connection, so that the controlled device executes a corresponding operation according to the received control instruction.

In the embodiment of the invention, when the mobile terminal is used as the remote controller to control the controlled equipment, because the mobile terminal and the controlled equipment transmit the control instruction through the established wireless local area network connection instead of directly through the infrared connection, the controlled equipment does not need to be in the sight range of a user holding the mobile terminal, and the remote control use distance of the user is enlarged. Meanwhile, the operation angle of the user is not limited, and great convenience is brought to the operation of the user.

As shown in fig. 3, a second embodiment of the present invention provides a mobile terminal, including:

1) an obtaining module 301, configured to obtain controlled device information.

Specifically, the obtaining module 301 is configured to: acquiring controlled equipment information in a mode of carrying out image recognition on a set identifier of the controlled equipment or in a mode of searching through a wireless signal;

the setting of the identifier includes: two-dimensional codes, bar codes or set icons. The image recognition mode refers to: and (4) resolving after photographing, or scanning an image.

For example, a two-dimensional code is pasted on the shell of the controlled device, and the obtaining module 301 obtains information of the controlled device by scanning the two-dimensional code or recognizing the two-dimensional code after photographing; or, a set icon is pasted on the controlled device shell, the set icon can acquire information contained in the set icon through a set analysis algorithm, and the acquisition module 301 acquires the controlled device information by shooting the set icon and then analyzing the set icon.

The wireless signal searching mode may be a mode of discovering a wifi device or a bluetooth device, and the searched wireless signal refers to a wifi signal or a bluetooth signal.

2) A first connection module 302, configured to establish a wireless local area network connection with a controlled device according to the controlled device information; the wireless local area network connection comprises: wifi directly links to connect, wifi is gone into the net and is connected or the bluetooth is connected.

Specifically, according to different ways of obtaining information of the controlled device, the embodiment of the present invention divides the specific functions of the first connection module 302 into the following two cases:

the first method comprises the following steps: in the case that the obtaining module 301 is configured to obtain the controlled device information by performing image recognition on the setting identifier of the controlled device, the first connecting module 302 is configured to:

In this case, since the user actively initiates information acquisition control on a certain controlled device, the user wants to control the controlled device through the mobile terminal in the hand, after acquiring information of the controlled device through an image recognition mode, the user needs to judge whether the controlled device is connected with the mobile terminal before, if so, the user is likely to have downloaded an infrared control instruction set of the controlled device locally, and the user only needs to directly load the infrared control instruction set corresponding to the controlled device; if not, the controlled device is strange for the mobile terminal, an infrared control instruction set of the controlled device needs to be downloaded from an instruction library of a cloud terminal and then loaded, and after a wireless local area network connection is established with the controlled device, the information of the controlled device is added into the device library.

And the second method comprises the following steps: in the case that the obtaining module 301 is configured to obtain the controlled device information by means of wireless signal search, the first connecting module 302 is configured to:

In this case, since the mobile terminal automatically discovers the surrounding devices through wifi signals or bluetooth signals, it is likely that the device may be searched for its own home or neighboring home, and the user does not want to control all the searched devices, but only controls the searched controlled devices that have previously established a wireless local area network connection with the mobile terminal, for which the mobile terminal needs to automatically establish a wireless local area network connection with the controlled device based on the information of the controlled device and load an infrared control instruction set corresponding to the controlled device, and for which the controlled devices that have not previously established a wireless local area network connection with the mobile terminal do not operate, if the user needs to control the controlled devices that have not established a wireless local area network connection with the mobile terminal, the technical scheme of the first case may be used to perform information acquisition, Connection and loading of instruction sets.

As shown in fig. 3, a third embodiment of the present invention provides a mobile terminal, including:

1) an obtaining module 301, configured to obtain controlled device information;

Specifically, the sending module 303 is configured to, when the mobile terminal starts a screen sending function of the controlled device:

and sending a corresponding control instruction to the controlled equipment based on the touch operation received by the screen of the controlled equipment.

According to the different types of the established wireless local area network connections, the embodiment of the present invention divides the specific functions of the sending module 303 into the following two cases:

the first method comprises the following steps: under the condition that the wireless local area network connection is wifi direct connection or wifi network access connection, the sending module 303 is configured to:

Under the condition, the transmission rate of the wifi direct connection or the wifi network access connection is much higher than that of the bluetooth connection, so that the controlled device can be supported to quickly transmit the image data of each key of the control interface to the mobile terminal. When the screen of the mobile terminal receives the touch operation of the user, the key is to record the pressed position of the touch operation to determine which key area is pressed, so that the pressed key area is sent to the controlled device, and the controlled device can know a corresponding control instruction according to the fixed corresponding relation between the screen control interface of the controlled device and the control interface displayed by the screen of the mobile terminal.

And the second method comprises the following steps: in a case that the wireless lan connection is a bluetooth connection, the sending module 303 is configured to:

In this case, since the transmission rate of the bluetooth connection is much slower than that of the wifi direct connection or the wifi network access connection, the controlled device cannot be supported to quickly transmit the image data of each key of the control interface to the mobile terminal, and in order to avoid influencing the operation experience of the user due to delay, the embodiment of the invention simplifies the data transmitted under the bluetooth connection condition, does not transmit the image data, but transmits the coordinate data of each key of the control interface, and thus the screen data display speed almost equivalent to that of the wifi direct connection or the wifi network access connection can be achieved.

As shown in fig. 3, a fourth embodiment of the present invention provides a mobile terminal, including:

1) an obtaining module 301, configured to obtain controlled device information;

Specifically, in the case that the mobile terminal turns off the screen sending function of the controlled device, the sending module 303 is configured to:

In the embodiment of the invention, when the mobile terminal is used as the remote controller to control the controlled equipment, because the infrared control instruction is transmitted between the mobile terminal and the controlled equipment through the established wireless local area network connection instead of directly through the infrared connection, the controlled equipment does not need to be in the sight range of a user holding the mobile terminal, and the remote control use distance of the user is enlarged. Meanwhile, the operation angle of the user is not limited, and great convenience is brought to the operation of the user.

As shown in fig. 4, a fifth embodiment of the present invention provides a controlled device, including:

1) a providing module 401, configured to provide the controlled device information to a mobile terminal;

2) a second connection module 402, configured to establish a wireless local area network connection with an intelligent device; the wireless local area network connection comprises: wifi direct connection, wifi network access connection or Bluetooth connection;

3) a receiving module 403, configured to receive a control instruction sent by the mobile terminal based on the wireless local area network, and execute a corresponding operation according to the control instruction.

In the embodiment of the invention, when the user uses the mobile terminal as the remote controller to control the controlled equipment, the controlled equipment and the mobile terminal transmit the control instruction through the established wireless local area network connection instead of directly through the infrared connection, so that the controlled equipment does not need to be in the sight range of the user holding the mobile terminal, and the remote control use distance of the user is enlarged. Meanwhile, the operation angle of the user is not limited, and great convenience is brought to the operation of the user.

As shown in fig. 4, a sixth embodiment of the present invention proposes a controlled device, including:

1) a providing module 401, configured to provide the controlled device information to the mobile terminal.

Specifically, the providing module 401 is configured to provide the controlled device information to the mobile terminal in a manner of providing a setting identifier for image recognition of the mobile terminal or in a manner of transmitting a wireless signal for search by the mobile terminal;

Specifically, in a case that the screen sending function of the controlled device is turned on by the mobile terminal, the receiving module 403 is configured to:

According to the different types of the established wireless local area network connections, the embodiment of the present invention divides the specific functions of the receiving module 403 into the following two cases:

the first method comprises the following steps: under the condition that the wireless lan connection is wifi direct connection or wifi network access connection, the receiving module 403 is configured to:

And the second method comprises the following steps: in the case that the wireless lan connection is a bluetooth connection, the receiving module 403 is configured to:

As shown in fig. 4, a seventh embodiment of the present invention proposes a controlled device, including:

Specifically, in a case that the screen sending function of the controlled device is not turned on, the receiving module 403 is configured to: and receiving an infrared control instruction sent by the mobile terminal through wireless local area network connection.

In the embodiment of the invention, when the user uses the mobile terminal as the remote controller to control the controlled equipment, the controlled equipment and the mobile terminal transmit the infrared control instruction through the established wireless local area network connection instead of directly through the infrared connection, so that the controlled equipment does not need to be in the sight range of the user holding the mobile terminal, and the remote control use distance of the user is enlarged. Meanwhile, the operation angle of the user is not limited, and great convenience is brought to the operation of the user.

As shown in fig. 5, an eighth embodiment of the present invention provides a method for a mobile terminal to control a controlled device, where the steps executed by the mobile terminal side include:

step S101, a mobile terminal acquires controlled equipment information and establishes wireless local area network connection with controlled equipment according to the controlled equipment information; the wireless local area network connection comprises: wifi direct connection, wifi network access connection or Bluetooth connection;

and step S102, the mobile terminal sends a control instruction to the controlled equipment based on the wireless local area network connection, so that the controlled equipment can execute corresponding operation according to the received control instruction.

As shown in fig. 5, a ninth embodiment of the present invention provides a method for a mobile terminal to control a controlled device, where the steps executed by the mobile terminal side include:

specifically, the mobile terminal acquires the information of the controlled device in a mode of image recognition of a set identifier of the controlled device or a mode of wireless signal search;

For example, a two-dimensional code is pasted on the shell of the controlled device, and the obtaining module 301 obtains information of the controlled device by scanning the two-dimensional code or recognizing the two-dimensional code after photographing; or, a set icon is pasted on the shell of the controlled device, the set icon can acquire information contained in the icon through a set analysis algorithm, and the mobile terminal acquires the information of the controlled device by shooting the set icon and then analyzing the icon.

According to different modes of obtaining the information of the controlled equipment, the embodiment of the invention specifically divides the connection process into the following two conditions:

the first method comprises the following steps: in step S101, establishing a wireless local area network connection with a controlled device according to the controlled device information, where the mobile terminal obtains the controlled device information by performing image recognition on a setting identifier of the controlled device, the method includes:

And the second method comprises the following steps: under the condition that the mobile terminal obtains the controlled device information in a wireless signal searching mode, the establishing of the wireless local area network connection with the controlled device according to the controlled device information comprises the following steps:

As shown in fig. 5, a tenth embodiment of the present invention provides a method for a mobile terminal to control a controlled device, where the steps executed by the mobile terminal side include:

Specifically, when the mobile terminal starts the screen sending function of the controlled device, the step S102 of sending, by the mobile terminal, the control instruction to the controlled device based on the wlan connection includes:

The embodiment of the invention divides the screen display process into the following two conditions according to the different types of the established wireless local area network connection:

the first method comprises the following steps: in the case where the wireless lan connection is a wifi direct connection or a wifi network access connection,

And the second method comprises the following steps: in the case where the wireless lan connection is a bluetooth connection,

As shown in fig. 5, an eleventh embodiment of the present invention provides a method for a mobile terminal to operate a controlled device, where the steps executed by the mobile terminal include:

Specifically, in the case that the screen sending function of the controlled device is not turned on, the step S102 of sending, by the mobile terminal, the control instruction to the controlled device based on the wireless local area network connection includes:

As shown in fig. 6, a twelfth embodiment of the present invention provides a method for a mobile terminal to control a controlled device, where the steps executed by a controlled device side include:

step S201, the controlled device provides the controlled device information to the mobile terminal, and establishes wireless local area network connection with the intelligent device; the wireless local area network connection comprises: wifi direct connection, wifi network access connection or Bluetooth connection;

and step S202, the controlled device receives a control instruction sent by the mobile terminal based on the wireless local area network, and executes corresponding operation according to the control instruction.

As shown in fig. 6, a thirteenth embodiment of the present invention provides a method for a mobile terminal to operate a controlled device, where the controlled device side performs steps including:

specifically, the controlled device provides the controlled device information to the mobile terminal in a mode of providing a set identifier for image recognition of the mobile terminal or in a mode of transmitting a wireless signal for search of the mobile terminal;

As shown in fig. 6, a fourteenth embodiment of the present invention provides a method for a mobile terminal to control a controlled device, where the steps executed by a controlled device side include:

Specifically, when the screen sending function of the controlled device is turned on by the mobile terminal, the receiving, by the controlled device in step S202, the control instruction sent by the mobile terminal based on the wireless local area network includes:

The embodiment of the invention divides the screen transfer display process into the following two conditions according to the different types of the established wireless local area network connection:

As shown in fig. 6, a fifteenth embodiment of the present invention provides a method for a mobile terminal to operate a controlled device, where the controlled device side performs steps including:

Specifically, when the screen sending function of the controlled device is not turned on, the receiving, by the controlled device in step S202, the control instruction sent by the mobile terminal based on the wireless local area network includes:

As shown in fig. 7 to 8, a sixteenth embodiment of the present invention introduces a typical application scenario, where in this embodiment, a mobile phone is used for shooting a device for the first time, information of the device is obtained, a corresponding control instruction is downloaded from a remote instruction library according to the information of the device, the device is stored in a local device library, and once a device in the device library is searched, a connection is directly initiated. After the connection is finished, the instructions in the instruction library are directly sent through the wifi direct for control during control, and after the controlled equipment receives the control instructions, the controlled equipment converts the control instructions into infrared control instructions. For the device capable of supporting screen projection, the controlled device projects the screen onto the mobile phone, and the mobile phone performs control in a screen projection mode. The scheme expands the use range of the user for control, provides different control modes according to different devices, and improves the use experience of the user.

The technical scheme design of the embodiment of the invention is described as follows:

A. the mobile phone side consists of 8 modules as shown in fig. 7. The camera module is used for framing the opposite terminal equipment, and the display module is used for framing pictures or displaying screen pictures of the display equipment; the image recognition module is used for recognizing information such as special marks, similar two-dimensional codes and the like in the image captured by the camera to acquire information of the display equipment; the device type identification module identifies the type of the opposite device and simultaneously identifies whether the opposite device supports screen projection; the control instruction sending module is used for sending a control instruction of a user; the wifi module is responsible for completing wifi direct networking and maintaining a bottom link; the instruction library is used for storing infrared instructions of different devices; the equipment library is used for storing the connected equipment; and the screen analysis module is responsible for analyzing and displaying the data sent by the other party when the equipment supporting screen projection is enabled to realize the function.

B. The controlled device side is shown in fig. 8. The display module provides an interface operable by a user and provides a data source identified by the image on the mobile phone side; the screen data sending module starts to send the screen data when the user selects screen projection; the control instruction receiving module is used for receiving the screen projection control instruction and responding; the wifi module is used for completing wifi direct networking; the infrared module is used for analyzing the received infrared instruction and responding; the equipment type identification module identifies the equipment type of the equipment; the instruction identification module is used for identifying whether the received instruction is an infrared instruction or a screen projection control instruction

C. The device library stores information of all connected devices, and when the device is not connected with the mobile phone, once the device is searched, the connection is automatically established. And the user can modify the name of the device on the local machine, thereby facilitating the identification

D. There will be a list of devices on the mobile phone side and the devices that support screen projection have switches, and in the connected situation, the user can manually select whether to use the screen projection mode for control.

E. After the equipment identification is completed, the remote end downloads the corresponding operation instruction to the local instruction library directly according to the identified type, and the wifi direct connection with the other party is completed at the same time.

F. The screen data sending module of the controlled device is optional, when the opposite-end device is provided with the module, the mobile phone can identify whether the module exists after the connection is completed, if so, the device supports screen projection, and meanwhile, projection is given to a user on an interface.

G. For equipment which does not support screen projection, the mobile phone calls a corresponding instruction in the instruction library, the instruction is sent through wifi, and after receiving the instruction, the opposite-end equipment recognizes that the instruction is an infrared instruction and transfers the infrared instruction to the infrared module for processing; for the device supporting screen projection, when the screen projection function is not started, the control mode is consistent with that of the device not supporting screen projection, and when the screen projection is started, the mobile phone receives screen data of the opposite device, so that touch operation on the whole screen is realized.

The technical scheme of the embodiment of the invention has the following related flow detailed description:

and step 1, when the equipment exists in the equipment library, directly completing the wifi direct connection under the condition of connection.

Step 2, when the equipment does not exist in the equipment library, the user opens the camera at the mobile phone side, and frames the equipment to be controlled through the frame, and after the user determines the frame content through the interface, the image recognition is started

And 3, identifying and acquiring equipment information through forms such as special marks or two-dimensional codes provided for the frame of the display equipment, automatically downloading an instruction set of corresponding equipment from a remote library according to the identified equipment, and automatically completing the connection of the wifi direct.

And 4, after the connection is finished, directly selecting a corresponding instruction from the instruction library to send the corresponding instruction when the user controls the equipment which does not support screen projection.

Step 5, under the condition that the screen projection function is not started and the user controls the equipment supporting the screen projection, directly selecting a corresponding instruction from an instruction library to send; when the screen projection function is started, the mobile phone side receives and displays screen data of opposite terminal equipment, and a user sends a control instruction by operating the mobile phone screen of the user

And 6, after receiving the instruction, the controlled device firstly identifies whether the instruction is an infrared instruction, if the instruction is the infrared instruction, the infrared instruction is processed by an infrared module, and if the instruction is not the infrared instruction, the infrared instruction is processed by a control instruction receiving module and converted into a touch screen event, and the touch screen event is responded.

And 7, after the connection is finished, the user selects to use the screen projection to control a certain device, the mobile phone closes the screen partition identification function, the mobile phone initiates a screen projection request to the display device, the display device sends screen data, and the mobile phone analyzes and displays the received data.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.

The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.

Claims

1. A mobile terminal, characterized in that the mobile terminal comprises:

the sending module is used for sending a control instruction to the controlled equipment based on the wireless local area network connection so that the controlled equipment can execute corresponding operation according to the received control instruction;

the obtaining module is configured to: acquiring controlled equipment information in a mode of carrying out image recognition on a set identifier of the controlled equipment or in a mode of searching through a wireless signal;

the setting of the identifier includes: two-dimensional codes, bar codes or set icons;

under the condition that the obtaining module is used for obtaining the controlled device information in a mode of carrying out image recognition on the set identifier of the controlled device, the first connecting module is used for:

2. The mobile terminal according to claim 1, wherein in a case that the obtaining module is configured to obtain the controlled device information through a wireless signal search, the first connecting module is configured to:

3. The mobile terminal of claim 1, wherein in case that the mobile terminal turns on a screen transmission function of the controlled device,

the sending module is configured to:

4. The mobile terminal of claim 3, wherein in case the wireless local area network connection is a wifi direct connection or a wifi network access connection,

the sending module is configured to:

5. A mobile terminal according to claim 3, characterized in that, in case the wireless local area network connection is a Bluetooth connection,

the sending module is configured to:

6. The mobile terminal according to claim 1 or 2, wherein, in case that the mobile terminal turns off the screen transmission function of the controlled device,

the sending module is configured to:

7. A controlled device, characterized in that the controlled device comprises:

the receiving module is used for receiving a control instruction sent by the mobile terminal based on the wireless local area network and executing corresponding operation according to the control instruction;

in case that the screen transmission function of the controlled device is turned on by the mobile terminal,

the receiving module is configured to:

receiving a control instruction which is sent by a mobile terminal and corresponds to touch operation on a screen of the mobile terminal;

in case that the screen transmission function of the controlled device is not turned on,

the receiving module is configured to:

8. The controlled device according to claim 7, wherein the providing module is configured to provide the controlled device information to the mobile terminal in a manner of providing a setting identifier for image recognition by the mobile terminal or in a manner of transmitting a wireless signal for search by the mobile terminal;

9. The controlled device of claim 7, wherein, in the case where the wireless local area network connection is a wifi direct connection or a wifi network access connection,

the receiving module is configured to:

10. The controlled device of claim 7, wherein, in the case where the wireless local area network connection is a Bluetooth connection,

the receiving module is configured to:

11. A method for a mobile terminal to control a controlled device is characterized by comprising the following steps:

the mobile terminal sends a control instruction to the controlled equipment based on the wireless local area network connection, so that the controlled equipment executes corresponding operation according to the received control instruction;

the step of obtaining the controlled device information by the mobile terminal comprises the following steps:

the mobile terminal acquires the information of the controlled equipment in a mode of carrying out image recognition on the set identifier of the controlled equipment or in a mode of searching through a wireless signal;

the step of establishing a wireless local area network connection with the controlled device according to the controlled device information under the condition that the mobile terminal obtains the controlled device information by performing image recognition on the set identifier of the controlled device comprises the following steps:

12. The method of claim 11, wherein the step of establishing a wireless local area network connection with the controlled device according to the controlled device information when the mobile terminal obtains the controlled device information through a wireless signal search method includes:

13. The method for controlling a controlled device by a mobile terminal according to claim 11, wherein in case that the mobile terminal starts a screen transmission function of the controlled device,

the step that the mobile terminal sends a control instruction to the controlled equipment based on the wireless local area network connection comprises the following steps:

14. The method for controlling controlled device by mobile terminal according to claim 13, wherein in case that the wireless LAN connection is a wifi direct connection or a wifi network access connection,

15. The method of claim 13, wherein in the case that the wireless LAN connection is a Bluetooth connection,

16. The method for controlling a controlled device of a mobile terminal according to claim 11 or 12, wherein, in case that the screen transmission function of the controlled device is not turned on,

17. A method for a mobile terminal to control a controlled device is characterized by comprising the following steps:

the controlled equipment receives a control instruction sent by the mobile terminal based on the wireless local area network and executes corresponding operation according to the control instruction;

the method for controlling the controlled device to receive the control instruction sent by the mobile terminal based on the wireless local area network includes the following steps:

the controlled device receives a control instruction which is sent by a mobile terminal and corresponds to touch operation on a screen of the mobile terminal;

the method for controlling the controlled device to receive the control instruction sent by the mobile terminal based on the wireless local area network under the condition that the screen sending function of the controlled device is not started comprises the following steps:

18. The method for controlling a controlled device by a mobile terminal according to claim 17, wherein the step of providing the controlled device information to the mobile terminal by the controlled device comprises:

the controlled device provides the controlled device information to the mobile terminal in a mode of image recognition of the mobile terminal through the provided set identifier or in a mode of searching for the mobile terminal through transmitting a wireless signal;

19. The method for controlling controlled device by mobile terminal according to claim 17, wherein in case that the wireless local area network connection is wifi direct connection or wifi network access connection,

20. The method for controlling controlled device of claim 17, wherein in case that the wireless LAN connection is Bluetooth connection,