CN108415572B - Module control method and device applied to mobile terminal and storage medium - Google Patents
Module control method and device applied to mobile terminal and storage medium Download PDFInfo
- Publication number
- CN108415572B CN108415572B CN201810214633.0A CN201810214633A CN108415572B CN 108415572 B CN108415572 B CN 108415572B CN 201810214633 A CN201810214633 A CN 201810214633A CN 108415572 B CN108415572 B CN 108415572B
- Authority
- CN
- China
- Prior art keywords
- module
- eye information
- mobile terminal
- module set
- eye
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 46
- 210000001508 eye Anatomy 0.000 claims description 225
- 210000005252 bulbus oculi Anatomy 0.000 claims description 15
- 230000004424 eye movement Effects 0.000 claims description 8
- 238000004590 computer program Methods 0.000 claims description 7
- 238000001514 detection method Methods 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 5
- 230000004397 blinking Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
- G06F21/31—User authentication
- G06F21/32—User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B15/00—Systems controlled by a computer
- G05B15/02—Systems controlled by a computer electric
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/20—Pc systems
- G05B2219/26—Pc applications
- G05B2219/2642—Domotique, domestic, home control, automation, smart house
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Security & Cryptography (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Computer Hardware Design (AREA)
- Automation & Control Theory (AREA)
- Manufacturing & Machinery (AREA)
- Quality & Reliability (AREA)
- Telephone Function (AREA)
- Selective Calling Equipment (AREA)
- User Interface Of Digital Computer (AREA)
- Telephonic Communication Services (AREA)
Abstract
The invention discloses a module control method, a device and a storage medium applied to a mobile terminal, wherein the method comprises the following steps: and acquiring first eye information of the user according to the acquired module control request, searching according to the first eye information to obtain a corresponding module set, acquiring second eye information of the user, and controlling the modules in the module set based on the second eye information. Each module set comprises a plurality of intelligent devices connected with the mobile terminal, operation instructions corresponding to the second eye information are sent to the corresponding intelligent devices in the module set through the mobile terminal, the operation instructions are used for indicating the corresponding intelligent devices in the module set to execute corresponding operations, so that the mobile terminal can remotely control the plurality of intelligent devices connected with the mobile terminal through the second eye information, the intelligent devices can be remotely controlled through one master control device, the operation is simple and fast, and the centralized control of the modules is facilitated.
Description
The present application is a divisional application of chinese patent application with the title "module control method and apparatus applied to mobile terminal" filed by chinese patent office on 28/10/2015, application number 2015107195749.
Technical Field
The present invention relates to the field of iris recognition technologies, and in particular, to a module control method and apparatus applied to a mobile terminal, and a storage medium.
Background
With the intelligent development of electronic devices, iris recognition technology is gradually entering the lives of people.
Taking home appliances such as a television, a sound box, an intelligent door and the like as examples, a commonly used control mode at present is to integrate an iris recognition device and a control system in each home appliance, and if a user needs to open a certain home appliance, the user needs to recognize the home appliance through the iris recognition device of the home appliance. The operation mode not only has certain requirements on the household appliances (namely, each household appliance is required to be provided with the iris recognition device), but also needs to carry out iris recognition operation for many times when a user needs to open a plurality of household appliances at the same time, so that the operation process is complicated, the working efficiency is low, and much inconvenience is brought to the user.
Disclosure of Invention
The invention aims to provide a module control method, a module control device and a storage medium applied to a mobile terminal, and aims to solve the problems of complex operation process and low working efficiency of the existing module control method.
In order to solve the above technical problems, embodiments of the present invention provide the following technical solutions:
a module control method applied to a mobile terminal includes:
acquiring a module control request;
acquiring first eye information of a user according to the module control request;
searching according to the first eye information to obtain a corresponding module set, wherein the module set comprises a plurality of intelligent devices which are connected with the mobile terminal;
acquiring second eye information of the user according to the module set;
and controlling the modules in the module set based on the second eye information, wherein an operation instruction corresponding to the second eye information is sent to the corresponding intelligent equipment in the module set through the mobile terminal, and the operation instruction is used for indicating the corresponding intelligent equipment in the module set to execute corresponding operation, so that the mobile terminal remotely controls the plurality of intelligent equipment connected with the mobile terminal through the second eye information.
Further, the step of controlling the modules in the module set based on the second eye information specifically includes:
determining corresponding intelligent equipment and operation instructions in the module set according to the second eye information;
and sending an operation instruction corresponding to the second eye information to the corresponding intelligent equipment in the module set through the mobile terminal, so that the mobile terminal can remotely control the corresponding intelligent equipment in the module set through the operation instruction.
Further, the step of determining the corresponding smart device and operation instruction in the module set according to the second eye information includes:
and searching according to the second eye information to obtain the corresponding intelligent equipment and the operation instruction in the module set.
Further, the step of controlling the modules of the set of modules based on the second eye information comprises:
and carrying out opening or closing operation on the corresponding intelligent equipment in the module set based on the second eye information.
Further, the step of turning on or off the corresponding smart device in the module set based on the second eye information includes:
searching in a preset instruction database according to the second eye information to obtain the corresponding intelligent equipment in the module set;
detecting the running state of the intelligent equipment;
and performing an operation of the opposite operation state according to the detected operation state.
Further, the step of searching according to the first eye information to obtain a corresponding module set specifically includes: searching in a preset first eye template library according to the first eye information to obtain a corresponding module set, wherein the first eye template library is used for storing the corresponding relation between the first eye information and the module set, and each module set comprises a plurality of same or different intelligent devices which are connected with the mobile terminal;
the step of searching according to the second eye information to obtain the corresponding intelligent device in the module set specifically includes: and searching in a preset second eye template library according to the second eye information to obtain one or more corresponding intelligent devices in the module set, wherein the second eye template library is used for storing the corresponding relation between the second eye information and the intelligent devices.
Further, the first eye information and the second eye information both comprise eyeball action information, the module set is divided according to module types, and the module set comprises a radio frequency module set, a Bluetooth module set and an infrared module set.
Further, the first eye information comprises eyeball biological information, the second eye information comprises eyeball action information, the module set is divided according to user modes, and the module set comprises a main mode module set, a visitor mode module set and a child mode module set.
In order to solve the above technical problems, embodiments of the present invention further provide the following technical solutions:
a module control device applied to a mobile terminal, comprising:
a first obtaining unit, configured to obtain a module control request;
the second acquisition unit is used for acquiring the first eye information of the user according to the module control request;
the searching unit is used for searching according to the first eye information to obtain a corresponding module set, wherein the module set comprises a plurality of intelligent devices which are connected with the mobile terminal;
the third acquisition unit is used for acquiring second eye information of the user according to the module set;
and the control unit is used for controlling the modules in the module set based on the second eye information, wherein an operation instruction corresponding to the second eye information is sent to the corresponding intelligent equipment in the module set through the mobile terminal, and the operation instruction is used for indicating the corresponding intelligent equipment in the module set to execute corresponding operation, so that the mobile terminal remotely controls the plurality of intelligent equipment connected with the mobile terminal through the second eye information.
Further, the control unit specifically includes:
the first control searching subunit is used for determining the corresponding intelligent equipment and the corresponding operation instruction in the module set according to the second eye information;
and the first control subunit is used for sending the operation instruction corresponding to the second eye information to the corresponding intelligent equipment in the module set through the mobile terminal, so that the mobile terminal can remotely control the corresponding intelligent equipment in the module set through the operation instruction.
Further, the first control search subunit is specifically configured to:
and searching in a preset instruction database according to the second eye information to acquire the corresponding intelligent equipment and the operation instruction in the module set.
Further, the control unit is specifically configured to:
and switching on or switching off the intelligent equipment in the module set based on the second eye information.
Further, the control unit specifically includes:
the second control searching subunit is used for searching according to the second eye information to obtain the corresponding intelligent equipment in the module set;
the control detection subunit is used for detecting the running state of the intelligent equipment;
and a second control subunit for executing an operation of the opposite operating state in accordance with the detected operating state.
Further, the search unit is specifically configured to: searching in a preset first eye template library according to the first eye information to obtain a corresponding module set, wherein the first eye template library is used for storing the corresponding relation between the first eye information and the module set, and each module set comprises a plurality of same or different intelligent devices which are connected with the mobile terminal;
the second control search subunit is specifically configured to: and searching in a preset second eye template library according to the second eye information to obtain one or more corresponding intelligent devices in the module set, wherein the second eye template library is used for storing the corresponding relation between the second eye information and the intelligent devices.
Embodiments of the present invention also provide a storage medium having a computer program stored thereon, where the computer program is used to make a computer execute the method described above when the computer program runs on the computer.
According to the module control method, the device and the storage medium applied to the mobile terminal, the first eye information of the user is obtained according to the obtained module control request, the second eye information of the user is obtained after the corresponding module set is obtained by searching according to the first eye information, and the modules in the module set are controlled based on the second eye information, so that the control of the modules can be realized quickly, the operation is simple, and the centralized control of the modules is facilitated. Each module set comprises a plurality of intelligent devices connected with the mobile terminal, operation instructions corresponding to the second eye information are sent to the corresponding intelligent devices in the module set through the mobile terminal, the operation instructions are used for indicating the corresponding intelligent devices in the module set to execute corresponding operations, so that the mobile terminal can remotely control the plurality of intelligent devices connected with the mobile terminal through the second eye information, the plurality of intelligent devices can be remotely controlled through one main control device, and the operation is simple and rapid.
Drawings
The technical solution and other advantages of the present invention will become apparent from the following detailed description of specific embodiments of the present invention, which is to be read in connection with the accompanying drawings.
Fig. 1 is a schematic view of a scenario of a module control system applied to a mobile terminal according to an embodiment of the present invention.
Fig. 2 is a flowchart illustrating a module control method applied to a mobile terminal according to a first embodiment of the present invention.
Fig. 3 is a schematic structural diagram of a module control device applied to a mobile terminal according to a second embodiment of the present invention.
Fig. 4 is a schematic structural diagram of a first control unit in a second embodiment of the present invention.
Fig. 5 is a schematic structural diagram of a second control unit according to a second embodiment of the present invention.
Detailed Description
Referring to the drawings, wherein like reference numbers refer to like elements, the principles of the present invention are illustrated as being implemented in a suitable computing environment. The following description is based on illustrated embodiments of the invention and should not be taken as limiting the invention with regard to other embodiments that are not detailed herein.
In the description that follows, specific embodiments of the present invention are described with reference to steps and symbols executed by one or more computers, unless otherwise indicated. Accordingly, these steps and operations will be referred to, several times, as being performed by a computer, the computer performing operations involving a processing unit of the computer in electronic signals representing data in a structured form. This operation transforms the data or maintains it at locations in the computer's memory system, which may be reconfigured or otherwise altered in a manner well known to those skilled in the art. The data maintains a data structure that is a physical location of the memory that has particular characteristics defined by the data format. However, while the principles of the invention have been described in language specific to above, it is not intended to be limited to the specific form set forth herein, but on the contrary, it is to be understood that various steps and operations described hereinafter may be implemented in hardware.
The term "module" as used herein may be considered a software object executing on the computing system. The various components, modules, engines, and services described herein may be viewed as objects implemented on the computing system. The apparatus and method described herein are preferably implemented in software, but may also be implemented in hardware, and are within the scope of the present invention.
The embodiment of the invention provides a module control method and device applied to a mobile terminal and a storage medium.
Referring to fig. 1, fig. 1 is a scene schematic diagram of a module control system applied to a mobile terminal according to an embodiment of the present invention, where the module control system applied to the mobile terminal may include a module control device applied to the mobile terminal, and is mainly used to obtain first eye information of a user according to an obtained module control request, obtain a corresponding module set by searching according to the first eye information, obtain second eye information of the user, and control modules in the module set based on the second eye information.
As shown in fig. 1, the module control device is integrated in a mobile phone, and is mainly applied to smart home. The first eye information and the second eye information are eye movement information, such as upward turning of eyes, left turning or right turning of eyes, squinting, opening eyes, blinking, and the like. The module set is divided according to module types, such as a radio frequency module set, a Bluetooth module set, an infrared module set and the like. When a user needs to open a certain infrared remote control device, for example, a television is opened, the module control device acquires first eye information (for example, eyeball upturning) of the user, searches for a corresponding module set (infrared module set) according to the first eye information, then acquires second eye information (for example, blinking twice), and realizes the starting operation of the television based on the second eye information.
The details will be described below separately.
First embodiment
In the present embodiment, the description will be made from the perspective of a module control apparatus applied to a mobile terminal, which may be specifically integrated in a mobile terminal such as a mobile phone or an IPAD.
Referring to fig. 2, fig. 2 is a flowchart illustrating a module control method applied to a mobile terminal according to a first embodiment of the present invention. The module control method applied to the mobile terminal may include:
s101, acquiring a module control request.
In this embodiment, a user may generate a module control request by entering a module control window on a mobile terminal such as a mobile phone, for example, by entering a terminal Application (APP) controlled by a module.
And S102, acquiring the first eye information of the user according to the module control request.
In this embodiment, the first eye information of the user may be acquired by an iris recognition camera on the mobile terminal.
Preferably, the first eye information may include eye movement information or eye biological information.
S103, searching is carried out according to the first eye information, and a corresponding module set is obtained.
The module set comprises a plurality of intelligent devices which are connected with the mobile terminal.
Preferably, the step S103 may specifically include: and searching in a preset first eye template library according to the first eye information to obtain a corresponding module set, wherein the first eye template library is used for storing the corresponding relation between the first eye information and the module set. Each module set comprises a plurality of same or different intelligent devices which are connected with the mobile terminal.
It is to be understood that the first eye template library may be established by pre-capturing first eye information of the user and associating the first eye information with the set of modules.
In this embodiment, the module set may be divided in various ways to meet different requirements of users.
For example, when the purpose of iris recognition set by the user is mainly to limit the usage right of the electronic device so as to protect privacy, the module set may be divided according to user modes, different users correspond to different module sets, and the modules in each module set are different. When the purpose of the user setting iris recognition is to facilitate management of various electronic devices, the module set may be divided according to the module types of the electronic devices.
And S104, acquiring second eye information of the user according to the module set.
In this embodiment, the second eye information may also be acquired by an iris recognition camera on the mobile terminal.
Preferably, the second eye information may include eye movements, such as upward turning of eyes, left or right turning of eyes, squinting, opening eyes, blinking, and so on.
It should be noted that, when the first eye information and the second eye information both include the eye movement information, it is preferable that the module set is divided according to the module types, and in this case, the module set may include a radio frequency module set, a bluetooth module set, and an infrared module set.
For example, the set of rf modules may include doors, etc., the set of bluetooth modules may include speakers, alarm clocks, etc., and the set of ir modules may include televisions, electric fans, air conditioners, etc.
When the first eye information includes eyeball bio-information and the second eye information includes eyeball motion information, it is preferable that the module set is divided according to a user mode, and in this case, the module set may include a main mode module set, a guest mode module set, and a child mode module set.
For example, the master mode module set may include all controllable electronic devices, the child mode module set may not include electronic devices such as computers and televisions, or may define the on-period of the electronic devices such as computers and televisions, so that parents can manage children when they are not at home. The set of guest mode modules may not include electronic devices in more private areas such as home, study, etc.
And S105, controlling the modules in the module set based on the second eye information.
And sending an operation instruction corresponding to the second eye information to the corresponding intelligent equipment in the module set through the mobile terminal, wherein the operation instruction is used for indicating the corresponding intelligent equipment in the module set to execute corresponding operation, so that the mobile terminal can remotely control the plurality of intelligent equipment connected with the mobile terminal through the second eye information.
Preferably, the step S105 can be implemented in two ways,
implementation mode one
Specifically, the step S105 may include:
and A1, determining the corresponding intelligent equipment and operation instructions in the module set according to the second eye information.
Preferably, the step a1 may include: and searching in a preset instruction database according to the second eye information to acquire the corresponding intelligent equipment and the operation instruction in the module set.
In this embodiment, the instruction database is configured to store a corresponding relationship between the second eye information and the intelligent device and the operation instruction. The user can acquire second eye information in advance, and the second eye information is stored in the instruction database after being associated with the intelligent equipment and the operation instructions in the module set.
For example, the left or right eye-flipping may be pre-matched with the tv front channel or back channel-swapping command in the command database. And when the second eye information input by the user is the left turn of the eyeball, the module and the operation instruction which are searched in the instruction database according to the second eye information are respectively the television and the front replacement station.
And A2, executing the operation instruction on the determined module.
Specifically, the operation instruction corresponding to the second eye information is sent to the corresponding intelligent device in the module set through the mobile terminal, so that the mobile terminal can remotely control the corresponding intelligent device in the module set through the operation instruction.
In this embodiment, the execution command of the operation instruction may be automatically sent by the system of the mobile terminal, or may be selectively sent by the user in the form of a pop-up box, so that it is avoided that when the second eye information of the user is incorrectly input, the relevant control operation can be cancelled in time.
Implementation mode two
Specifically, the step S105 may include:
B. and switching on or switching off the intelligent equipment in the module set based on the second eye information.
Preferably, the step B may specifically include:
b1, searching according to the second eye information to obtain the corresponding intelligent device in the module set.
In this embodiment, the step B1 may specifically include: and searching in a preset second eye template library according to the second eye information to obtain one or more corresponding intelligent devices in the module set, wherein the second eye template library is used for storing the corresponding relation between the second eye information and the intelligent devices.
Similarly, the user may acquire second eye information in advance, and store the second eye information in the second eye template library after establishing association with the smart device in the module set.
For example, the eyeball may be matched with the television in the second eye template library in advance, and when the obtained second eye information is the eyeball left turn, the television is obtained according to the search result of the second eye information in the second eye template library.
For example, the same second eye information may correspond to multiple smart devices in the module set. For example, 4 consecutive blinks may be previously mapped to all the smart devices in the corresponding module set being turned off in the second eye template library, 8 consecutive blinks may be mapped to all the smart devices in the corresponding module set being turned on, and when the obtained second eye information is 4 consecutive blinks, all the smart devices in the corresponding infrared module set are turned off according to the search result of the second eye information in the second eye template library, for example, the television, the electric fan, the air conditioner, and the like in the infrared module set are turned off at the same time. For example, the same second eye information may correspond to a plurality of smart devices of the same type in the module set, e.g., 4 consecutive blinks are corresponding to turning on all air conditioners in the module set, etc. A plurality of intelligent equipment can be correspondingly controlled through the same eye information, so that the mobile terminal can remotely control a plurality of intelligent equipment connected with the mobile terminal through one eye information, a plurality of intelligent equipment can be remotely controlled through one main control device, and the operation is simple and rapid.
And B2, detecting the running state of the intelligent equipment.
In this embodiment, the operation state mainly refers to an on or off state of the smart device.
B3, executing the operation of the reverse operation state according to the detected operation state.
For example, when it is detected that the television is in the on state, the operation of turning off the television is executed accordingly.
Similarly, the execution command of the operation may be automatically sent by the system of the mobile terminal, or may be sent in the form of a pop-up box for the user to select.
As can be seen from the above, the module control method applied to the mobile terminal provided in this embodiment obtains the first eye information of the user according to the obtained module control request, searches for the corresponding module set according to the first eye information, obtains the second eye information of the user, and controls the modules in the module set based on the second eye information, so that the control of the modules can be quickly realized, the operation is simple, and the centralized control of the modules is facilitated. Each module set comprises a plurality of intelligent devices connected with the mobile terminal, operation instructions corresponding to the second eye information are sent to the corresponding intelligent devices in the module set through the mobile terminal, the operation instructions are used for indicating the corresponding intelligent devices in the module set to execute corresponding operations, so that the mobile terminal can remotely control the plurality of intelligent devices connected with the mobile terminal through the second eye information, the plurality of intelligent devices can be remotely controlled through one main control device, and the operation is simple and rapid.
Second embodiment
In order to better implement the module control method applied to the mobile terminal provided by the embodiment of the present invention, the embodiment of the present invention further provides a module control device applied to the mobile terminal, and the module control device applied to the mobile terminal may be specifically integrated in a mobile terminal such as a mobile phone or an IPAD. The terms are the same as those in the above module control method applied to the mobile terminal, and specific implementation details can refer to the description in the method embodiment.
Referring to fig. 3, fig. 3 is a schematic structural diagram of a module control device applied to a mobile terminal according to a second embodiment of the present invention. The module control apparatus applied to the mobile terminal may include:
a first obtaining unit 10, configured to obtain a module control request.
In this embodiment, a user may enter a module control window (APP) on a mobile terminal such as a mobile phone to generate a module control request, and perform acquisition through the first acquisition unit 10.
A second obtaining unit 20, configured to obtain the first eye information of the user according to the module control request.
Preferably, the first eye information may include eye movement information or eye biological information.
The searching unit 30 is configured to search according to the first eye information to obtain a corresponding module set.
The module set comprises a plurality of intelligent devices which are connected with the mobile terminal.
Preferably, the search unit 30 may be specifically configured to: and searching in a preset first eye template library according to the first eye information to obtain a corresponding module set, wherein the first eye template library is used for storing the corresponding relation between the first eye information and the module set. Each module set comprises a plurality of same or different intelligent devices which are connected with the mobile terminal.
In this embodiment, the module set may be divided in various ways to meet different requirements of users.
For example, when the purpose of iris recognition set by the user is mainly to limit the usage right of the electronic device so as to protect privacy, the module set may be divided according to user modes, different users correspond to different module sets, and the modules in each module set are different. When the purpose of the user setting iris recognition is to facilitate management of various electronic devices, the module set may be divided according to the module types of the electronic devices.
And a third obtaining unit 40, configured to obtain second eye information of the user according to the module set.
Preferably, the second eye information may include eye movements, such as upward turning of eyes, left or right turning of eyes, squinting, opening eyes, blinking, and so on.
It should be noted that, when the first eye information and the second eye information both include the eye movement information, it is preferable that the module set is divided according to the module types, and in this case, the module set may include a radio frequency module set, a bluetooth module set, and an infrared module set.
For example, the set of rf modules may include doors, etc., the set of bluetooth modules may include speakers, alarm clocks, etc., and the set of ir modules may include televisions, fans, set-top boxes, etc.
When the first eye information includes eyeball bio-information and the second eye information includes eyeball motion information, it is preferable that the module set is divided according to a user mode, and in this case, the module set may include a main mode module set, a guest mode module set, and a child mode module set.
For example, the master mode module set may include all controllable electronic devices, the child mode module set may not include electronic devices such as computers and televisions, or may define the on-period of the electronic devices such as computers and televisions, so that parents can manage children when they are not at home. The set of guest mode modules may not include electronic devices in more private areas such as home, study, etc.
A control unit 50 for controlling the modules of the set of modules based on the second eye information.
The control unit 50 sends an operation instruction corresponding to the second eye information to the corresponding intelligent device in the module set through the mobile terminal, where the operation instruction is used to instruct the corresponding intelligent device in the module set to perform corresponding operation, so that the mobile terminal remotely controls the plurality of intelligent devices connected with the mobile terminal through the second eye information.
Preferably, referring to fig. 4, corresponding to the first implementation manner of step S105 in the first embodiment, the control unit 50 may include:
and the first control searching subunit 51A is configured to determine, according to the second eye information, a corresponding smart device and an operation instruction in the module set.
Preferably, the first control search subunit 51A may be specifically configured to: and searching in a preset instruction database according to the second eye information to acquire the corresponding intelligent equipment and the operation instruction in the module set.
For example, the module and the operation command obtained by searching in a preset command database according to the action of turning left the eyeball are the television and the front-end switching station respectively.
The first control subunit 52A is configured to execute the operation instruction on the determined module.
Specifically, the first control subunit 52A sends the operation instruction corresponding to the second eye information to the corresponding intelligent device in the module set through the mobile terminal, so that the mobile terminal remotely controls the corresponding intelligent device in the module set through the operation instruction.
In this embodiment, the execution command of the operation instruction may be automatically sent by the system of the mobile terminal, or may be selectively sent by the user in the form of a pop-up box, so that it is avoided that when the second eye information of the user is incorrectly input, the relevant control operation can be cancelled in time.
Referring to fig. 5, corresponding to the second implementation manner of step S105 in the first embodiment, the control unit 50 may specifically be configured to:
and switching on or switching off the intelligent equipment in the module set based on the second eye information.
Preferably, the control unit 50 may specifically include:
and the second control searching subunit 51B is configured to search according to the second eye information to obtain the intelligent device corresponding to the module set.
In this embodiment, the second control search subunit 51B may specifically be configured to: and searching in a preset second eye template library according to the second eye information to obtain one or more corresponding intelligent devices in the module set, wherein the second eye template library is used for storing the corresponding relation between the second eye information and the intelligent devices.
For example, the module obtained by searching in the preset second eye template library according to the action of turning left the eyeball is a television.
For example, the same second eye information may correspond to multiple smart devices in the module set. For example, 4 consecutive blinks may be previously mapped to all the smart devices in the corresponding module set being turned off in the second eye template library, 8 consecutive blinks may be mapped to all the smart devices in the corresponding module set being turned on, and when the obtained second eye information is 4 consecutive blinks, all the smart devices in the corresponding infrared module set are turned off according to the search result of the second eye information in the second eye template library, for example, the television, the electric fan, the air conditioner, and the like in the infrared module set are turned off at the same time. For example, the same second eye information may correspond to a plurality of smart devices of the same type in the module set, e.g., 4 consecutive blinks are corresponding to turning on all air conditioners in the module set, etc. A plurality of intelligent equipment can be correspondingly controlled through the same eye information, so that the mobile terminal can remotely control a plurality of intelligent equipment connected with the mobile terminal through one eye information, a plurality of intelligent equipment can be remotely controlled through one main control device, and the operation is simple and rapid.
And the control detection subunit 52B is used for detecting the operating state of the intelligent device.
In this embodiment, the operation state mainly refers to an on or off state of the smart device.
A second control subunit 53B for performing an operation of the opposite operating state in accordance with the detected operating state.
For example, when the control detecting subunit 52B detects that the television is in the on state, the second control subunit 53B correspondingly performs the operation of turning off the television.
Similarly, the execution command of the operation may be automatically sent by the system of the mobile terminal, or may be sent in the form of a pop-up box for the user to select.
As can be seen from the above, the module control device applied to the mobile terminal provided in this embodiment obtains the first eye information of the user according to the obtained module control request, searches for the corresponding module set according to the first eye information, obtains the second eye information of the user, and controls the modules in the module set based on the second eye information, so that the control of the modules can be realized quickly, the operation is simple, and the centralized control of the modules is facilitated. Each module set comprises a plurality of intelligent devices connected with the mobile terminal, operation instructions corresponding to the second eye information are sent to the corresponding intelligent devices in the module set through the mobile terminal, the operation instructions are used for indicating the corresponding intelligent devices in the module set to execute corresponding operations, so that the mobile terminal can remotely control the plurality of intelligent devices connected with the mobile terminal through the second eye information, the plurality of intelligent devices can be remotely controlled through one main control device, and the operation is simple and rapid.
In the above embodiments, the descriptions of the embodiments have respective emphasis, and a part that is not described in detail in a certain embodiment may refer to the above detailed description of the module control method applied to the mobile terminal, and is not described herein again.
The module control device applied to the mobile terminal provided by the embodiment of the present invention is, for example, a tablet computer, a mobile phone with an iris recognition camera, and the like, and the module control device applied to the mobile terminal and the module control method applied to the mobile terminal in the above embodiments belong to the same concept, and any one of the methods provided in the embodiment of the module control method applied to the mobile terminal may be run on the module control device applied to the mobile terminal, and the specific implementation process thereof is described in the embodiment of the module control method applied to the mobile terminal, and is not described herein again.
It should be noted that, for the module control method applied to the mobile terminal of the present invention, it can be understood by a person skilled in the art that all or part of the process of implementing the module control method applied to the mobile terminal of the present invention can be completed by controlling the relevant hardware through a computer program, where the computer program can be stored in a computer readable storage medium, such as a memory of the terminal, and executed by at least one processor in the terminal, and the process of executing the process can include the process of the embodiment of the module control method applied to the mobile terminal. The storage medium may be a magnetic disk, an optical disk, a Read Only Memory (ROM), a Random Access Memory (RAM), or the like.
In the module control device applied to the mobile terminal according to the embodiment of the present invention, each functional module may be integrated in one processing chip, or each module may exist alone physically, or two or more modules may be integrated in one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium, such as a read-only memory, a magnetic or optical disk, or the like.
The above detailed description is provided for a module control method, apparatus and storage medium applied to a mobile terminal according to an embodiment of the present invention, and a specific example is applied in this document to explain the principle and implementation manner of the present invention, and the description of the above embodiment is only used to help understanding the method and core ideas of the present invention; meanwhile, for those skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (15)
1. A module control method applied to a mobile terminal is characterized by comprising the following steps:
acquiring a module control request;
acquiring first eye information of a user according to the module control request;
searching according to the first eye information to obtain a module set corresponding to the first eye information, wherein the module set comprises a plurality of intelligent devices which are connected with the mobile terminal, different first eye information corresponds to different module sets, different module sets comprise a plurality of intelligent devices which are connected with the mobile terminal, and the intelligent devices in different module sets are different;
acquiring second eye information of the user according to the module set;
and controlling the modules in the module set based on the second eye information, wherein an operation instruction corresponding to the second eye information is sent to the corresponding intelligent equipment in the module set through the mobile terminal, and the operation instruction is used for indicating the corresponding intelligent equipment in the module set to execute corresponding operation, so that the mobile terminal remotely controls the plurality of intelligent equipment connected with the mobile terminal through the second eye information.
2. The method according to claim 1, wherein the step of controlling the modules in the module set based on the second eye information specifically comprises:
determining corresponding intelligent equipment and operation instructions in the module set according to the second eye information;
and sending an operation instruction corresponding to the second eye information to the corresponding intelligent equipment in the module set through the mobile terminal, so that the mobile terminal can remotely control the corresponding intelligent equipment in the module set through the operation instruction.
3. The module control method applied to the mobile terminal according to claim 2, wherein the step of determining the corresponding smart device and operation instruction in the module set according to the second eye information comprises:
and searching in a preset instruction database according to the second eye information to acquire the corresponding intelligent equipment and the operation instruction in the module set.
4. The module control method applied to the mobile terminal according to claim 1, wherein the step of controlling the modules in the module set based on the second eye information comprises:
and carrying out opening or closing operation on the corresponding intelligent equipment in the module set based on the second eye information.
5. The module control method applied to the mobile terminal according to claim 4, wherein the step of turning on or off the corresponding smart device in the module set based on the second eye information comprises:
searching according to the second eye information to obtain the corresponding intelligent equipment in the module set;
detecting the running state of the intelligent equipment;
and performing an operation of the opposite operation state according to the detected operation state.
6. The module control method applied to a mobile terminal according to claim 5,
the step of searching according to the first eye information to obtain a corresponding module set specifically includes: searching in a preset first eye template library according to the first eye information to obtain a corresponding module set, wherein the first eye template library is used for storing the corresponding relation between the first eye information and the module set, and each module set comprises a plurality of same or different intelligent devices which are connected with the mobile terminal;
the step of searching according to the second eye information to obtain the corresponding intelligent device in the module set specifically includes: and searching in a preset second eye template library according to the second eye information to obtain one or more corresponding intelligent devices in the module set, wherein the second eye template library is used for storing the corresponding relation between the second eye information and the intelligent devices.
7. The module control method applied to the mobile terminal according to any one of claims 1 to 6, wherein the first eye information and the second eye information each include eye movement information, the module sets are divided according to module types, and the module sets include a radio frequency module set, a Bluetooth module set, and an infrared module set.
8. The module control method applied to a mobile terminal according to any one of claims 1 to 6, wherein the first eye information includes eyeball bio-information, the second eye information includes eyeball motion information, the set of modules is divided according to user modes, and the set of modules includes a main mode module set, a guest mode module set, and a child mode module set.
9. A module control apparatus applied to a mobile terminal, comprising:
a first obtaining unit, configured to obtain a module control request;
the second acquisition unit is used for acquiring the first eye information of the user according to the module control request;
the searching unit is used for searching according to the first eye information to obtain a module set corresponding to the first eye information, wherein the module set comprises a plurality of intelligent devices which are connected with the mobile terminal, different first eye information corresponds to different module sets, different module sets comprise a plurality of intelligent devices which are connected with the mobile terminal, and the intelligent devices in different module sets are different;
the third acquisition unit is used for acquiring second eye information of the user according to the module set;
and the control unit is used for controlling the modules in the module set based on the second eye information, wherein an operation instruction corresponding to the second eye information is sent to the corresponding intelligent equipment in the module set through the mobile terminal, and the operation instruction is used for indicating the corresponding intelligent equipment in the module set to execute corresponding operation, so that the mobile terminal remotely controls the plurality of intelligent equipment connected with the mobile terminal through the second eye information.
10. The module control device applied to the mobile terminal according to claim 9, wherein the control unit specifically comprises:
the first control searching subunit is used for determining the corresponding intelligent equipment and the corresponding operation instruction in the module set according to the second eye information;
and the first control subunit is used for sending the operation instruction corresponding to the second eye information to the corresponding intelligent equipment in the module set through the mobile terminal, so that the mobile terminal can remotely control the corresponding intelligent equipment in the module set through the operation instruction.
11. The module control device applied to the mobile terminal according to claim 10, wherein the first control search subunit is specifically configured to:
and searching in a preset instruction database according to the second eye information to acquire the corresponding intelligent equipment and the operation instruction in the module set.
12. The module control device applied to the mobile terminal according to claim 9, wherein the control unit is specifically configured to:
and carrying out opening or closing operation on the corresponding intelligent equipment in the module set based on the second eye information.
13. The module control device applied to the mobile terminal according to claim 12, wherein the control unit specifically comprises:
the second control searching subunit is used for searching according to the second eye information to obtain the corresponding intelligent equipment in the module set;
the control detection subunit is used for detecting the running state of the intelligent equipment;
and a second control subunit for executing an operation of the opposite operating state in accordance with the detected operating state.
14. The module control apparatus applied to a mobile terminal according to claim 13,
the search unit is specifically configured to: searching in a preset first eye template library according to the first eye information to obtain a corresponding module set, wherein the first eye template library is used for storing the corresponding relation between the first eye information and the module set, and each module set comprises a plurality of same or different intelligent devices which are connected with the mobile terminal;
the second control search subunit is specifically configured to: and searching in a preset second eye template library according to the second eye information to obtain one or more corresponding intelligent devices in the module set, wherein the second eye template library is used for storing the corresponding relation between the second eye information and the intelligent devices.
15. A storage medium having stored thereon a computer program, characterized in that, when the computer program is run on a computer, it causes the computer to execute the method according to any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810214633.0A CN108415572B (en) | 2015-10-28 | 2015-10-28 | Module control method and device applied to mobile terminal and storage medium |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510719574.9A CN105373720B (en) | 2015-10-28 | 2015-10-28 | A kind of module control method and device applied to mobile terminal |
| CN201810214633.0A CN108415572B (en) | 2015-10-28 | 2015-10-28 | Module control method and device applied to mobile terminal and storage medium |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510719574.9A Division CN105373720B (en) | 2015-10-28 | 2015-10-28 | A kind of module control method and device applied to mobile terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108415572A CN108415572A (en) | 2018-08-17 |
| CN108415572B true CN108415572B (en) | 2021-03-02 |
Family
ID=55375911
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510719574.9A Expired - Fee Related CN105373720B (en) | 2015-10-28 | 2015-10-28 | A kind of module control method and device applied to mobile terminal |
| CN201810214633.0A Active CN108415572B (en) | 2015-10-28 | 2015-10-28 | Module control method and device applied to mobile terminal and storage medium |
Family Applications Before (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510719574.9A Expired - Fee Related CN105373720B (en) | 2015-10-28 | 2015-10-28 | A kind of module control method and device applied to mobile terminal |
Country Status (2)
| Country | Link |
|---|---|
| CN (2) | CN105373720B (en) |
| WO (1) | WO2017071349A1 (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105373720B (en) * | 2015-10-28 | 2018-04-20 | 广东欧珀移动通信有限公司 | A kind of module control method and device applied to mobile terminal |
| CN110750226A (en) * | 2019-09-17 | 2020-02-04 | 北京真视通科技股份有限公司 | Central control equipment management method and device, computer equipment and storage medium |
| CN111930234A (en) * | 2020-08-05 | 2020-11-13 | 西安闻泰电子科技有限公司 | Input method and device based on eye control, electronic equipment and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103826000A (en) * | 2012-11-19 | 2014-05-28 | 五甲(大连)计算机系统研发有限公司 | Intelligent household electrical appliance remote control system in which mobile phone is used as pupil encryption recognition terminal |
| CN104766456A (en) * | 2014-01-06 | 2015-07-08 | 上海本星电子科技有限公司 | Intelligent interactive system with portable intelligent device as control center |
| CN104898452A (en) * | 2015-06-26 | 2015-09-09 | 南通理工学院 | Intelligent household control system and intelligent household control method |
Family Cites Families (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7091471B2 (en) * | 2004-03-15 | 2006-08-15 | Agilent Technologies, Inc. | Using eye detection for providing control and power management of electronic devices |
| EP2587342A1 (en) * | 2011-10-28 | 2013-05-01 | Tobii Technology AB | Method and system for user initiated query searches based on gaze data |
| CN102419588B (en) * | 2011-12-28 | 2014-08-13 | 许冰 | Method and device for controlling target based on brain electrical signal and motion signal |
| WO2013134830A1 (en) * | 2012-03-15 | 2013-09-19 | Callander Aaron | System and method for controlling an appliance |
| KR101850035B1 (en) * | 2012-05-02 | 2018-04-20 | 엘지전자 주식회사 | Mobile terminal and control method thereof |
| KR20140013548A (en) * | 2012-07-25 | 2014-02-05 | 삼성전자주식회사 | User terminal apparatus and control method thereof |
| CN103699210A (en) * | 2012-09-27 | 2014-04-02 | 北京三星通信技术研究有限公司 | Mobile terminal and control method thereof |
| WO2015054272A2 (en) * | 2013-10-07 | 2015-04-16 | Google Inc. | Automated crowdsourced power outage identification and staggering of hvac system restarts |
| CN104977904B (en) * | 2014-04-04 | 2018-06-19 | 浙江大学 | A kind of visible i.e. controllable intelligent home control system and control method |
| CN104320688A (en) * | 2014-10-15 | 2015-01-28 | 小米科技有限责任公司 | Video play control method and device |
| CN104866100B (en) * | 2015-05-27 | 2018-11-23 | 京东方科技集团股份有限公司 | Eye control device and its eye prosecutor method and eye control system |
| CN204667054U (en) * | 2015-06-09 | 2015-09-23 | 衢州立诺电子科技有限公司 | A kind of intelligent home control system based on smart mobile phone |
| CN105373720B (en) * | 2015-10-28 | 2018-04-20 | 广东欧珀移动通信有限公司 | A kind of module control method and device applied to mobile terminal |
-
2015
- 2015-10-28 CN CN201510719574.9A patent/CN105373720B/en not_active Expired - Fee Related
- 2015-10-28 CN CN201810214633.0A patent/CN108415572B/en active Active
-
2016
- 2016-07-29 WO PCT/CN2016/092419 patent/WO2017071349A1/en active Application Filing
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103826000A (en) * | 2012-11-19 | 2014-05-28 | 五甲(大连)计算机系统研发有限公司 | Intelligent household electrical appliance remote control system in which mobile phone is used as pupil encryption recognition terminal |
| CN104766456A (en) * | 2014-01-06 | 2015-07-08 | 上海本星电子科技有限公司 | Intelligent interactive system with portable intelligent device as control center |
| CN104898452A (en) * | 2015-06-26 | 2015-09-09 | 南通理工学院 | Intelligent household control system and intelligent household control method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108415572A (en) | 2018-08-17 |
| CN105373720B (en) | 2018-04-20 |
| WO2017071349A1 (en) | 2017-05-04 |
| CN105373720A (en) | 2016-03-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105471705B (en) | Intelligent control method, equipment and system based on instant messaging | |
| CN108447480B (en) | Intelligent household equipment control method, intelligent voice terminal and network equipment | |
| CN107528753B (en) | Intelligent household voice control method, intelligent equipment and device with storage function | |
| CN107135443B (en) | Signal processing method and electronic equipment | |
| CN106406119B (en) | Service robot based on interactive voice, cloud and integrated intelligent Household monitor | |
| CN102779509B (en) | Voice processing equipment and voice processing method | |
| CN103529762B (en) | A kind of intelligent home furnishing control method based on sensor technology and system | |
| CN103295028B (en) | gesture operation control method, device and intelligent display terminal | |
| CN105634881B (en) | Application scene recommendation method and device | |
| EP3792913A1 (en) | Auxiliary speech control method and device and air conditioner | |
| CN108520746A (en) | The method, apparatus and storage medium of voice control smart machine | |
| CN105206275A (en) | Device control method, apparatus and terminal | |
| CN105045140A (en) | Method and device for intelligently controlling controlled equipment | |
| JP2017506772A (en) | Intelligent device scene mode customization method and apparatus | |
| US20170046866A1 (en) | Method and device for presenting operating states | |
| CN104039040A (en) | Control method and device for intelligent lamp | |
| CN105045240A (en) | Household appliance control method and device | |
| CN105049923A (en) | Method and apparatus for waking up electronic device | |
| CN105118257A (en) | Intelligent control system and method | |
| CN204904540U (en) | There is screen intelligent remote controller | |
| CN109032039A (en) | A kind of method and device of voice control | |
| CN108415572B (en) | Module control method and device applied to mobile terminal and storage medium | |
| CN105068722A (en) | Intelligent home environment-oriented man-machine interaction control method | |
| CN112908321A (en) | Device control method, device, storage medium, and electronic apparatus | |
| CN109388238A (en) | The control method and device of a kind of electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Applicant after: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. Address before: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Applicant before: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |