CN112286122A

CN112286122A - Intelligent household control method, device, terminal and storage medium

Info

Publication number: CN112286122A
Application number: CN202011372604.0A
Authority: CN
Inventors: 朱娟
Original assignee: Jiekai Communications Shenzhen Co Ltd
Current assignee: JRD Communication Shenzhen Ltd; Jiekai Communications Shenzhen Co Ltd
Priority date: 2020-11-30
Filing date: 2020-11-30
Publication date: 2021-01-29
Also published as: WO2022110352A1

Abstract

The embodiment of the invention discloses an intelligent home control method, an intelligent home control device, a terminal and a storage medium, wherein when a screen of the terminal is in a screen-off state, if the fact that the terminal establishes communication connection with intelligent home equipment is detected, the air-isolated gesture operation of a user is obtained, a corresponding control instruction is determined according to the air-isolated gesture operation, and the running state of the corresponding intelligent home equipment is controlled based on the control instruction; according to the intelligent home control method provided by the embodiment of the invention, the spaced gesture operation of the user is obtained in the state of the screen, the intelligent home equipment is controlled according to the spaced gesture operation, the screen does not need to be lightened for operation, and the power consumption is saved; the method can overcome the inconvenience that the transmission instruction between the interconnected equipment is generally required to be used for operating on a graphical operation interface, the user can directly control the interconnected equipment through the transmission instruction between the interconnected equipment through the space gesture, convenience is brought to the user, a plurality of intelligent household equipment can be controlled quickly and conveniently, the operation is simple, the learning is easy, and the richness of user operation is expanded.

Description

Intelligent household control method, device, terminal and storage medium

Technical Field

The invention relates to the field of intelligent home, in particular to an intelligent home control method, an intelligent home control device, a terminal and a storage medium.

Background

With the continuous development of communication technology, a great number of mobile terminals such as smart phones, tablet computers and notebook computers are widely popularized and applied, and the terminals are developed towards diversification and individuation, and increasingly become indispensable terminals in life and work of people. Meanwhile, the mobile internet and the internet of things are rapidly developed, various intelligent terminals are more and more, users do not use intelligent devices such as mobile phones, tablets, notebook computers and televisions independently any more, and the devices can be conveniently connected with one another for cooperative operation; for example, the mobile phone can be used for projecting a screen to a television, a user can answer the phone of the mobile phone through the television, and can control a panel or the mobile phone on a computer, the interconnection of multiple devices brings convenience to the life of people, the user can also transmit control equipment through instructions among the interconnection equipment, for example, the interconnection is established between the mobile phone and a home smart home, the user can regulate and control the temperature of an air conditioner or switch the air conditioner according to the self requirement by controlling the mobile phone, and the user can turn on or off lamps at all positions in the home according to the self requirement by controlling the mobile phone.

During the research and practice of the prior art, the inventor of the embodiment of the invention finds that the operation between the interconnected devices is often completed by a user through screen interaction. Taking the above scenario as an example, the user is required to turn on the mobile phone screen first, and then perform a series of operations on the mobile phone to send an instruction to the connected air conditioner or smart lamp for control. Therefore, the operation process is relatively complicated, the operation process is usually carried out by depending on a graphical operation interface of the equipment, and the operation cannot be carried out if the screen is turned off, so that the operation is not convenient enough.

Disclosure of Invention

The embodiment of the invention provides an intelligent home control method, an intelligent home control device, a terminal and a storage medium, which can conveniently and quickly control intelligent home equipment in an air space while saving power consumption.

The embodiment of the invention provides a control method of an intelligent home, which is applied to a terminal and comprises the following steps:

when the screen of the terminal is in a screen-off state, if the fact that the terminal establishes communication connection with the intelligent home equipment is detected, acquiring the spaced gesture operation of a user;

determining a corresponding control instruction according to the air gesture operation;

and controlling the running state of the corresponding intelligent household equipment based on the control instruction.

Correspondingly, an embodiment of the present invention provides an intelligent home control device, where the device includes:

the detection module is used for detecting that the screen of the terminal is in a screen-off state and establishing communication connection between the terminal and the intelligent household equipment;

the acquisition module is used for acquiring the air gesture operation of the user;

the determining module is used for determining a corresponding control instruction according to the operation of the air gesture;

a processing module for controlling the running state of the corresponding smart home device based on the control instruction

Optionally, in some embodiments of the present invention, the determining module is further configured to:

determining corresponding target intelligent household equipment from the plurality of intelligent household equipment according to the first gesture operation;

and determining a corresponding control instruction according to the second gesture operation.

Optionally, in some embodiments of the present invention, the apparatus further includes:

the judging module is used for judging whether the face photo is matched with the sample face photo;

and if so, determining corresponding target intelligent household equipment from the plurality of intelligent household equipment according to the first gesture operation.

Optionally, in some embodiments of the present invention, the obtaining module is further configured to:

the system comprises a first image acquisition module, a second image acquisition module, a first image acquisition module and a second image acquisition module, wherein the first image acquisition module is used for acquiring a first specified shooting number of images to obtain a first image set;

judging whether a picture in the first picture set is matched with a first sample gesture picture;

if a picture in the first picture set is matched with the first sample gesture picture, taking the space gesture operation corresponding to the first sample gesture picture as a first gesture operation, and obtaining a second picture set according to the fact that a second specified shooting number of pictures are obtained within a second preset time length through the shooting element;

the gesture recognition module is used for judging whether any picture in the second picture set is matched with a second sample gesture picture;

and if the pictures in the second picture set are matched with the second sample gesture picture, taking the space gesture operation corresponding to the second sample gesture picture as a second gesture operation.

the identification module is used for identifying the content of each picture in the first picture set;

judging whether each picture in the first picture set has a hand region or not according to the identification result;

and when the hand region is judged to exist, judging whether a picture in the first picture set is matched with the first sample gesture picture.

Optionally, in some embodiments of the present invention, the processing module is further configured to:

generating a gesture signal according to the second infrared light;

judging whether the gesture signal is matched with the sample gesture signal;

and if so, taking the gesture operation corresponding to the sample gesture signal as the air gesture operation.

and performing voice recognition processing on the voice information, and determining target intelligent household equipment corresponding to the voice information from the plurality of intelligent household equipment.

Correspondingly, the embodiment of the invention also provides a terminal, which comprises a processor and a memory, wherein the memory stores a plurality of instructions, and the processor loads the instructions to execute the steps of the intelligent home control method.

In addition, an embodiment of the present invention further provides a storage medium, where a plurality of instructions are stored in the storage medium, and the instructions are suitable for being loaded by a processor to execute the steps in the smart home control method according to any one of the embodiments of the present invention.

The embodiment of the invention provides an intelligent home control method, an intelligent home control device, a terminal and a storage medium, wherein when a screen of the terminal is detected to be in a screen-off state, if the terminal is detected to be in communication connection with intelligent home equipment, the air gesture operation of a user is obtained, then a corresponding control instruction is determined according to the air gesture operation, and then the running state of the intelligent home equipment is controlled based on the control instruction; the embodiment of the invention provides an intelligent home control method, which comprises the steps of firstly, when a screen of a terminal is in a screen-off state, if the fact that the terminal establishes communication connection with intelligent home equipment is detected, obtaining the air gesture operation of a user, controlling the intelligent home equipment in an air-isolated mode according to the air gesture operation, and saving power consumption because the screen does not need to be lightened for operation. Secondly, the inconvenience that the command transmission among the interconnected devices is usually required to be operated on a graphical operation interface can be overcome, and a user can directly transmit the command among the interconnected devices through the air gesture to control the interconnected devices, so that convenience is brought to the user. In addition, the user can define own preference gesture actions, the control mode is various, the flexibility is high, a plurality of intelligent household devices can be controlled quickly and conveniently, the operation is simple and easy to learn, and the richness of user operation is expanded.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1 is an application scene diagram of the smart home control method provided by the embodiment of the invention.

Fig. 2 is a schematic flowchart of a first flow of a smart home control method according to an embodiment of the present invention.

Fig. 3 is a schematic flowchart of a second flow of the smart home control method according to the embodiment of the present invention.

FIG. 4 is a diagram illustrating a first gesture operation provided by an embodiment of the present invention.

Fig. 5 is a schematic diagram of a second gesture operation provided by the embodiment of the invention.

Fig. 6 is a schematic flowchart of a third method for controlling smart home according to an embodiment of the present invention.

Fig. 7 is a fourth flowchart illustrating a smart home control method according to an embodiment of the present invention.

Fig. 8 is a fifth flowchart illustrating a smart home control method according to an embodiment of the present invention. .

Fig. 9 is a sixth flowchart of the smart home control method according to the embodiment of the present invention.

Fig. 10 is a schematic flowchart of a first flow of the smart home control device according to the embodiment of the present invention.

Fig. 11 is a schematic structural diagram of a terminal according to an embodiment of the present invention.

Detailed Description

The technical solution in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. It is to be understood that the described embodiments are merely exemplary of the invention, and not restrictive of the full scope of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

In the description of the present invention, it is to be understood that the terms "first", "second" and the like are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implying any number of technical features indicated. Thus, features defined as "first", "second", may explicitly or implicitly include one or more of the described features. In the description of the present invention, "" means two or more unless specifically defined otherwise.

The following disclosure provides many different embodiments or examples for implementing different features of the invention. To simplify the disclosure of the present invention, the components and arrangements of specific examples are described below. Of course, they are merely examples and are not intended to limit the present invention. Furthermore, the present invention may repeat reference numerals and/or letters in the various examples, such repetition is for the purpose of simplicity and clarity and does not in itself dictate a relationship between the various embodiments and/or configurations discussed. In addition, the present invention provides examples of various specific processes and materials, but one of ordinary skill in the art may recognize applications of other processes and/or uses of other materials. In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.

The embodiment of the invention provides an intelligent home control method, an intelligent home control device, a terminal and a storage medium. The following describes the smart home control method, device, terminal, and storage medium in detail. It should be noted that the following description of the embodiments is not intended to limit the preferred order of the embodiments.

The present invention will be described in detail with reference to the drawings and the detailed description, referring to fig. 1 to 10.

Referring to fig. 1, fig. 1 is a scene schematic diagram of an intelligent home control method according to an embodiment of the present invention. When the fact that communication connection is established between the terminal and the intelligent home equipment and a screen of the terminal is in a screen-off state is detected, acquiring the spaced gesture operation of a user; determining a corresponding control instruction according to the air gesture operation, and sending the control instruction to the intelligent household equipment; and the intelligent household equipment receives the control instruction and responds.

Referring to fig. 2, fig. 2 is a schematic flowchart of an intelligent home control method according to an embodiment of the present invention. The embodiment of the invention comprises the following steps:

101. when the screen of the terminal is in a screen turning state, if the fact that the terminal is in communication connection with the intelligent household equipment is detected, the spaced gesture operation of the user is obtained.

In the embodiment of the present invention, the terminal and the smart home device may establish a communication connection through a communication means, and the terminal and the smart home device may be connected through a wireless fidelity WIFI Network, a bluetooth Network, a ZigBee (ZigBee) Network, a Digital Living Network Alliance (DLNA), and the like, but are not limited thereto.

Specifically, when the operation of the air gesture of the user is obtained, the air gesture can be obtained through a sensing device built in the terminal. For example, the gesture operations of the user in the air including, but not limited to, gestures such as an upward wave in the air, a downward wave in the air, a left shift in the air, a right shift in the air, a downward press in the air, a grasp in the air, a fist in the air, a figure in the air, a V-character gesture or a heart shape in the air can be obtained through a camera element or an infrared sensor element built in the terminal. In addition, the air-break gesture can be acquired by an ultrasonic element built in the terminal.

102. And determining a corresponding control instruction according to the air gesture operation.

In the embodiment of the invention, the terminal can determine the corresponding control instruction according to the operation of the spaced gesture and send the determined control instruction to the intelligent household equipment, and the number of the intelligent household equipment can be one or more.

It should be noted that, by way of example only, the smart home devices include, but are not limited to, smart air conditioners, smart refrigerators, smart sounds, smart doors and windows, smart water heaters, smart curtains, smart computers, smart televisions, and other smart home devices that can establish a communication connection with a terminal.

103. And controlling the running state of the corresponding intelligent household equipment based on the control instruction.

Specifically, the intelligent home equipment receives a control instruction sent by the terminal, the intelligent home equipment controls the running state of the intelligent home equipment based on the control instruction, and the intelligent home equipment receives the control instruction and responds.

For example, when it is determined that the smart home device is an intelligent air conditioner, the embodiment of the present invention specifically has the following four possible implementation manners:

optionally, in a first possible implementation manner, when the blank gesture operation is blank fist, the corresponding control instruction is: closing the current intelligent household equipment, namely closing the intelligent air conditioner, and sending the control instruction to the intelligent household equipment; and the intelligent household equipment receives the control command and responds to the control command, and the intelligent household equipment executes the operation of closing the intelligent air conditioner.

Optionally, in a second possible implementation manner, when the air gesture is operated to be deployed in the air, the corresponding control instruction is: starting the current intelligent household equipment, namely starting an intelligent air conditioner, and sending the control instruction to the intelligent household equipment; and the intelligent household equipment receives the control command and responds to the control command, and the operation of starting the intelligent air conditioner is executed.

Optionally, in a third possible implementation manner, when the air gesture operation is an air ascent, the corresponding control instruction is: increasing the temperature of current intelligent household equipment, namely an intelligent air conditioner, and sending the control instruction to the intelligent household equipment; and the intelligent household equipment receives the control command and responds to the control command, and the intelligent household equipment executes the operation of increasing the temperature of the intelligent air conditioner.

Optionally, in a fourth possible implementation manner, when the air gesture operation is an air downward swing, the corresponding control instruction is: increasing the current intelligent household equipment, namely, reducing the temperature of an intelligent air conditioner, and sending the control instruction to the intelligent household equipment; and the intelligent household equipment receives the control instruction and responds to the control instruction, and the intelligent household equipment executes the operation of reducing the temperature of the intelligent air conditioner.

In summary, an embodiment of the present invention provides an intelligent home control method, where first, when a screen of a terminal is in a screen-saving state, if it is detected that the terminal establishes a communication connection with an intelligent home device, an air-break gesture operation of a user can be obtained, and the intelligent home device is controlled in an air-break manner according to the air-break gesture operation, so that the screen does not need to be lit up for operation, and power consumption is saved. Secondly, the inconvenience that the command transmission among the interconnected devices is usually required to be operated on a graphical operation interface can be overcome, and a user can directly transmit the command among the interconnected devices through the air gesture to control the interconnected devices, so that convenience is brought to the user. In addition, the user can define own preference gesture actions, the control mode is various, the flexibility is high, a plurality of intelligent household devices can be controlled quickly and conveniently, the operation is simple and easy to learn, and the richness of user operation is expanded.

Referring to fig. 3, fig. 3 is a schematic flowchart of an intelligent home control method according to a second embodiment of the present invention. The embodiment of the invention comprises the following steps:

201. when the screen of the terminal is in a screen turning state, if the fact that the terminal is in communication connection with the intelligent household equipment is detected, the spaced gesture operation of the user is obtained.

Specifically, in the embodiment of the present invention, the terminal and the smart home device may establish a communication connection through a communication means, and the terminal and the smart home device may be connected through a wireless fidelity (WIFI) Network, a bluetooth Network, a ZigBee (ZigBee) Network, a Digital Living Network Alliance (DLNA), and the like, but are not limited thereto.

Specifically, in the embodiment of the present invention, an air gesture operation of a user is obtained, and the terminal may obtain the air gesture operation of the user through a shooting element carried by the terminal, where the air gesture operation includes a first gesture and a second gesture, the first gesture operation includes, but is not limited to, a digital gesture, and the second gesture operation includes, but is not limited to, an air up-swing gesture, an air down-swing gesture, an air left-shift gesture, an air right-shift gesture, an air down-press gesture, an air grab gesture, an air fist gesture, an air ratio digit gesture, a gesture V-character gesture, or a heart shape gesture.

202. Acquiring a first appointed shooting number of pictures within a first preset time length through a shooting element to obtain a first picture set, and judging whether any picture in the first picture set is matched with a first sample gesture picture; if yes, go to step 203; if not, go to step 206.

In this embodiment of the present invention, the number of the first sample gesture pictures may be multiple, the shooting element is started, the shooting element obtains a first picture set of a first specified shooting number within a first preset time period, then, it is determined whether there is a picture in the first picture set that matches the first sample gesture picture, and by comparing each picture in the first picture set with each picture of the first sample gesture picture, the following two possible situations exist in this embodiment of the present invention:

if yes, go to step 203;

if not, go to step 207.

203. And taking the first sample gesture picture as a first gesture operation, and determining corresponding target intelligent household equipment from the plurality of intelligent household equipment according to the first gesture operation.

In the embodiment of the invention, the terminal takes the first sample gesture picture as a first gesture operation, and determines the corresponding target smart home equipment from the plurality of smart home equipment according to the first gesture operation. For example, please refer to fig. 4, fig. 4 is a schematic diagram of a first gesture operation, the number of the first gesture pictures may be multiple, the sample gesture pictures include a digital one gesture 301, a digital two gesture 302, and a digital three gesture 303, the smart home device corresponding to the digital one gesture 301 is an intelligent air conditioner, the smart home device corresponding to the digital two gesture 302 is an intelligent television, the smart home device corresponding to the digital three gesture 303 is an intelligent curtain, and other digital gestures correspond to one another according to the above method, which is not described herein again. And if a picture in the first picture set is consistent with a digital gesture 301 in a plurality of first gesture pictures, taking the first gesture picture as a first gesture operation, namely taking the digital gesture 301 as the first gesture operation, and determining that the corresponding intelligent household equipment is an intelligent air conditioner according to the first gesture operation.

204. Obtaining a second picture set by obtaining a second specified number of pictures within a second preset time period through the shooting element, judging whether any picture in the second picture set is matched with a second sample gesture picture, and if so, executing step 205; if not, go to step 207. .

In this embodiment of the present invention, the number of the second sample gesture pictures may be multiple, the shooting element is started, a second picture set is obtained by obtaining a second specified number of pictures shot by the shooting element within a second preset time, then, it is determined whether there is a picture in the second picture set matching the second sample gesture picture, and by comparing each picture in the second picture set with each picture in the second sample gesture picture, the following two possible situations exist in the embodiment of the present invention:

if yes, go to step 205.

If not, go to step 207.

205. And determining a corresponding control instruction according to the second gesture operation, and sending the control instruction to the target intelligent household equipment.

In the embodiment of the invention, the corresponding control instruction is determined according to the second gesture operation, and the control instruction is sent to the target intelligent household equipment.

For example, referring to fig. 5, fig. 5 is a schematic diagram of a second gesture operation, a plurality of second sample gesture pictures include an empty fist 401, an empty spread 402, an empty top wave 403, and an empty bottom wave 404, when the identified second gesture operation is the empty fist 401, a corresponding control instruction is determined according to the empty fist 401 operation, and the control instruction is: closing the current intelligent household equipment, namely closing an air conditioner, and sending the control instruction to the intelligent household equipment; when the identified second gesture operation is the space expansion 402, determining a corresponding control instruction according to the space expansion 402 operation, wherein the control instruction is as follows: starting the current intelligent household equipment, namely starting an air conditioner, and sending the control instruction to the intelligent household equipment; when the identified second gesture operation is the space ascent 403, determining a corresponding control instruction according to the space ascent 403 operation, wherein the control instruction is as follows: increasing the temperature of current intelligent household equipment, namely an air conditioner, and sending the control instruction to the intelligent household equipment; when the identified second gesture operation is the spaced downward swing 404, determining a corresponding control instruction according to the spaced downward swing operation 404, wherein the control instruction is as follows: and (4) reducing the current intelligent household equipment, namely reducing the temperature of an air conditioner, and sending the control instruction to the intelligent household equipment. Other space-isolated gestures can be in one-to-one correspondence according to the above method, and are not described herein.

It should be noted that, by way of example only, the smart home devices include, but are not limited to, smart air conditioners, smart refrigerators, smart sounds, smart doors and windows, smart water heaters, smart curtains, smart computers, smart televisions, and other smart home devices that can establish a communication connection with a terminal. The control instruction corresponding to the air-separating gesture comprises but is not limited to turning on the device, turning off the device, turning up a certain function of the device, turning down a certain function of the device, starting transmission, stopping transmission and the like.

206. And controlling the running state of the corresponding intelligent household equipment based on the control instruction.

In the embodiment of the invention, the intelligent household equipment receives the control instruction sent by the terminal, and controls the running state of the corresponding intelligent household equipment based on the control instruction.

For example, when it is determined that the target smart home device is an intelligent air conditioner, the embodiment of the present invention specifically has the following four possible implementation manners:

207. And finishing the intelligent home control flow.

In summary, an embodiment of the present invention provides an intelligent home control method, which includes, first, when a screen of a terminal is in a screen saver state, if it is detected that the terminal establishes a communication connection with an intelligent home device, acquiring an air gesture operation of a user through a shooting element, determining a target intelligent home device according to the first gesture operation, and controlling the intelligent home device in an air mode according to a second gesture operation without lighting the screen, so as to save power consumption. Secondly, the inconvenience that the command transmission among the interconnected devices is usually required to be operated on a graphical operation interface can be overcome, and a user can directly transmit the command among the interconnected devices through the air gesture to control the interconnected devices, so that convenience is brought to the user. In addition, the user can define own preference gesture actions, the control mode is various, the flexibility is high, a plurality of intelligent household devices can be controlled quickly and conveniently, the operation is simple and easy to learn, and the richness of user operation is expanded.

Referring to fig. 6, fig. 6 is a schematic flowchart of a smart home control method according to a third embodiment of the present invention. The embodiment of the invention comprises the following steps:

501. when the screen of the terminal is in a screen turning state, if the fact that the terminal is in communication connection with the intelligent household equipment is detected, the spaced gesture operation of the user is obtained.

Specifically, in the embodiment of the present invention, an air-spaced gesture operation of a user is obtained, a terminal may obtain the air-spaced gesture operation of the user through a shooting element carried by the terminal, where the air-spaced gesture operation includes a first gesture and a second gesture, the terminal is connected to a plurality of smart home devices, the first gesture operation includes, but is not limited to, a digital gesture, and the second gesture operation includes, but is not limited to, an air-spaced upward swing, an air-spaced downward swing, an air-spaced left shift, an air-spaced right shift, an air-spaced downward press, an air-spaced grab, an air-spaced fist, an air-spaced digit, a gesture V-character or heart-shape, and other gestures, where in the embodiment of the present invention, a corresponding target smart home device is determined from the plurality of smart home devices according to the first gesture operation; and determining a corresponding control instruction according to the second gesture operation.

502. Acquiring a first appointed shooting number of pictures within a first preset time length through the shooting element to obtain a first picture set, and judging whether any picture in the first picture set is matched with a first sample gesture picture; if yes, go to step 503; if not, go to step 508.

Specifically, in this embodiment of the present invention, the number of the first sample gesture pictures may be multiple, the shooting element is started, the shooting element acquires a first picture set of a first specified shooting number within a first preset time duration, then, it is determined whether there is a picture in the first picture set that matches the first sample gesture picture, and by comparing each picture in the first picture set with each picture of the first sample gesture picture, the following two possible situations exist in this embodiment of the present invention:

if yes, go to step 503.

If not, go to step 508.

503. Acquiring a face photo of a current user, judging whether the face photo is matched with the sample face photo, and if so, executing a step 504; if not, go to step 508.

Specifically, when the terminal senses a face through a shooting element (the shooting element can be a camera built in the terminal or a camera external to the terminal) in a screen locking state of the terminal, the terminal is triggered to perform face recognition. The terminal acquires a face picture of a current user through a shooting element to obtain a face picture to be recognized; and matching the face picture to be recognized with a sample face picture pre-recorded in the terminal, and judging whether the face picture is matched with the sample face picture, wherein the specific face recognition process can be realized by referring to the existing face recognition technology, and the details are not repeated here. The following two possible situations exist in the embodiments of the present invention:

if yes, go to step 504.

If not, go to step 508.

504. And taking the first sample gesture picture as a first gesture operation, and determining corresponding target intelligent household equipment from the plurality of intelligent household equipment according to the first gesture operation.

505. Obtaining a second picture set by obtaining a second specified shooting number of pictures within a second preset time length through the shooting element, judging whether any picture in the second picture set is matched with a second sample gesture picture, and if so, executing a step 506; if not, go to step 508.

Specifically, in the embodiment of the present invention, the number of the second sample gesture pictures may be multiple, the shooting element is started, a second picture set is obtained by obtaining a second specified number of pictures shot by the shooting element within a second preset time, then, it is determined whether there is a picture in the second picture set matching with the second sample gesture picture, and by comparing each picture in the second picture set with each picture in the second sample gesture picture, the following two possible situations exist in the embodiment of the present invention:

if yes, go to step 506.

If not, go to step 508.

506. And determining a corresponding control instruction according to the second gesture operation, and sending the control instruction to the target intelligent household equipment.

507. And controlling the running state of the corresponding intelligent household equipment based on the control instruction.

508. And finishing the intelligent home control flow.

In summary, an embodiment of the present invention provides an intelligent home control method, which includes, first, when a screen of a terminal is in a screen saver state, if it is detected that the terminal establishes a communication connection with an intelligent home device, acquiring an air gesture operation of a user through a shooting element, determining a target intelligent home device according to the first gesture operation, and controlling the intelligent home device in an air mode according to a second gesture operation without lighting the screen, so as to save power consumption. Secondly, before the corresponding target intelligent household equipment is determined from the plurality of intelligent household equipment according to the first gesture operation, the identity of the current user is judged, and the permissions of different users for controlling the intelligent household equipment are different, so that the privacy of the user is protected. The embodiment of the invention can overcome the inconvenience that the instruction transmission among the interconnected devices is usually used for operation on the graphical operation interface, and the user can directly transmit the instruction among the interconnected devices through the space gesture to control the interconnected devices, thereby bringing convenience to the user. In addition, the user can define own preference gesture actions, the control mode is various, the flexibility is high, a plurality of intelligent household devices can be controlled quickly and conveniently, the operation is simple and easy to learn, and the richness of user operation is expanded.

Referring to fig. 7, fig. 7 is a schematic flowchart of a smart home control method according to a fourth embodiment of the present invention. The embodiment of the invention comprises the following steps:

601. when the screen of the terminal is in a screen turning state, if the fact that the terminal is in communication connection with the intelligent household equipment is detected, the spaced gesture operation of the user is obtained.

602. Acquiring a first picture set and identifying whether a hand area exists, if so, executing a step 603; if not, 609 is performed.

In the embodiment of the invention, the shooting element is started, the shooting element acquires a first picture set according to a first preset shooting quantity in a first preset time, and content identification is carried out on each picture in the first picture set; judging whether each picture in the first picture set has a hand region according to the recognition result:

if yes, go to step 603;

if not, go to step 609.

603. And judging whether any picture in the first picture set is matched with the first sample gesture picture.

Specifically, in the embodiment of the present invention, the terminal determines whether a picture in the first picture set matches the first gesture picture, and by comparing each picture in the first picture set with each picture in the first gesture picture, the following two possible situations may occur in the embodiment of the present invention:

if yes, go to step 604.

If not, go to step 609.

604. Acquiring a face photo of a current user, judging whether the face photo is matched with the sample face photo, and if so, executing a step 605; if not, go to step 609.

if yes, go to step 605.

If not, go to step 609.

605. And taking the first sample gesture picture as a first gesture operation, and determining corresponding target intelligent household equipment from the plurality of intelligent household equipment according to the first gesture operation.

606. Obtaining a second picture set by the shooting element according to the fact that a second specified shooting quantity of pictures is obtained within a second preset time length, judging whether a picture in the second picture set is matched with a second sample gesture picture, and if yes, executing a step 607; if not, go to step 609.

if yes, go to step 607.

If not, go to step 609.

607. And determining a corresponding control instruction according to the second gesture operation, and sending the control instruction to the target intelligent household equipment.

608. And controlling the running state of the corresponding intelligent household equipment based on the control instruction.

609. And finishing the intelligent home control flow.

In summary, an embodiment of the present invention provides an intelligent home control method, which includes, first, when a screen of a terminal is in a screen saver state, if it is detected that the terminal establishes a communication connection with an intelligent home device, acquiring an air gesture operation of a user through a shooting element, determining a target intelligent home device according to the first gesture operation, and controlling the intelligent home device in an air mode according to a second gesture operation without lighting the screen, so as to save power consumption. Secondly, before the corresponding target intelligent household equipment is determined from the intelligent household equipment according to the first gesture operation, the identity of the current user is judged, whether a hand picture is in the first picture set or not is identified, the control accuracy is ensured, the permission of different users for controlling the intelligent household equipment is different, and the privacy of the user can be protected. The embodiment of the invention can overcome the inconvenience that the instruction transmission among the interconnected devices is usually used for operation on the graphical operation interface, and the user can directly transmit the instruction among the interconnected devices through the space gesture to control the interconnected devices, thereby bringing convenience to the user. In addition, the user can define own preference gesture actions, the control mode is various, the flexibility is high, a plurality of intelligent household devices can be controlled quickly and conveniently, the operation is simple and easy to learn, and the richness of user operation is expanded.

Referring to fig. 8, fig. 8 is a schematic flowchart of a smart home control method according to a fifth embodiment of the present invention. The embodiment of the invention comprises the following steps:

701. when the screen of the terminal is in a screen turning state, if the fact that the terminal is in communication connection with the intelligent household equipment is detected, the spaced gesture operation of the user is obtained.

Specifically, the terminal and the smart home device may establish a communication connection through a communication means, and the terminal and the smart home device may be connected through a wireless fidelity (WIFI) Network, a bluetooth Network, a ZigBee (ZigBee) Network, a Digital Living Network Alliance (DLNA), and the like, but is not limited thereto.

In the embodiment of the invention, a signal transmitter of the infrared sensor element transmits first infrared light to the outside, and a signal receiver of the infrared sensor element receives second infrared light reflected by the first infrared light through an external obstacle. And generating a gesture signal according to the second infrared light.

702. Judging whether the gesture signal is matched with the sample gesture signal, if so, executing a step 703; if not, go to step 706.

In the embodiment of the present invention, the sample gesture signal may be multiple, the sample gesture signal corresponds to an operation gesture, and whether the gesture signal is matched with the sample gesture signal is determined:

if yes, go to step 703;

if not, go to step 706;

703. and taking the gesture operation corresponding to the sample gesture signal as the air gesture operation.

Specifically, the terminal takes the gesture operation corresponding to the sample gesture signal as the air gesture operation. In the embodiment of the invention, the space gesture operation of the user is acquired, and the space gesture operation of the user can be acquired by the terminal through a shooting element carried by the terminal, wherein the space gesture operation comprises but is not limited to space upward waving, space downward waving, space left shifting, space right shifting, space downward pressing, space grabbing, space fist making, space digit comparing, gesture V-shaped or heart-shaped gestures and other gestures.

704. And determining a corresponding control instruction according to the air gesture operation.

705. And controlling the running state of the intelligent household equipment based on the control instruction.

706. And finishing the intelligent home control flow.

In summary, an embodiment of the present invention provides an intelligent home control method, which includes, first, when a screen of a terminal is in a screen-saving state, if it is detected that the terminal establishes a communication connection with an intelligent home device, acquiring an air gesture operation of a user through an infrared sensing element, and controlling the intelligent home device in an air-isolated manner according to the air gesture operation, without lighting the screen for operation, so as to save power consumption. Secondly, the inconvenience that the command transmission among the interconnected devices is usually required to be operated on a graphical operation interface can be overcome, and a user can directly transmit the command among the interconnected devices through the air gesture to control the interconnected devices, so that convenience is brought to the user. In addition, the user can define own preference gesture actions, the control mode is various, the flexibility is high, a plurality of intelligent household devices can be controlled quickly and conveniently, the operation is simple and easy to learn, and the richness of user operation is expanded.

Referring to fig. 9, fig. 9 is a schematic flowchart of a smart home control method according to a sixth embodiment of the present invention. The embodiment of the invention comprises the following steps:

801. when the screen of the terminal is in a screen-off state, if the fact that the terminal is in communication connection with the intelligent household equipment is detected, voice information collected through the voice recognition element is used.

Specifically, in the embodiment of the present invention, the voice information collected by the voice recognition element is used to perform voice recognition processing on the voice information, and a target smart home device corresponding to the voice information is determined from the plurality of smart home devices, for example, if the voice information collected by the voice recognition element is an "smart air conditioner", the target smart home device is determined from the plurality of smart home devices as the "smart air conditioner".

802. And acquiring the air gesture operation of the user.

803. And determining a corresponding control instruction according to the air gesture operation.

804. And controlling the running state of the intelligent household equipment based on the control instruction.

In order to better implement the method, an embodiment of the present invention may further provide an intelligent home control apparatus, where the intelligent home control apparatus may be specifically integrated in a network device, and the network device may be a device such as a mobile terminal.

For example, as shown in fig. 10, the smart home control apparatus may include a detection module 901, an acquisition module 902, a determination module 903, and a processing module 904, as follows:

the detection module 901 is used for detecting that the screen of the terminal is in a screen-off state and for detecting that the terminal and the intelligent home equipment establish communication connection;

an obtaining module 902, configured to obtain an air gesture operation of a user;

a determining module 903, configured to determine a corresponding control instruction according to the operation of the spaced gesture;

a processing module 904, configured to control an optional operation state of the corresponding smart home device based on the control instruction, in some embodiments of the present invention, the determining module 903 is further configured to:

Optionally, in some embodiments of the present invention, the obtaining module 902 is further configured to:

Optionally, in some embodiments of the present invention, the processing module 904 is further configured to:

generating a gesture signal according to the second infrared light;

judging whether the gesture signal is matched with the sample gesture signal;

Optionally, in some embodiments of the present invention, the determining module 903 is further configured to:

The embodiment of the invention discloses an intelligent home control device, which comprises: the method comprises the steps that a detection module detects that when a screen of a terminal is in a screen-off state, the terminal is in communication connection with intelligent household equipment, an acquisition module acquires the air-isolated gesture operation of a user, a determination module determines a corresponding control instruction according to the air-isolated gesture operation, and finally a processing module controls the running state of the corresponding intelligent household equipment based on the control instruction. According to the embodiment of the invention, when the screen of the terminal is in the screen-off state, if the fact that the terminal establishes communication connection with the intelligent household equipment is detected, the air-isolated gesture operation of the user can be obtained, the intelligent household equipment is controlled in an air-isolated mode according to the air-isolated gesture operation, the screen does not need to be lightened for operation, and the power consumption is saved. Secondly, the inconvenience that the command transmission among the interconnected devices is usually required to be operated on a graphical operation interface can be overcome, and a user can directly transmit the command among the interconnected devices through the air gesture to control the interconnected devices, so that convenience is brought to the user. In addition, the user can define own preference gesture actions, the control mode is various, the flexibility is high, a plurality of intelligent household devices can be controlled quickly and conveniently, the operation is simple and easy to learn, and the richness of user operation is expanded.

The terminal in the embodiment of the present invention is described above from the perspective of the modular functional entity, and the terminal in the embodiment of the present invention is described below from the perspective of hardware processing. An embodiment of the present invention further provides a terminal, as shown in fig. 10, which shows a schematic structural diagram of a terminal according to an embodiment of the present invention, where the terminal may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, and the like, and specifically:

as shown in fig. 11, the terminal may include Radio Frequency (RF) circuitry 111, memory 112 including one or more computer-readable storage media, an input unit 113, a display unit 114, a sensor 115, audio circuitry 116, a Wireless Fidelity (Wi-Fi) module 117, a processor 118 including one or more processing cores, and a power supply 119. Those skilled in the art will appreciate that the terminal structure shown in fig. 11 is not intended to be limiting and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components. Wherein:

the RF circuit 111 may be used for receiving and transmitting signals during a message transmission or call, and in particular, for receiving downlink messages from a base station and then processing the received downlink messages by one or more processors 118; in addition, data relating to uplink is transmitted to the base station. In general, the RF circuitry 111 includes, but is not limited to, an antenna, at least one Amplifier, a tuner, one or more oscillators, a Subscriber Identity Module (SIM) card, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, and the like. In addition, the RF circuitry 111 may also communicate with networks and other devices via wireless communications. The wireless communication may use any communication standard or protocol, including but not limited to Global System for Mobile communication (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), email, Short Messaging Service (SMS), and the like.

The memory 112 may be used to store software programs and modules, and the processor 118 executes various functional applications and data processing by executing the software programs and modules stored in the memory 112. The memory 112 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the terminal, etc. Further, the memory 112 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, the memory 112 may also include a memory controller to provide the processor 118 and the input unit 113 access to the memory 112.

The input unit 113 may be used to receive input numeric or character information and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control. In particular, in one particular embodiment, input unit 113 may include a touch-sensitive surface as well as other input devices. The touch-sensitive surface, also referred to as a touch display screen or a touch pad, may collect touch operations by a user (e.g., operations by a user on or near the touch-sensitive surface using a finger, a stylus, or any other suitable object or attachment) thereon or nearby, and drive the corresponding connection device according to a predetermined program. Alternatively, the touch sensitive surface may comprise two parts, a touch detection means and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts it to touch point coordinates, and sends the touch point coordinates to the processor 118, and can receive and execute commands from the processor 118. In addition, touch sensitive surfaces may be implemented using various types of resistive, capacitive, infrared, and surface acoustic waves. The input unit 113 may include other input devices in addition to the touch-sensitive surface. In particular, other input devices may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like.

The display unit 114 may be used to display information input by or provided to the user and various graphical user interfaces of the terminal, which may be made up of graphics, text, icons, video, and any combination thereof. The Display unit 114 may include a Display screen, and optionally, the Display screen may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like. Further, the touch-sensitive surface may overlay the display screen, and when a touch operation is detected on or near the touch-sensitive surface, the touch operation is transmitted to the processor 118 to determine the type of touch event, and then the processor 118 provides a corresponding visual output on the display screen according to the type of touch event.

The terminal may also include at least one sensor 115, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor that adjusts brightness of the display screen according to brightness of ambient light, and a proximity sensor that turns off the display screen and/or backlight when the terminal moves to the ear. As one of the motion sensors, the gravity acceleration sensor can detect the magnitude of acceleration (generally three axes) at each position, can detect the magnitude and position of gravity when the mobile phone is stationary, and can be used for applications of recognizing the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer and tapping) and the like; as for other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which can be configured in the terminal, detailed description is omitted here.

Audio circuitry 116, a speaker, and a microphone may provide an audio interface between the user and the terminal. The audio circuit 116 may transmit the electrical signal converted from the received audio data to a speaker, and convert the electrical signal into a sound signal for output; on the other hand, the microphone converts the collected sound signal into an electric signal, which is received by the audio circuit 116 and converted into audio data, which is then processed by the audio data output processor 118, and then transmitted to, for example, another terminal via the RF circuit 111, or the audio data is output to the memory 112 for further processing. The audio circuitry 116 may also include an earbud jack to provide communication of peripheral headphones with the terminal.

Wi-Fi belongs to short-distance wireless transmission technology, and the terminal can help a user to send and receive e-mails, browse webpages, access streaming media and the like through the Wi-Fi module 117, and provides wireless broadband internet access for the user. Although fig. 11 shows the Wi-Fi module 117, it is understood that it does not belong to the essential constitution of the terminal, and may be omitted entirely as needed within the scope not changing the essence of the invention.

The processor 118 is a control center of the terminal, connects various parts of the entire handset using various interfaces and lines, and performs various functions of the terminal and processes data by operating or executing software programs and/or modules stored in the memory 112 and calling data stored in the memory 112, thereby performing overall monitoring of the handset. Optionally, processor 118 may include one or more processing cores; preferably, the processor 118 may integrate an application processor, which primarily handles operating systems, user interfaces, application programs, etc., and a modem processor, which primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 118.

The terminal also includes a power supply 119 (e.g., a battery) for powering the various components, which may preferably be logically coupled to the processor 118 via a power management system that may be used to manage charging, discharging, and power consumption. The power supply 119 may also include any component of one or more dc or ac power sources, recharging systems, power failure detection circuitry, power converters or inverters, power status indicators, and the like.

Although not shown, the terminal may further include a camera, a bluetooth module, and the like, which will not be described herein. Specifically, in this embodiment, the processor 118 in the terminal loads the executable file corresponding to the process of one or more application programs into the memory 112 according to the following instructions, and the processor 118 runs the application programs stored in the memory 112, thereby implementing various functions.

The electronic equipment provided by the embodiment of the invention can overcome the inconvenience that the instruction transmission among the interconnected equipment is usually used for operation on a graphical operation interface, and a user can directly transmit the instruction among the interconnected equipment through the space gesture to control the interconnected equipment, thereby bringing convenience to the user. In addition, the user can define own preference gesture actions, the control mode is various, the flexibility is high, a plurality of intelligent household devices can be controlled quickly and conveniently, the operation is simple and easy to learn, and the richness of user operation is expanded.

In another aspect, an embodiment of the present invention further provides a storage medium, on which a computer program is stored, where the computer program is implemented to perform the method provided in the foregoing embodiments when executed by a processor, and for example, the method includes: when the screen of the terminal is in a screen-off state, if the fact that the terminal establishes communication connection with the intelligent home equipment is detected, acquiring the spaced gesture operation of a user; determining a corresponding control instruction according to the air gesture operation; controlling the running state of the intelligent household equipment based on the control instruction

In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments. The embodiments described above are only a part of the embodiments of the present invention, and not all of them. Based on the embodiments of the present invention, those skilled in the art can obtain all other embodiments without creative efforts, and the design consistent with the embodiments of the present invention except the design mentioned in the embodiments of the present invention is within the protection scope of the present invention.

The smart home control method, the smart home control device, the smart home control terminal and the storage medium provided by the embodiments of the present invention are described in detail above, and a specific example is applied to illustrate the principle and the implementation manner of the present invention, and the description of the embodiments is only used to help understanding the technical scheme and the core idea of the present invention; those of ordinary skill in the art will understand that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.

Claims

1. A control method of smart home is applied to a terminal, and is characterized by comprising the following steps:

2. The method according to claim 1, wherein a plurality of smart home devices are connected to the terminal, and the spaced gesture operations comprise a first gesture operation and a second gesture operation; the determining of the corresponding control instruction according to the air gesture operation comprises the following steps:

determining a corresponding control instruction according to the second gesture operation;

the controlling the operating state of the intelligent household equipment based on the control instruction comprises the following steps:

and controlling the running state of the target intelligent household equipment based on the corresponding control instruction determined according to the second gesture operation.

3. The method according to claim 2, wherein before determining the corresponding target smart home device from the plurality of smart home devices according to the first gesture operation, further comprising:

acquiring a face photo of a current user;

judging whether the face photo is matched with the sample face photo;

4. A method according to claim 2 or 3, characterized in that the terminal has a camera element; the acquiring of the spaced gesture operation of the user comprises the following steps:

acquiring a first specified shooting quantity of pictures within a first preset time length through the shooting element to obtain a first picture set;

judging whether a picture in the second picture set is matched with a second sample gesture picture;

5. The method of claim 4, wherein before determining whether any picture in the first set of pictures matches the first sample gesture picture, further comprising:

performing content identification on each picture in the first picture set;

and when the hand region is judged to exist, executing judgment to judge whether a picture in the first picture set is matched with the first sample gesture picture.

6. The method of claim 1, wherein the terminal has an infrared sensor element; the acquiring of the spaced gesture operation of the user comprises the following steps:

emitting first infrared light to the outside through a signal emitter of the infrared sensor element, and receiving second infrared light reflected by the first infrared light through an external obstacle through a signal receiver of the infrared sensor element;

generating a gesture signal according to the second infrared light;

judging whether the gesture signal is matched with the sample gesture signal;

7. The method according to claim 1, characterized in that a terminal is provided with a voice recognition element, and a plurality of smart home devices are connected to the terminal; the method further comprises the following steps:

voice information collected by the voice recognition element;

performing voice recognition processing on the voice information, and determining target intelligent home equipment corresponding to the voice information from the plurality of intelligent home equipment;

based on control command control smart home devices's running state includes:

and controlling the target intelligent household equipment corresponding to the voice information based on the control instruction.

8. The utility model provides an intelligence house controlling means which characterized in that includes:

and the processing module is used for controlling the running state of the corresponding intelligent household equipment based on the control instruction.

9. A terminal comprising a memory, a processor and a computer program stored on the memory and running on the processor, wherein the steps of the smart home control method according to any one of claims 1 to 7 are implemented when the processor executes the program.

10. A storage medium characterized in that it comprises instructions which, when run on a computer, cause the computer to perform a method of smart home control according to any one of claims 1-7.