CN107704085B - Detection method, household appliance and storage medium - Google Patents
Detection method, household appliance and storage medium Download PDFInfo
- Publication number
- CN107704085B CN107704085B CN201710979385.4A CN201710979385A CN107704085B CN 107704085 B CN107704085 B CN 107704085B CN 201710979385 A CN201710979385 A CN 201710979385A CN 107704085 B CN107704085 B CN 107704085B
- Authority
- CN
- China
- Prior art keywords
- gesture
- range hood
- image acquisition
- preset
- household appliance
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F24—HEATING; RANGES; VENTILATING
- F24C—DOMESTIC STOVES OR RANGES ; DETAILS OF DOMESTIC STOVES OR RANGES, OF GENERAL APPLICATION
- F24C15/00—Details
- F24C15/20—Removing cooking fumes
- F24C15/2021—Arrangement or mounting of control or safety systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
- G06V40/28—Recognition of hand or arm movements, e.g. recognition of deaf sign language
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Health & Medical Sciences (AREA)
- Combustion & Propulsion (AREA)
- Chemical & Material Sciences (AREA)
- Mechanical Engineering (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Health & Medical Sciences (AREA)
- Psychiatry (AREA)
- Social Psychology (AREA)
- Multimedia (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the invention discloses a detection method, which comprises the following steps: the household appliance detects an operation body by using the image acquisition assembly; the image acquisition assembly is arranged in the household appliance or arranged outside the household appliance and connected with the household appliance; the household appliance can form an image acquisition area by using the image acquisition assembly; after the operation body is determined to be in the target area in the image acquisition area, acquiring gesture operation corresponding to the operation body; recognizing the gesture operation to obtain gesture recognition information; the household appliance can determine a control instruction matched with the gesture recognition information based on the gesture recognition information and respond to the control instruction. The embodiment of the invention also discloses a household appliance and a storage medium.
Description
Technical Field
The invention relates to an information processing technology, in particular to a detection method, a household appliance and a storage medium.
Background
With the development of artificial intelligence technology, the visual perception technology based on the camera is rapidly developed, and some visual perception technologies, such as face recognition, gesture recognition and the like, are applied to various fields, so that how to improve the intelligence of the household appliance by using the visual perception technology becomes a problem to be solved urgently in the household appliance industry.
Disclosure of Invention
In order to solve the existing technical problems, embodiments of the present invention provide a detection method, a home appliance, and a storage medium, which can at least solve the above problems in the prior art.
The technical scheme of the embodiment of the invention is realized as follows:
a first aspect of an embodiment of the present invention provides a detection method, where the method includes:
the household appliance detects an operation body by using the image acquisition assembly; the image acquisition assembly is arranged in the household appliance or arranged outside the household appliance and connected with the household appliance; the household appliance can form an image acquisition area by using the image acquisition assembly;
after the operation body is determined to be in a target area in the image acquisition area, acquiring gesture operation corresponding to the operation body;
recognizing the gesture operation to obtain gesture recognition information; the household appliance can determine a control instruction matched with the gesture recognition information based on the gesture recognition information and respond to the control instruction.
In the foregoing solution, the determining that the operation body is in the target area in the image capturing area includes:
detecting to obtain the position relation between the operation body and the image acquisition assembly;
and determining that the operating body is in a target area in the image acquisition area after at least determining that the distance between the operating body and the image acquisition assembly is within a preset range based on the position relation.
In the foregoing solution, the determining that the operation body is in the target area in the image capturing area includes:
determining that the area of the operation body in the image acquisition area is larger than a preset area based on the position relation, and determining that the operation body is in a target area in the image acquisition area after determining that the distance between the operation body and the image acquisition assembly is within a preset range.
In the above scheme, the method includes:
judging whether the gesture recognition information meets a preset rule or not;
after the preset rule is determined to be met, determining a control instruction matched with the gesture recognition information; the household appliance can respond to the control instruction and execute preset operation corresponding to the control instruction.
In the above scheme, the method further comprises:
determining a target body corresponding to the operation body;
judging whether the target body and the household appliance are in a preset position relation or not;
correspondingly, the recognizing the gesture operation to obtain gesture recognition information includes:
and after the target body and the household appliance are determined to be in the preset position relation, recognizing the gesture operation to obtain gesture recognition information.
In the above scheme, the method further comprises:
acquiring biological characteristic information of the target body;
correspondingly, the judging whether the target body and the household appliance are in a preset position relationship includes:
and after the fact that the biological characteristic information of the target body is matched with preset biological characteristic information is determined, whether the target body and the household appliance are in a preset position relation or not is judged.
In the above scheme, the household appliance is a range hood.
A second aspect of an embodiment of the present invention provides a home appliance, including:
the detection unit is used for detecting the operation body by utilizing the image acquisition assembly; the image acquisition assembly is arranged in the household appliance or arranged outside the household appliance and connected with the household appliance; the household appliance can form an image acquisition area by using the image acquisition assembly; the gesture operation corresponding to the operation body is obtained after the operation body is determined to be in the target area in the image acquisition area;
the processing unit is used for identifying the gesture operation to obtain gesture identification information; the household appliance can determine a control instruction matched with the gesture recognition information based on the gesture recognition information and respond to the control instruction.
In the above scheme, the detection unit is further configured to detect and obtain a position relationship between the operation body and the image acquisition assembly;
correspondingly, the processing unit is further configured to determine that the operating body is in a target area in the image capturing area after at least determining that the distance between the operating body and the image capturing assembly is within a preset range based on the position relationship.
In the foregoing solution, the processing unit is further configured to determine, based on the position relationship, that an area of the operation body located in the image acquisition area is larger than a preset area, and determine that a distance between the operation body and the image acquisition assembly is within a preset range, and then determine that the operation body is located in a target area in the image acquisition area.
In the foregoing solution, the processing unit is further configured to:
judging whether the gesture recognition information meets a preset rule or not;
after the preset rule is determined to be met, determining a control instruction matched with the gesture recognition information; the household appliance can respond to the control instruction and execute preset operation corresponding to the control instruction.
In the above scheme, the detection unit is further configured to determine a target body corresponding to the operation body; in a corresponding manner, the first and second electrodes are,
the processing unit is also used for judging whether the target body and the household appliance are in a preset position relation or not; and after the target body and the household appliance are determined to be in the preset position relation, recognizing the gesture operation to obtain gesture recognition information.
In the foregoing solution, the processing unit is further configured to:
acquiring biological characteristic information of the target body;
and after the fact that the biological characteristic information of the target body is matched with preset biological characteristic information is determined, whether the target body and the household appliance are in a preset position relation or not is judged.
A third aspect of an embodiment of the present invention provides a home appliance, including: a processor and a memory for storing a computer program operable on the processor, wherein the processor is operable to perform the steps of the method when executing the computer program.
A fourth aspect of embodiments of the present invention provides a computer-readable storage medium, on which a computer program is stored, which, when executed by a processor, implements the steps of the method described above.
According to the detection method, the household appliance and the storage medium, the household appliance detects the operation body by using the image acquisition assembly, after the operation body is determined to be located in the target area in the image acquisition area, the gesture operation corresponding to the operation body is obtained, and the gesture operation is identified to obtain gesture identification information; therefore, the household appliance is controlled to determine a control instruction matched with the gesture recognition information based on the gesture recognition information, and the purpose of controlling the household appliance through the gesture is achieved by responding to the control instruction. When the gesture operation is non-contact operation, the method provided by the embodiment of the invention can realize non-contact control on the household appliance, so that the control mode of the existing household appliance is broken through, the control form of the household appliance is changed, and the intellectualization of the household appliance is improved.
Drawings
FIG. 1 is a schematic diagram of a flow chart of a detection method according to an embodiment of the present invention;
FIG. 2 is a schematic structural diagram of a cigarette making machine provided with a camera according to an embodiment of the invention;
FIG. 3 is a schematic diagram illustrating an implementation flow of a detection method in a specific scenario according to an embodiment of the present invention;
FIG. 4 is a schematic illustration of a target area in a specific example of an embodiment of the invention;
fig. 5 is a schematic structural diagram of a household appliance according to an embodiment of the present invention.
Detailed Description
The smoke exhaust ventilator (smoke exhaust ventilator for short) is an important component of modern kitchen, and is a kitchen electrical appliance for purifying kitchen environment, and can quickly exhaust away waste burned by a stove and oil smoke harmful to human body generated in the cooking process, that is, the smoke exhaust ventilator has the main function of exhausting oil smoke and burned waste in the cooking process. Inherits the control mode of traditional household appliances, the existing cigarette making machine usually adopts key control, for example, the cigarette making machine is controlled by a switch key, such as turning on, turning off, or adjusting air volume, or controlling the starting or turning off of a lamp arranged in the cigarette making machine. However, the existing contact control mode for the cigarette machine has the following problems:
first, because the cigarette machine is in the oil smoke environment for a long time, the button that sets up on the cigarette machine inevitable is stained with the oil smoke, consequently, can influence the outward appearance of cigarette machine, and in addition, on being stained with the oil smoke on the cigarette machine also is stained with user's finger easily, reduced user experience.
Second, during the culinary art, food may have been handled to user's finger, and at this moment, if must can be infected with the cigarette machine with the material that is infected with in the finger through button control cigarette machine, increased the clean degree of difficulty of cigarette machine, influenced the outward appearance, can influence the life of cigarette machine even.
Therefore, in order to solve the above problems, embodiments of the present invention provide a detection method, a home appliance, and a storage medium. So that the manner in which the features and aspects of the present invention can be understood in detail, a more particular description of the invention, briefly summarized above, may be had by reference to embodiments, some of which are illustrated in the appended drawings.
Example one
The embodiment provides a detection method, which is applied to household appliances; here, the household appliance may be any household appliance such as a range hood, a refrigerator, an air conditioner, and the like, and in practical application, the present embodiment does not limit the specific category of the household appliance. Further, the embodiment of the present invention is described in detail by taking a household electrical appliance as a cigarette making machine as an example, fig. 1 is a schematic flow chart of an implementation of the detection method of the embodiment of the present invention, and as shown in fig. 1, the method includes:
step 101: the household appliance detects an operation body by using the image acquisition assembly; the image acquisition assembly is arranged in the household appliance or arranged outside the household appliance and connected with the household appliance; the household appliance can form an image acquisition area by using the image acquisition assembly;
in this embodiment, the image capturing component may specifically be a camera, and in practical applications, the camera may specifically be disposed in the household appliance, or disposed outside the household appliance, and connected to the household appliance, so that the household appliance can utilize its own setting, or perform image capturing with its own connected camera. For example, as shown in fig. 2, the camera is disposed in the range hood, for example, embedded in the range hood, and forms an image acquisition area on the range hood, at this time, when the range hood is in a preset position relationship with the cooking range, for example, when the cooking range is down, the range hood is up, and the two are in a corresponding position relationship, the image acquisition area is located above the cooking range, so that the hand movement of the user (i.e., the gesture operation described in this embodiment) can be conveniently acquired by using the image acquisition area, and then the hand movement is recognized, thereby laying a foundation for implementing non-contact control of the range hood. Of course, in practical application, the image acquisition region can be the rotation type, so, be convenient for carry out image acquisition to domestic appliance present environment on the multi-space dimension, and then promote gesture operation's collection scope, establish the basis for promoting user experience, richening user experience.
Certainly, in practical applications, the camera may also be non-embedded, and in this case, the camera may be directly disposed on the household appliance and may rotate. It should be noted that, in practical application, the image capturing assembly may be specifically set according to actual requirements, which is not limited in this embodiment.
In a specific embodiment, the gesture operation is a non-contact operation for the home appliance, for example, the gesture operation is a non-contact gesture operation that is within a preset range from a specific position on the home appliance and can be detected by the home appliance. Here, the specific location may be specifically an area corresponding to the camera as shown in fig. 2.
Further, in order to avoid misoperation, reduce the false trigger rate and improve the operation experience of a user, a target area can be preset in advance, wherein the target area is at least a partial area corresponding to the image acquisition area, and thus, after the operation body is determined to be in the target area, the household appliance obtains the gesture operation corresponding to the operation body; correspondingly, if the operation body is not located in the target area, even if the household appliance detects the operation body, the gesture operation of the operation body does not need to be acquired, and a foundation is laid for reducing the misoperation rate and improving the user experience.
Step 102: after the operation body is determined to be in a target area in the image acquisition area, acquiring gesture operation corresponding to the operation body;
step 103: recognizing the gesture operation to obtain gesture recognition information; the household appliance can determine a control instruction matched with the gesture recognition information based on the gesture recognition information and respond to the control instruction.
That is, in a specific example, after the control instruction is determined, the household appliance responds to the control execution and executes the preset operation corresponding to the control instruction. In practical applications, the preset operation may be turning on or turning off of the household appliance, or adjusting an air volume (relative to a range hood and an air conditioner), or controlling a lamp provided in the household appliance to be turned on or off, and the like. Of course, the relationship may not be a one-to-one correspondence, and in practical application, the setting may be arbitrarily set according to actual requirements, which is not limited in this embodiment.
In a specific example, after the household appliance detects a gesture operation, the gesture operation may be recognized to obtain gesture recognition information; further, in order to avoid misoperation, the household appliance further judges whether the gesture recognition information meets a preset rule, determines that the preset rule is met, and then determines a control instruction matched with the gesture recognition information, so that the household appliance responds to the control instruction and executes a preset operation corresponding to the control instruction. That is to say, only after the gesture recognition information meets the preset rule, the control instruction corresponding to the gesture recognition information is determined, otherwise, the gesture recognition information is shielded, so that misoperation is further avoided, meanwhile, a foundation is laid for reducing the false triggering rate and improving the user control experience.
Here, the determining whether the gesture recognition information satisfies a preset rule may specifically be: and judging whether the gesture recognition information is matched with preset gesture information or not, and further determining whether the gesture recognition information meets a preset rule or not based on a matching result. For example, when the gesture recognition information is matched with preset gesture information, it indicates that the gesture recognition information satisfies a preset rule, otherwise, it indicates that the gesture recognition information does not satisfy the preset rule.
In another specific example, after the household appliance detects a gesture operation on an operation body, a target body corresponding to the operation body is determined, whether the target body and the household appliance are in a preset position relationship is judged, and correspondingly, after the target body and the household appliance are determined to be in the preset position relationship, the gesture operation is recognized, so that gesture recognition information is obtained. That is to say, in this scheme, only when the target body with domestic appliance is in predetermine the position relation, just right gesture operation discerns, and then judges whether gesture recognition information that gesture recognition obtained satisfies and predetermines the rule, so, has further avoided the maloperation, also further has laid a foundation for promoting user experience.
Further, in another specific example, after the target body corresponding to the operation body is determined, the home appliance obtains biometric information of the target body, for example, biometric information (such as human face features) of the target body is acquired by using an image acquisition component, and then after it is determined that the biometric information of the target body matches preset biometric information, it is determined whether the target body and the home appliance are in a preset positional relationship. Therefore, the household appliance can only recognize the gesture operation of a specific user, and the user experience is further enriched.
In this way, according to the method provided by the embodiment of the invention, the household appliance detects the operation body by using the image acquisition assembly, after the operation body is determined to be located in the target area in the image acquisition area, the gesture operation corresponding to the operation body is obtained, and the gesture operation is identified to obtain gesture identification information; therefore, the household appliance is controlled to determine a control instruction matched with the gesture recognition information based on the gesture recognition information, and the purpose of controlling the household appliance through the gesture is achieved by responding to the control instruction. When the gesture operation is non-contact operation, the method provided by the embodiment of the invention can realize non-contact control on the household appliance, so that the control mode of the existing household appliance is broken through, the control form of the household appliance is changed, and the intellectualization of the household appliance is improved.
Example two
Based on the method described in the first embodiment, this embodiment provides a specific implementation manner of determining whether an operation body is located in a target area, specifically, the home appliance detects a positional relationship between the operation body and the image capturing assembly, and further determines that at least a distance between the operation body and the image capturing assembly is within a preset range based on the positional relationship, and then determines that the operation body is located in the target area in the image capturing area, that is, when it is determined that the distance between the operation body and the image capturing assembly is within the preset range, the operation body is considered to be located in the target area in the image capturing area, otherwise, the operation body is considered not to be located in the target area in the image capturing area.
Further, in a specific example, the determining that the operation body is in the target area in the image capturing area specifically includes: determining that the area of the operation body in the image acquisition area is larger than a preset area based on the position relation, and determining that the operation body is in a target area in the image acquisition area after determining that the distance between the operation body and the image acquisition assembly is within a preset range. For example, it is determined that the area of the palm of the user in the image capturing region is larger than a preset area, and the distance between the palm and the image capturing assembly is within a preset range, at this time, the operating body is considered to be in the target region in the image capturing region, otherwise, the operating body is considered not to be in the target region in the image capturing region.
The embodiment of the present invention is further described in detail below with reference to specific scenarios, and specifically, as shown in fig. 3, the steps of controlling the cigarette making machine by gestures are as follows: the camera that sets up in the cigarette machine gathers the gesture action, for example, gathers hand picture information to hand picture information transmission to the gesture module that will acquire, the gesture module is right hand picture information detects, discerns, determines the control command that corresponds with this hand picture information, transmits this control command to automatically controlled module, automatically controlled module receives control command and processing are carried out with the control cigarette machine control command, for example, control switch cigarette machine, or switch lamp, or adjust the amount of wind etc..
Here, automatically controlled module and gesture module also all set up in the processing unit of cigarette machine, wherein, the gesture module is used for carrying out gesture recognition to determine with the control command that gesture operation corresponds, automatically controlled module is used for based on this control command control cigarette machine carries out the operation of predetermineeing that corresponds with this control command, so, realizes the non-contact control of cigarette machine. Certainly, in practical applications, the gesture module may be only used to recognize a gesture operation, and the matching process between the gesture operation and the control instruction may be implemented by the electronic control module, that is, the functions of the gesture module and the control module given above in this embodiment are only exemplary, and are used to explain the embodiment of the present invention, but not to limit the embodiment of the present invention.
For example, a typical cigarette machine mainly includes three functions, which are: the cigarette machine is switched on and off, the lamp is switched on and off, and the air volume is adjusted, so that three gestures can be defined, the gestures correspond to functions, and of course, in practical application, specific gestures can be added and deleted according to the functions. Further, in practical application, the gesture definition is adapted to the use habit of the user, and is simple and unambiguous in principle, so that the learning cost of the user is low, and the gesture operation is convenient for the user. The gestures shown in the following table may be employed to control the range hood to perform specific functions.
In one example, in order to reduce the false triggering rate and improve the user's manipulation experience, the logic of controlling the cigarette making machine by gesture recognition is as follows:
firstly, switching on and off a range hood; here, in order to simplify the gesture, the same gesture can be used for opening and closing the cigarette machine, and in addition, the palm opening comprises the meaning of waiting for the opposite party to give in daily life, so the gesture of opening the five fingers is used for controlling the opening and closing of the cigarette machine, and the user can learn and remember the gesture conveniently. Specifically, the gesture control logic for starting the cigarette making machine comprises the following steps:
the five fingers are opened, and the palm is placed in the target area, wherein as shown in fig. 4, the target area can be a cube area with the side length of 30cm covered by a cone with the camera as the vertex, and the distance from the cube area (i.e. the target area) to the camera is 15cm to 45cm, so that the palm of the user can be considered to be located in the target area after being placed in the cube area; further, the staying time of the palm in the target area is detected, for example, more than 3 seconds, the gesture that the five fingers are opened is considered to be a valid gesture, the gesture that the five fingers are opened is recognized, and the cigarette making machine is started.
Here, in practical application, before determining whether to respond to the gesture, the area occupied by the palm in the target area may be further detected, and if the occupied area is larger than a preset area, the staying time of the palm in the target area is further determined, so as to determine whether the gesture of opening the five fingers is an effective gesture, that is, only after determining that the gesture of opening the five fingers is an effective gesture, the cigarette making machine responds to the gesture of opening the five fingers to open the cigarette making machine, otherwise, the gesture of opening the five fingers is shielded. Of course, the step of detecting the area of the palm in the target region and the staying time of the palm in the target region may be executed synchronously or asynchronously, and the execution sequence of the two steps is not limited in this embodiment.
Further, the gesture control logic for closing the cigarette machine is as follows: when the cigarette machine is in an open state, the five fingers are opened, the palm is placed in a target area (namely a cube area) as shown in fig. 4, the staying time of the palm in the target area is detected, for example, more than 3 seconds, the gesture of the opened five fingers is considered to be an effective gesture, the gesture of the opened five fingers is recognized, and the cigarette machine is closed.
In practical application, before the cigarette making machine is determined to be turned off, objective conditions corresponding to the environment where the cigarette making machine is located can be detected, such as whether a cooking range is turned off or not, and therefore the condition that a user mistakenly triggers the turning off of the cigarette making machine in the cooking process is avoided. For example, the household appliance detects the environmental characteristics (smoke concentration and the like) of the household appliance, and determines whether to respond to the control instruction (for example, determine whether to respond to an instruction for turning off the range hood or the like) according to the environmental characteristics.
Here, similar to the step of turning on the cigarette machine, the area occupied by the palm in the target area can be detected before determining whether the gesture is responded, so as to determine whether the gesture is a valid gesture.
Secondly, turning on and off the lamp; here, two gestures, such as a fist making (i.e., fist) and a thumb extending (a scraping gesture), may be used to control the turning on and off of the light; specifically, the control logic for turning on the light includes:
and (3) extending the thumb, placing the palm in the target area, further, detecting the staying time of the palm in the target area, for example, more than 2 seconds, regarding the gesture of extending the thumb as a valid gesture, recognizing the gesture of extending the thumb, and turning on the light source.
Further, the gesture control logic for turning off the light source is as follows:
and (4) making a fist, placing the palm in a target area, detecting the retention time of the palm in the target area, for example, exceeding 2 seconds, considering the gesture of the fist as an effective gesture, identifying the gesture of the fist, and turning off a light source.
Here, similar to the step of switching on and off the cigarette machine, the area occupied by the palm in the target area can be detected before determining whether the gesture is responded, so as to determine whether the gesture is a valid gesture.
Thirdly, adjusting air volume; here, suppose that the range hood has two wind volumes, namely a small wind volume and a large wind volume, at this time, the logic of gesture control is as follows:
the control logic for reducing the air volume comprises the following steps: and stretching out the index finger, placing the palm in the target area, further, detecting the staying time of the palm in the target area, for example, exceeding 2 seconds, regarding the gesture stretching out the index finger as a valid gesture, recognizing the gesture stretching out the index finger, and turning down the air volume (or turning on the small air volume, or adjusting the air volume from the large air volume to the small air volume).
The control logic for increasing the air volume comprises the following steps: and (3) extending the index finger and the middle finger, placing the palm in the target area, further detecting the staying time of the palm in the target area, for example, exceeding 2 seconds, regarding the gesture extending the index finger and the middle finger as a valid gesture, recognizing the gesture extending the index finger and the middle finger, and increasing the air volume (or opening the large air volume, or adjusting the air volume from the small air volume to the large air volume).
Here, similar to the step of switching on and off the cigarette machine, the area occupied by the palm in the target area can be detected before determining whether the gesture is responded, so as to determine whether the gesture is a valid gesture.
In this embodiment, the image capturing component may support RGB (2D), or support RGB-D (3D); moreover, the image acquisition assembly supports various angle perception information (namely, image acquisition can be carried out on multiple spatial dimensions), such as image acquisition on a stove corresponding to the range hood from top to bottom, or image acquisition on the environment where the range hood is located in the horizontal direction, and the like; further, the method of the embodiment can simultaneously support gesture recognition and biometric feature recognition, such as face recognition, and thus the non-contact control process is cooperatively completed through the gesture recognition and the biometric feature recognition.
Therefore, the embodiment of the invention can control the cigarette machine through a simple gesture without contacting a cigarette machine entity, solves the defects of the existing cigarette machine control, simultaneously improves the intelligence of the cigarette machine, enriches the user experience and also improves the user experience.
EXAMPLE III
The present embodiment provides a home appliance, as shown in fig. 5, including:
a detection unit 51 for detecting an operation body with the image pickup assembly; the image acquisition assembly is arranged in the household appliance or arranged outside the household appliance and connected with the household appliance; the household appliance can form an image acquisition area by using the image acquisition assembly; the gesture operation corresponding to the operation body is obtained after the operation body is determined to be located in the target area in the image acquisition area;
the processing unit 52 is configured to recognize the gesture operation to obtain gesture recognition information; the household appliance can determine a control instruction matched with the gesture recognition information based on the gesture recognition information and respond to the control instruction.
In a specific embodiment, the detecting unit 51 is further configured to detect and obtain a position relationship between the operating body and the image capturing assembly;
correspondingly, the processing unit 52 is further configured to determine that the operation body is in a target area in the image capturing area after at least determining that the distance between the operation body and the image capturing assembly is within a preset range based on the position relationship.
In another specific embodiment, the processing unit 52 is further configured to determine, based on the position relationship, that an area of the operation body located in the image capturing area is larger than a preset area, and determine that the distance between the operation body and the image capturing assembly is within a preset range, and then determine that the operation body is located in a target area in the image capturing area.
In another specific embodiment, the processing unit 52 is further configured to:
judging whether the gesture recognition information meets a preset rule or not;
after the preset rule is determined to be met, determining a control instruction matched with the gesture recognition information; the household appliance can respond to the control instruction and execute preset operation corresponding to the control instruction.
In another specific embodiment, the detecting unit 51 is further configured to determine a target body corresponding to the operating body; in a corresponding manner, the first and second electrodes are,
the processing unit 52 is further configured to determine whether the target body and the household appliance are in a preset position relationship; and after the target body and the household appliance are determined to be in the preset position relation, recognizing the gesture operation to obtain gesture recognition information.
In another specific embodiment, the processing unit 52 is further configured to:
acquiring biological characteristic information of the target body;
and after the fact that the biological characteristic information of the target body is matched with preset biological characteristic information is determined, whether the target body and the household appliance are in a preset position relation or not is judged.
The present embodiment also provides a household appliance, including: a processor and a memory for storing a computer program operable on the processor, wherein the processor is operable to perform the following steps when executing the computer program:
the household appliance detects an operation body by using the image acquisition assembly; the image acquisition assembly is arranged in the household appliance or arranged outside the household appliance and connected with the household appliance; the household appliance can form an image acquisition area by using the image acquisition assembly;
after the operation body is determined to be in a target area in the image acquisition area, acquiring gesture operation corresponding to the operation body;
recognizing the gesture operation to obtain gesture recognition information; the household appliance can determine a control instruction matched with the gesture recognition information based on the gesture recognition information and respond to the control instruction.
In a specific example, the determining that the operation body is in the target area in the image acquisition area includes:
detecting to obtain the position relation between the operation body and the image acquisition assembly;
and determining that the operating body is in a target area in the image acquisition area after at least determining that the distance between the operating body and the image acquisition assembly is within a preset range based on the position relation.
In another specific example, the determining that the operation body is in the target area in the image acquisition area includes:
determining that the area of the operation body in the image acquisition area is larger than a preset area based on the position relation, and determining that the operation body is in a target area in the image acquisition area after determining that the distance between the operation body and the image acquisition assembly is within a preset range.
In another specific example, the following steps are also performed:
judging whether the gesture recognition information meets a preset rule or not;
after the preset rule is determined to be met, determining a control instruction matched with the gesture recognition information; the household appliance can respond to the control instruction and execute preset operation corresponding to the control instruction.
In another specific example, the following steps are also performed:
determining a target body corresponding to the operation body;
judging whether the target body and the household appliance are in a preset position relation or not;
correspondingly, the recognizing the gesture operation to obtain gesture recognition information includes:
and after the target body and the household appliance are determined to be in the preset position relation, recognizing the gesture operation to obtain gesture recognition information.
In another specific example, the following steps are also performed:
acquiring biological characteristic information of the target body;
correspondingly, the judging whether the target body and the household appliance are in a preset position relationship includes:
and after the fact that the biological characteristic information of the target body is matched with preset biological characteristic information is determined, whether the target body and the household appliance are in a preset position relation or not is judged.
In another particular example, the household appliance is a range hood.
Here, it should be noted that: the above description of the embodiment of the household appliance is similar to the above description of the embodiment of the method, and has similar beneficial effects to the embodiment of the method, and therefore, the description is omitted. For technical details that are not disclosed in the embodiment of the household appliance of the present invention, please refer to the description of the embodiment of the method of the present invention for understanding, and therefore, for brevity, will not be described again.
The present embodiments also provide a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of:
the household appliance detects an operation body by using the image acquisition assembly; the image acquisition assembly is arranged in the household appliance or arranged outside the household appliance and connected with the household appliance; the household appliance can form an image acquisition area by using the image acquisition assembly;
after the operation body is determined to be in a target area in the image acquisition area, acquiring gesture operation corresponding to the operation body;
recognizing the gesture operation to obtain gesture recognition information; the household appliance can determine a control instruction matched with the gesture recognition information based on the gesture recognition information and respond to the control instruction.
In a specific example, the determining that the operation body is in the target area in the image acquisition area includes:
detecting to obtain the position relation between the operation body and the image acquisition assembly;
and determining that the operating body is in a target area in the image acquisition area after at least determining that the distance between the operating body and the image acquisition assembly is within a preset range based on the position relation.
In another specific example, the determining that the operation body is in the target area in the image acquisition area includes:
determining that the area of the operation body in the image acquisition area is larger than a preset area based on the position relation, and determining that the operation body is in a target area in the image acquisition area after determining that the distance between the operation body and the image acquisition assembly is within a preset range.
In another specific example, the following steps are also implemented:
judging whether the gesture recognition information meets a preset rule or not;
after the preset rule is determined to be met, determining a control instruction matched with the gesture recognition information; the household appliance can respond to the control instruction and execute preset operation corresponding to the control instruction.
In another specific example, the following steps are also implemented:
determining a target body corresponding to the operation body;
judging whether the target body and the household appliance are in a preset position relation or not;
correspondingly, the recognizing the gesture operation to obtain gesture recognition information includes:
and after the target body and the household appliance are determined to be in the preset position relation, recognizing the gesture operation to obtain gesture recognition information.
In another specific example, the following steps are also implemented:
acquiring biological characteristic information of the target body;
correspondingly, the judging whether the target body and the household appliance are in a preset position relationship includes:
and after the fact that the biological characteristic information of the target body is matched with preset biological characteristic information is determined, whether the target body and the household appliance are in a preset position relation or not is judged.
In another particular example, the household appliance is a range hood.
In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above-described device embodiments are merely illustrative, for example, the division of the unit is only a logical functional division, and there may be other division ways in actual implementation, such as: multiple units or components may be combined, or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the coupling, direct coupling or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection between the devices or units may be electrical, mechanical or other forms.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed on a plurality of network units; some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, all the functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may be separately regarded as one unit, or two or more units may be integrated into one unit; the integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.
Those of ordinary skill in the art will understand that: all or part of the steps for implementing the method embodiments may be implemented by hardware related to program instructions, and the program may be stored in a computer readable storage medium, and when executed, the program performs the steps including the method embodiments; and the aforementioned storage medium includes: various media that can store program codes, such as a removable Memory device, a Read Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
Alternatively, the integrated unit of the present invention may be stored in a computer-readable storage medium if it is implemented in the form of a software functional module and sold or used as a separate product. Based on such understanding, the technical solutions of the embodiments of the present invention may be essentially implemented or a part contributing to the prior art may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the methods described in the embodiments of the present invention. And the aforementioned storage medium includes: a removable storage device, a ROM, a RAM, a magnetic or optical disk, or various other media that can store program code.
The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and all the changes or substitutions should be covered within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (13)
1. A method of detection, the method comprising:
the range hood detects an operation body by using the image acquisition assembly; the image acquisition assembly is arranged in the range hood or a stove connected with the range hood; the range hood can form an image acquisition area by using the image acquisition assembly;
detecting to obtain the position relation between the operation body and the image acquisition assembly;
determining that the area of the operation body in the image acquisition area is larger than a preset area based on the position relation, and determining that the distance between the operation body and the image acquisition assembly is within a preset range, and then acquiring gesture operation corresponding to the operation body;
determining whether the gesture is an effective gesture according to the staying time of the operation body in the target area, and identifying the gesture operation to obtain gesture identification information; the range hood can determine a control instruction matched with the gesture recognition information based on the gesture recognition information under the condition that the gesture is an effective gesture, and respond to the control instruction;
before responding to the control command, the range hood detects the environmental characteristics of the range hood and determines whether to respond to the control command according to the detected environmental characteristics.
2. The method of claim 1, wherein the operating body is a palm; the gesture includes any one of: fist making, five fingers opening, one finger and two fingers.
3. The method according to claim 1, characterized in that it comprises:
judging whether the gesture recognition information meets a preset rule or not;
after the preset rule is determined to be met, determining a control instruction matched with the gesture recognition information; and the range hood can respond to the control instruction and execute preset operation corresponding to the control instruction.
4. The method of claim 1, further comprising:
determining a target body corresponding to the operation body;
judging whether the target body and the range hood are in a preset position relation or not;
correspondingly, the recognizing the gesture operation to obtain gesture recognition information includes:
and after the target body and the range hood are in the preset position relation, recognizing the gesture operation to obtain gesture recognition information.
5. The method of claim 4, further comprising:
acquiring biological characteristic information of the target body;
correspondingly, the judging whether the target body and the range hood are in a preset position relation or not comprises the following steps:
and after the fact that the biological characteristic information of the target body is matched with the preset biological characteristic information is determined, whether the target body and the range hood are in the preset position relation or not is judged.
6. A method according to claim 1, wherein the range hood is a range hood.
7. A range hood, comprising:
the detection unit is used for detecting the operation body by utilizing the image acquisition assembly; the image acquisition assembly is arranged in the range hood or a cooking range connected with the range hood; the range hood can form an image acquisition area by using the image acquisition assembly;
the detection unit is also used for detecting and obtaining the position relation between the operation body and the image acquisition assembly;
the processing unit is used for determining that the area of the operation body in the image acquisition area is larger than a preset area based on the position relation, and acquiring gesture operation corresponding to the operation body after determining that the distance between the operation body and the image acquisition assembly is within a preset range;
the processing unit is further used for determining whether the gesture is an effective gesture according to the staying time of the operation body in the target area, and recognizing the gesture operation to obtain gesture recognition information; the range hood can determine a control instruction matched with the gesture recognition information based on the gesture recognition information under the condition that the gesture is an effective gesture, and respond to the control instruction;
the processing unit is further used for detecting the environmental characteristics of the range hood before responding to the control instruction, and determining whether to respond to the control instruction according to the detected environmental characteristics.
8. The range hood according to claim 7, wherein the operating body is a palm; the gesture includes any one of: fist making, five fingers opening, one finger and two fingers.
9. The range hood of claim 7, wherein the processing unit is further configured to:
judging whether the gesture recognition information meets a preset rule or not;
after the preset rule is determined to be met, determining a control instruction matched with the gesture recognition information; and the range hood can respond to the control instruction and execute preset operation corresponding to the control instruction.
10. The range hood according to claim 7, wherein the detection unit is further configured to determine a target body corresponding to the operation body; in a corresponding manner, the first and second electrodes are,
the processing unit is also used for judging whether the target body and the range hood are in a preset position relation or not; and after the target body and the range hood are determined to be in the preset position relation, recognizing the gesture operation to obtain gesture recognition information.
11. The range hood of claim 10, wherein the processing unit is further configured to:
acquiring biological characteristic information of the target body;
and after the fact that the biological characteristic information of the target body is matched with the preset biological characteristic information is determined, whether the target body and the range hood are in the preset position relation or not is judged.
12. A range hood, comprising: a processor and a memory for storing a computer program operable on the processor, wherein the processor is operable to perform the steps of the method of any of claims 1 to 6 when the computer program is executed.
13. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710979385.4A CN107704085B (en) | 2017-10-19 | 2017-10-19 | Detection method, household appliance and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710979385.4A CN107704085B (en) | 2017-10-19 | 2017-10-19 | Detection method, household appliance and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107704085A CN107704085A (en) | 2018-02-16 |
| CN107704085B true CN107704085B (en) | 2022-06-14 |
Family
ID=61181856
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710979385.4A Active CN107704085B (en) | 2017-10-19 | 2017-10-19 | Detection method, household appliance and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107704085B (en) |
Families Citing this family (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108443927A (en) * | 2018-04-28 | 2018-08-24 | 深圳市赛亿科技开发有限公司 | A kind of intelligent fume exhauster |
| CN108758731A (en) * | 2018-04-28 | 2018-11-06 | 深圳市赛亿科技开发有限公司 | A kind of control method and system of intelligent fume exhauster |
| CN108888224A (en) * | 2018-05-23 | 2018-11-27 | 佛山市顺德区美的洗涤电器制造有限公司 | Control method, device and the computer readable storage medium of dish-washing machine |
| CN108924417A (en) * | 2018-07-02 | 2018-11-30 | Oppo（重庆）智能科技有限公司 | Filming control method and Related product |
| CN109028211A (en) * | 2018-09-27 | 2018-12-18 | 成都前锋电子有限责任公司 | A kind of hidden smoke exhaust ventilator convenient for manipulation |
| CN109028218A (en) * | 2018-09-27 | 2018-12-18 | 成都前锋电子有限责任公司 | A kind of conserving kitchen oil smoke pumping Lift-on/Lift-off System convenient for manipulation |
| CN109028223B (en) * | 2018-09-29 | 2023-10-03 | 佛山市云米电器科技有限公司 | Range hood with gesture control visual detection function and range hood concentration detection method |
| CN109948488A (en) * | 2019-03-08 | 2019-06-28 | 上海达显智能科技有限公司 | A kind of intelligence smoke eliminating equipment and its control method |
| CN109993139B (en) * | 2019-04-09 | 2020-12-01 | 东莞市飞音电子有限公司 | Gesture recognition method, gesture recognition device and equipment |
| CN110321001A (en) * | 2019-05-09 | 2019-10-11 | 江苏紫米软件技术有限公司 | A kind of wireless charging bracket and face tracking methods |
| CN113050434A (en) * | 2019-12-26 | 2021-06-29 | 佛山市云米电器科技有限公司 | Household appliance control method, household appliance and computer readable storage medium |
| CN111306714A (en) * | 2020-03-03 | 2020-06-19 | 青岛海尔空调器有限总公司 | Air conditioner and control method thereof |
| CN111306715A (en) * | 2020-03-03 | 2020-06-19 | 青岛海尔空调器有限总公司 | Air conditioner and control method thereof |
| CN112270302A (en) * | 2020-11-17 | 2021-01-26 | 支付宝(杭州)信息技术有限公司 | Limb control method and device and electronic equipment |
| CN112684887A (en) * | 2020-12-28 | 2021-04-20 | 展讯通信（上海）有限公司 | Application device and air gesture recognition method thereof |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104566591A (en) * | 2015-01-09 | 2015-04-29 | 广东海信家电有限公司 | Non-contact control method of extractor hood |
| CN106249899A (en) * | 2016-08-15 | 2016-12-21 | 珠海格力电器股份有限公司 | A kind of gesture recognition system, electrical equipment and control method thereof |
| CN106383452A (en) * | 2016-11-24 | 2017-02-08 | 北京地平线机器人技术研发有限公司 | Smart control module and kitchen appliances employing same |
| WO2017026961A1 (en) * | 2015-08-10 | 2017-02-16 | Arcelik Anonim Sirketi | A household appliance controlled by using a virtual interface |
| CN107120701A (en) * | 2017-05-04 | 2017-09-01 | 广东万家乐燃气具有限公司 | A kind of range hood with human body intelligent identification function and gesture operation |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104063041B (en) * | 2013-03-21 | 2018-02-27 | 联想(北京)有限公司 | A kind of information processing method and electronic equipment |
| CN103345232B (en) * | 2013-07-15 | 2016-08-17 | 盐城市智敏信息科技有限公司 | Individualized intelligent appliance control method and system |
-
2017
- 2017-10-19 CN CN201710979385.4A patent/CN107704085B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104566591A (en) * | 2015-01-09 | 2015-04-29 | 广东海信家电有限公司 | Non-contact control method of extractor hood |
| WO2017026961A1 (en) * | 2015-08-10 | 2017-02-16 | Arcelik Anonim Sirketi | A household appliance controlled by using a virtual interface |
| CN106249899A (en) * | 2016-08-15 | 2016-12-21 | 珠海格力电器股份有限公司 | A kind of gesture recognition system, electrical equipment and control method thereof |
| CN106383452A (en) * | 2016-11-24 | 2017-02-08 | 北京地平线机器人技术研发有限公司 | Smart control module and kitchen appliances employing same |
| CN107120701A (en) * | 2017-05-04 | 2017-09-01 | 广东万家乐燃气具有限公司 | A kind of range hood with human body intelligent identification function and gesture operation |
Non-Patent Citations (1)
| Title |
|---|
| 三星智能电视手势遥控技术专利分析;李熙等;《电视技术》;20130717(第14期);82-84 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107704085A (en) | 2018-02-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107704085B (en) | Detection method, household appliance and storage medium | |
| CN107422859B (en) | Gesture-based regulation and control method and device, computer-readable storage medium and air conditioner | |
| CN105159590B (en) | The method and user terminal of a kind of screen of control user terminal | |
| CN109074819A (en) | Preferred control method based on operation-sound multi-mode command and the electronic equipment using it | |
| US20160116891A1 (en) | Method and device for operating a household appliance and household appliance | |
| WO2020181570A1 (en) | Intelligent smoke removal device and control method thereof | |
| CN107085380B (en) | Intelligent household system user position judgment method and electronic equipment | |
| CN108196714B (en) | Electronic equipment | |
| CN104898996B (en) | Information processing method and electronic equipment | |
| CN104216516B (en) | A kind of terminal | |
| CN108108117B (en) | Screen capturing method and device and terminal | |
| US20140078040A1 (en) | Dual-mode remote control method | |
| CN103076968A (en) | Operation control method for touch terminal and touch terminal thereof | |
| CN107765573A (en) | Control method and household electrical appliance, the storage medium of a kind of household electrical appliance | |
| CN106297049B (en) | False touch prevention method based on contact number detection and intelligent express cabinet thereof | |
| CN110895934A (en) | Household appliance control method and device | |
| CN107015879A (en) | Unlocked by fingerprint method and device | |
| CN106642267A (en) | Automatic control method and device for range hood | |
| CN105426091A (en) | Method and terminal for controlling black screen gesture processing | |
| CN110413186A (en) | A kind of control method of household electrical appliance, device, household electrical appliance and computer readable storage medium | |
| CN106845189A (en) | A kind of method and apparatus being unlocked based on fingerprint recognition | |
| CN105517280B (en) | A kind of method and apparatus being illuminated | |
| CN107830559A (en) | Control method and household electrical appliance, the storage medium of a kind of household electrical appliance | |
| CN114016260A (en) | Airing machine sensing distance setting method and system, airing machine and storage medium | |
| US10185400B2 (en) | Gesture control device with fingertip identification |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |