CN112327645A - Control method and device for household appliance and household appliance - Google Patents
Control method and device for household appliance and household appliance Download PDFInfo
- Publication number
- CN112327645A CN112327645A CN202011212504.1A CN202011212504A CN112327645A CN 112327645 A CN112327645 A CN 112327645A CN 202011212504 A CN202011212504 A CN 202011212504A CN 112327645 A CN112327645 A CN 112327645A
- Authority
- CN
- China
- Prior art keywords
- image
- user
- gesture
- household appliance
- thermal imaging
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 51
- 238000001931 thermography Methods 0.000 claims abstract description 56
- 230000036760 body temperature Effects 0.000 claims description 6
- 238000005457 optimization Methods 0.000 claims description 4
- 230000037237 body shape Effects 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 13
- 238000004891 communication Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 6
- 238000004590 computer program Methods 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000001514 detection method Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 230000002265 prevention Effects 0.000 description 2
- 238000005057 refrigeration Methods 0.000 description 2
- 238000012216 screening Methods 0.000 description 2
- 238000013475 authorization Methods 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 238000001816 cooling Methods 0.000 description 1
- 238000013480 data collection Methods 0.000 description 1
- 238000007791 dehumidification Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 201000010099 disease Diseases 0.000 description 1
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000001815 facial effect Effects 0.000 description 1
- 238000010438 heat treatment Methods 0.000 description 1
- 238000003062 neural network model Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000001052 transient effect Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 238000005406 washing Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B15/00—Systems controlled by a computer
- G05B15/02—Systems controlled by a computer electric
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS], computer integrated manufacturing [CIM]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/20—Pc systems
- G05B2219/26—Pc applications
- G05B2219/2642—Domotique, domestic, home control, automation, smart house
Abstract
The application relates to the technical field of intelligent household appliance control, and discloses a control method for household appliance equipment. By acquiring a thermal imaging image of an acquisition area associated with the home appliance device, an order user within the acquisition area can be determined. The target gesture information is determined according to the pre-stored gesture model and the command gesture image of the command user, so that the household appliance can operate according to the control instruction associated with the target gesture information, the household appliance can be controlled through the gesture image acquired through thermal imaging, a more convenient household appliance control mode can be provided for the user, and the problem that the household appliance cannot be controlled when a remote controller cannot be found is solved. In addition, the control gesture of the user is determined through thermal imaging, so that the leakage of privacy information such as the face of the user is prevented, and the use safety of the device is improved. The application also discloses a control device for the household appliance and the household appliance.
Description
Technical Field
The present application relates to the field of home appliance control technologies, and for example, to a method and an apparatus for controlling a home appliance, and a home appliance.
Background
Since the invention of the air conditioner, no matter the air conditioner is a wall-mounted type, a cabinet type or another type, remote control is always dedicated to be carried out through a remote controller, the occurrence of the remote controller undoubtedly brings great convenience to users, and the users can press keys on the remote controller to remotely control the air conditioner to complete corresponding functions. However, as the number of home appliances increases, the number of remote controllers increases, how to quickly find a remote controller corresponding to a home appliance to be controlled from a plurality of remote controllers, and how to use the home appliance when a user cannot find the remote controller, are technical problems that need to be solved.
Disclosure of Invention
The following presents a simplified summary in order to provide a basic understanding of some aspects of the disclosed embodiments. This summary is not an extensive overview nor is intended to identify key/critical elements or to delineate the scope of such embodiments but rather as a prelude to the more detailed description that is presented later.
The embodiment of the disclosure provides a control method and device for household appliances and the household appliances, so as to solve the technical problem of how to use the household appliances when a user cannot find a remote controller.
In some embodiments, the method comprises: acquiring a thermal imaging image in an acquisition area associated with the household appliance, and determining an order user; determining a command gesture image of an order-giving user from the thermographic image; determining target gesture information corresponding to the command gesture image according to a pre-stored gesture model; and obtaining a control instruction associated with the target gesture information, and controlling the household appliance.
In some embodiments, the apparatus comprises: the system comprises a thermal imaging image acquisition module, a command processing module and a command processing module, wherein the thermal imaging image acquisition module is configured to acquire a thermal imaging image in an acquisition area associated with the household appliance and determine a command user; a command gesture image determination module configured to determine a command gesture image of an order-giving user from the thermographic image; the target gesture information determining module is configured to determine target gesture information corresponding to the command gesture image according to a pre-stored gesture model; and the control instruction acquisition module is configured to acquire a control instruction associated with the target gesture information and control the household appliance.
In some embodiments, the apparatus comprises: a processor and a memory storing program instructions, the processor being configured to perform the aforementioned control method for a home appliance when executing said program instructions.
In some embodiments, the home device comprises: the control device for the household appliance is described above.
The control method and device for the household appliance and the household appliance provided by the embodiment of the disclosure can achieve the following technical effects: the order applying user in the acquisition area can be determined by acquiring the thermal imaging image of the acquisition area associated with the household appliance, and then the target gesture information is determined according to the pre-stored gesture model and the command gesture image of the order applying user, so that the household appliance can operate according to the control instruction associated with the target gesture information. The scheme that the home appliance is controlled through the gesture image acquired through thermal imaging can provide a more convenient home appliance control mode for a user, and the problem that the home appliance cannot be controlled when a remote controller cannot be found is solved. In addition, the control gesture of the user is determined through thermal imaging, so that the leakage of privacy information such as the face of the user is prevented, and the use safety of the device is improved.
The foregoing general description and the following description are exemplary and explanatory only and are not restrictive of the application.
Drawings
One or more embodiments are illustrated by way of example in the accompanying drawings, which correspond to the accompanying drawings and not in limitation thereof, in which elements having the same reference numeral designations are shown as like elements and not in limitation thereof, and wherein:
fig. 1 is a schematic diagram of a control method for a home appliance according to an embodiment of the present disclosure;
FIG. 2 is a schematic diagram of a method for determining an order user provided by an embodiment of the present disclosure;
fig. 3 is a schematic diagram of a control apparatus for a home appliance according to an embodiment of the present disclosure;
fig. 4 is a schematic diagram of another control device for a home appliance according to an embodiment of the present disclosure.
Detailed Description
So that the manner in which the features and elements of the disclosed embodiments can be understood in detail, a more particular description of the disclosed embodiments, briefly summarized above, may be had by reference to the embodiments, some of which are illustrated in the appended drawings. In the following description of the technology, for purposes of explanation, numerous details are set forth in order to provide a thorough understanding of the disclosed embodiments. However, one or more embodiments may be practiced without these details. In other instances, well-known structures and devices may be shown in simplified form in order to simplify the drawing.
The terms "first," "second," and the like in the description and in the claims, and the above-described drawings of embodiments of the present disclosure, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It should be understood that the data so used may be interchanged under appropriate circumstances such that embodiments of the present disclosure described herein may be made. Furthermore, the terms "comprising" and "having," as well as any variations thereof, are intended to cover non-exclusive inclusions.
The term "plurality" means two or more unless otherwise specified.
In the embodiment of the present disclosure, the character "/" indicates that the preceding and following objects are in an or relationship. For example, A/B represents: a or B.
The term "and/or" is an associative relationship that describes objects, meaning that three relationships may exist. For example, a and/or B, represents: a or B, or A and B.
Fig. 1 is a schematic diagram of a control method for a home appliance according to an embodiment of the present disclosure, and in conjunction with fig. 1, the embodiment of the present disclosure provides a control method for controlling a home appliance, including:
and S11, acquiring the thermal imaging image in the acquisition area associated with the household appliance, and determining the order user.
And S12, determining a command gesture image for the user from the thermal imaging image.
And S13, determining target gesture information corresponding to the command gesture image according to the pre-stored gesture model.
And S14, obtaining a control instruction associated with the target gesture information, and controlling the household appliance.
The household appliance in the embodiment of the present disclosure may be a mobile device, a computer, an intelligent home device, or the like, or any combination thereof. In some embodiments, the smart home devices may include, for example, air conditioners, refrigerators, televisions, washing machines, and the like, or any combination thereof.
In step S11, the order user within the acquisition area may be determined by acquiring a thermographic image of the acquisition area associated with the home device. In the thermal imaging, infrared heat is detected in a non-contact manner and converted into an electric signal, so that a thermal image and a temperature value are generated. The thermal imaging image is obtained through a thermal imaging module of the household appliance or is obtained through a thermal imaging detection device connected with the household appliance body. The collection area associated with the household appliance can be an area within the collection range of the thermal imaging module of the household appliance; alternatively, the home appliance device may be divided into other areas in advance, and it is understood that the other areas are located within the acquisition range of the thermal imaging module or the thermal imaging detection device. The specific setting of the acquisition area can be preset in advance according to the needs of a user. For example, the household appliance is an air conditioner placed in a kitchen, and the associated collection area may be preset as an area within the collection range of the air conditioner; alternatively, if the areas such as the bedroom, the living room and the like are provided with thermal imaging detection devices, the acquisition areas of thermal imaging can be determined in the areas, namely, the user can control the operation of the air conditioner placed in the kitchen at the positions such as the bedroom, the living room and the like.
The household appliance equipment identifies the order applying user after acquiring the thermal imaging image, the order applying user can be effectively distinguished through the temperature information, a real person and a dummy are distinguished, the identification error caused by the figure image in the associated acquisition area is avoided, and the accuracy of identity confirmation is improved. In addition, because the acquisition process of the thermal imaging image has no requirement on indoor light, compared with a scheme of acquiring user gestures through a camera, the scheme provided by the embodiment of the disclosure can not be implemented indoors with darker light, and the scheme provided by the embodiment of the disclosure has higher universality.
In step S12, after determining the order-giving user, the hand area of the order-giving user may be determined in the thermographic image of the order-giving user, thereby determining the command gesture image of the order-giving user. The area in the thermal imaging image, which is the same as the shape of the human hand, can be determined as a hand area, and a command gesture image is extracted from the hand area. For example, when the home appliance is an air conditioner, the command gesture image may be a cooling command gesture image, a heating command gesture image, a temperature adjustment command gesture image, or a dehumidification command gesture image.
In step S13, after the command gesture image is determined, target gesture information corresponding to the determined command gesture image can be acquired according to a pre-stored gesture model. The pre-stored gesture model comprises a plurality of command gesture images and gesture information corresponding to the command gesture images, the pre-stored gesture model reduces the precision requirement of the household appliance processor and provides an accurate and convenient data base for gesture recognition.
In step S14, by obtaining the control instruction associated with the target gesture information, the home appliance performs a control operation corresponding to the gesture information according to the control instruction, so as to provide a more convenient home appliance control method for the user. The use of the user is convenient.
By adopting the control method for the household electrical appliance provided by the embodiment of the disclosure, the order user can be identified through the thermal imaging image, and the facial information of the user is prevented from being exposed while the identification precision is improved. When the user cannot find the remote controller, the household appliance is controlled through the collected thermal imaging gesture image, and a more convenient household appliance control mode is provided for the user.
Optionally, after determining the order user, the method further includes: and when the gesture of the order-giving user meets a preset awakening condition, determining a command gesture image of the order-giving user.
After the order applying user is determined, whether the gesture of the order applying user meets the awakening condition is judged. The satisfying of the wake-up condition may include at least the following three cases: the gesture of the order applying user is a wake-up gesture, the gesture keeping time of the order applying user is preset duration, the gesture of the order applying user is a wake-up gesture, and the gesture keeping time of the order applying user is preset duration. And when any one of the three situations occurs, determining that a preset awakening condition of gesture recognition is met. After the wake-up condition is met, the household appliance can carry out voice reminding on the user so that the user can know that the household appliance enters the wake-up mode. And further acquiring a command gesture image of the order-giving user from the thermal imaging image. By judging whether the gesture of the order-giving user meets the preset awakening condition or not, the condition that the gesture recognition is triggered by the household appliance in advance due to misoperation of the user can be effectively avoided. Operation events not intended by the user are avoided. The accuracy of the command gesture image is ensured, and the accuracy of gesture recognition is improved.
Optionally, after controlling the home appliance, the method further includes: and if a new thermal imaging image is acquired and a control instruction for stopping control is obtained according to the command gesture image determined from the new thermal imaging image, stopping controlling the household appliance.
After the household appliance is controlled, whether a new thermal imaging image is acquired or not is determined, and whether other command intentions exist for the user is judged. And under the condition that a new thermal imaging image is acquired, determining a command gesture image of the command user, and judging whether the command gesture image is gesture information for stopping control or not by identifying the command gesture image of the command user. And if the command gesture image is gesture information for stopping control, acquiring a control instruction associated with the gesture information to stop gesture control on the household appliance. For example, the control of the home appliance may be stopped in the following manner. In a first mode of operation, when the device receives a control command to stop controlling, the control of the home device is stopped by stopping the acquisition of the thermographic image of the associated area. In a second operation mode, when the device receives a control instruction for stopping control, gesture recognition is not performed on the thermal imaging image in the acquisition area associated with the home appliance, and the home appliance can also be stopped from being controlled. Through recognizing the gesture image for stopping control, the control operation of the equipment, which is not intended by the user, due to error acquisition and error recognition can be effectively avoided, the control accuracy is improved, and the integrity of the control process is ensured.
Optionally, determining the order enforcement user comprises:
and S21, marking the image area satisfying the preset human body temperature in the thermal imaging image.
And S22, determining the command user according to the image area and the preset human body shape image.
Fig. 2 is a schematic diagram of a method for determining an order user according to an embodiment of the present disclosure, and in conjunction with fig. 2, in step 21, an image area with a temperature meeting a preset body temperature is marked. For example, the preset body temperature is set to 35.5-39.5 ℃, and in the acquired thermal imaging, the region with the temperature of 35.5-39.5 ℃ is marked to obtain the region corresponding to the preset body temperature.
In step 22, it is determined whether the aforementioned marked image area satisfies the shape of the human body, and in the case of satisfying the shape of the human body, the image area is determined as the giving user.
Through carrying out temperature and human body shape screening to thermal imaging image, can ensure that the region after the screening is for executing the order user, avoid mistake acquisition region in portrait poster or portrait picture, prevent the portrait acquisition failure because of article and human body temperature unanimity cause, guaranteed the accuracy of data collection, provide accurate data basis for gesture recognition.
Optionally, after the pre-stored gesture model is obtained, performing model optimization on the pre-stored gesture model according to the command gesture image.
Specifically, the acquired thermal imaging image sample may be input into a neural network model for training, so as to obtain a pre-stored gesture model. As can be seen, the pre-stored gesture model is determined from the thermal imaging image samples. However, in the actual use process, the deviation may occur between the gesture image of the user and the thermal imaging image sample, which easily causes the gesture recognition result to be inaccurate. In view of the above, the embodiment of the present disclosure provides a scheme for performing model optimization on a pre-stored gesture model according to command gesture images of different command users. According to the scheme, one or more command gesture images of the order giving user can be obtained and used as a sample for model optimization, a new gesture model with higher recognition accuracy for the order giving user is obtained, and a more convenient household appliance control mode is provided for the user based on the new gesture model.
Optionally, after determining the order-giving user, the method further includes: determining the body surface temperature of a command user through a thermal imaging image; and controlling the household appliance according to the control instruction and the body surface temperature.
Under the condition that the household electrical appliance is an air conditioner, after a thermal imaging image is obtained, the body surface temperature of a user is determined through the thermal imaging image, the appropriate environment temperature corresponding to the body surface temperature is determined according to the body surface temperature of the current user, and therefore a control instruction corresponding to the environment temperature is obtained to control the air conditioner to adjust the temperature to the appropriate environment temperature. Therefore, the body surface temperature of the user is used as a reference parameter for temperature control, the household appliance can provide a more comfortable environment for the user according to the body surface temperature change, and a personalized household appliance control mode is provided for the user.
Optionally, the method further includes determining a body surface temperature of the order user through the thermal imaging image, and performing early warning when the body surface temperature exceeds a preset temperature value.
The body surface temperature of the order user is obtained, and whether the body surface temperature of the order user exceeds a preset temperature value or not is judged, so that the body surface temperature of the order user is monitored. When the body surface temperature of the user exceeds the preset temperature value, the user is reminded that the current body surface temperature is too high, and effective treatment is carried out in time. In addition, under the condition of obtaining the user authorization, the body surface temperature of the user can be uploaded to the cloud or other departments. For example, the epidemic prevention department or the community temperature monitoring department where the user is located enables the epidemic prevention department or the community temperature monitoring department to use the uploaded temperature data to count the number of the users with over-high temperature in the jurisdiction range, help the disease control center to detect the epidemic situation in real time, and ensure the accuracy of big data statistics.
In practical application, when the controlled household appliance is an air conditioner, a thermal imaging image of a collection area of the air conditioner is acquired. A user performing control of the air conditioner is determined in the acquired thermal imaging image. And judging whether the gesture of the user meets the preset awakening gesture and lasts for 2 seconds, and sending a voice notification to the user when the gesture meets the preset awakening gesture and lasts for 2 seconds so that the user knows that the controlled household appliance is awakened. And then acquiring a command gesture image of the user after the user keeps the command gesture for 1 second. And determining target gesture information corresponding to the command gesture image through a pre-stored gesture model so as to identify the target control intention of the current user. And when the target gesture information of the current user is identified to adjust the operation mode to the refrigeration mode, obtaining a control instruction associated with the target gesture information and controlling the air conditioner so as to control the air conditioner to adjust the operation mode to the refrigeration mode and finish controlling the air conditioner.
Fig. 3 is a schematic diagram of a control apparatus for a home appliance according to an embodiment of the present disclosure, and in combination with fig. 3, the control apparatus for a home appliance according to an embodiment of the present disclosure includes a thermal imaging image obtaining module 31, a command gesture image determining module 32, a target gesture information determining module 33, and a control instruction obtaining module 34. The thermal imaging image acquisition module 31 is configured to acquire a thermal imaging image within an acquisition area associated with the home appliance device and determine an order user; command gesture image determination module 32 is configured to determine a command gesture image of the exercising user from the thermographic image; the target gesture information determination module 33 is configured to determine target gesture information corresponding to the command gesture image according to a pre-stored gesture model; the control instruction obtaining module 34 is configured to obtain a control instruction associated with the target gesture information, and control the home appliance.
By adopting the control device for the household electrical appliance provided by the embodiment of the disclosure, the face information of a user can be prevented from being exposed while the identification precision is improved. When the user cannot find the remote controller, the household appliance is controlled through the collected thermal imaging gesture image. Simultaneously, the household electrical appliances control mode that this scheme was protected also can carry out corresponding control to household electrical appliances under the environment of dark, has solved the puzzlement that current control mode can't discern under the environment of dark, provides more convenient household electrical appliances control mode for the user.
Fig. 4 is a schematic diagram of another control device for a home appliance according to an embodiment of the present disclosure. As shown in fig. 4, an embodiment of the present disclosure provides a control apparatus for an electric home appliance, which includes a processor (processor)100 and a memory (memory) 101. Optionally, the apparatus may also include a Communication Interface (Communication Interface)102 and a bus 103. The processor 100, the communication interface 102, and the memory 101 may communicate with each other via a bus 103. The communication interface 102 may be used for information transfer. The processor 100 may call the logic instructions in the memory 101 to perform the control method for the electric home appliance of the above-described embodiment.
In addition, the logic instructions in the memory 101 may be implemented in the form of software functional units and stored in a computer readable storage medium when the logic instructions are sold or used as independent products.
The memory 101, which is a computer-readable storage medium, may be used for storing software programs, computer-executable programs, such as program instructions/modules corresponding to the methods in the embodiments of the present disclosure. The processor 100 executes functional applications and data processing by executing program instructions/modules stored in the memory 101, that is, implements the method for the home device in the above-described embodiments.
The memory 101 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to the use of the terminal device, and the like. In addition, the memory 101 may include a high-speed random access memory, and may also include a nonvolatile memory.
The embodiment of the disclosure provides a product (such as a computer, a mobile phone and the like) comprising the control device for the household appliance.
The disclosed embodiments provide a computer-readable storage medium storing computer-executable instructions configured to perform the above-described control method for a home appliance.
The disclosed embodiments provide a computer program product comprising a computer program stored on a computer readable storage medium, the computer program comprising program instructions which, when executed by a computer, cause the computer to perform the above-described control method for an electric home appliance.
The computer-readable storage medium described above may be a transitory computer-readable storage medium or a non-transitory computer-readable storage medium.
The technical solution of the embodiments of the present disclosure may be embodied in the form of a software product, where the computer software product is stored in a storage medium and includes one or more instructions to enable a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method of the embodiments of the present disclosure. And the aforementioned storage medium may be a non-transitory storage medium comprising: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes, and may also be a transient storage medium.
The above description and drawings sufficiently illustrate embodiments of the disclosure to enable those skilled in the art to practice them. Other embodiments may incorporate structural, logical, electrical, process, and other changes. The examples merely typify possible variations. Individual components and functions are optional unless explicitly required, and the sequence of operations may vary. Portions and features of some embodiments may be included in or substituted for those of others. Furthermore, the words used in the specification are words of description only and are not intended to limit the claims. As used in the description of the embodiments and the claims, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. Similarly, the term "and/or" as used in this application is meant to encompass any and all possible combinations of one or more of the associated listed. Furthermore, the terms "comprises" and/or "comprising," when used in this application, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. Without further limitation, an element defined by the phrase "comprising an …" does not exclude the presence of other like elements in a process, method or apparatus that comprises the element. In this document, each embodiment may be described with emphasis on differences from other embodiments, and the same and similar parts between the respective embodiments may be referred to each other. For methods, products, etc. of the embodiment disclosures, reference may be made to the description of the method section for relevance if it corresponds to the method section of the embodiment disclosure.
Those of skill in the art would appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software may depend upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the disclosed embodiments. It can be clearly understood by the skilled person that, for convenience and brevity of description, the specific working processes of the system, the apparatus and the unit described above may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the embodiments disclosed herein, the disclosed methods, products (including but not limited to devices, apparatuses, etc.) may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units may be merely a logical division, and in actual implementation, there may be another division, for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form. The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to implement the present embodiment. In addition, functional units in the embodiments of the present disclosure may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. In the description corresponding to the flowcharts and block diagrams in the figures, operations or steps corresponding to different blocks may also occur in different orders than disclosed in the description, and sometimes there is no specific order between the different operations or steps. For example, two sequential operations or steps may in fact be executed substantially concurrently, or they may sometimes be executed in the reverse order, depending upon the functionality involved. Each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
Claims (10)
1. A control method for an electric household appliance, comprising:
acquiring a thermal imaging image in an acquisition area associated with the household appliance, and determining an order-giving user;
determining a command gesture image of the command-applying user from the thermographic image;
determining target gesture information corresponding to the command gesture image according to a pre-stored gesture model;
and obtaining a control instruction associated with the target gesture information, and controlling the household appliance.
2. The method of claim 1, wherein after determining the instructional user, the method further comprises:
and when the gesture of the order-giving user meets a preset awakening condition, determining a command gesture image of the order-giving user.
3. The method of claim 1, wherein after controlling the home device, the method further comprises:
and if a new thermal imaging image is acquired and a control instruction for stopping control is obtained according to the command gesture image determined from the new thermal imaging image, stopping controlling the household appliance.
4. The method of claim 1, wherein determining the instructional user comprises:
marking an image area meeting a preset human body temperature in the thermal imaging image;
and determining the order applying user according to the image area and the preset human body shape image.
5. The method of claim 1, wherein after obtaining the pre-stored gesture model, the method further comprises:
and performing model optimization on the pre-stored gesture model according to the command gesture image.
6. The method of claim 1, wherein after determining the instructional user, the method further comprises:
determining the body surface temperature of the order applying user through the thermal imaging image;
and controlling the household appliance according to the control instruction and the body surface temperature.
7. The method of claim 1, further comprising:
and determining the body surface temperature of the order giving user through the thermal imaging image, and giving an early warning when the body surface temperature exceeds a preset temperature value.
8. A control device for an electrical household appliance, comprising:
the thermal imaging image acquisition module is configured to acquire a thermal imaging image in an acquisition area associated with the household appliance and determine an order user;
a command gesture image determination module configured to determine a command gesture image of the instructional user from the thermographic image;
the target gesture information determining module is configured to determine target gesture information corresponding to the command gesture image according to a pre-stored gesture model;
and the control instruction acquisition module is configured to acquire the control instruction associated with the target gesture information and control the household appliance.
9. A control apparatus for an electric home appliance comprising a processor and a memory storing program instructions, characterized in that the processor is configured to carry out the control method for an electric home appliance according to any one of claims 1 to 7 when executing the program instructions.
10. A household appliance comprising a control device for a household appliance according to claim 8 or 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011212504.1A CN112327645A (en) | 2020-11-03 | 2020-11-03 | Control method and device for household appliance and household appliance |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011212504.1A CN112327645A (en) | 2020-11-03 | 2020-11-03 | Control method and device for household appliance and household appliance |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112327645A true CN112327645A (en) | 2021-02-05 |
Family
ID=74323409
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011212504.1A Pending CN112327645A (en) | 2020-11-03 | 2020-11-03 | Control method and device for household appliance and household appliance |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112327645A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113341737A (en) * | 2021-05-18 | 2021-09-03 | 珠海格力电器股份有限公司 | Control method, system, device, equipment and storage medium of intelligent household equipment |
| CN113485146A (en) * | 2021-07-30 | 2021-10-08 | 重庆海尔空调器有限公司 | Control method and control device for household appliance and household appliance |
| CN113639432A (en) * | 2021-07-30 | 2021-11-12 | 青岛海尔空调器有限总公司 | Method and device for controlling air conditioner, air conditioner and readable storage medium |
| CN114415825A (en) * | 2021-12-13 | 2022-04-29 | 珠海格力电器股份有限公司 | Control method, control device, electronic equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103902026A (en) * | 2012-12-25 | 2014-07-02 | 鸿富锦精密工业(武汉)有限公司 | System and method for automatically adjusting display screen |
| CN105485852A (en) * | 2015-12-30 | 2016-04-13 | 美的集团武汉制冷设备有限公司 | Air conditioner control method and device based on body surface temperature |
| CN106155289A (en) * | 2015-04-14 | 2016-11-23 | 鸿富锦精密工业（深圳）有限公司 | Vehicle control system and operational approach thereof |
| CN107544272A (en) * | 2017-09-18 | 2018-01-05 | 广东美的制冷设备有限公司 | terminal control method, device and storage medium |
| CN108937952A (en) * | 2018-06-05 | 2018-12-07 | 上海东巍体育科技有限公司 | A kind of the elderly's motion state detection system and method based on thermal imaging |
| CN109991859A (en) * | 2017-12-29 | 2019-07-09 | 青岛有屋科技有限公司 | A kind of gesture instruction control method and intelligent home control system |
-
2020
- 2020-11-03 CN CN202011212504.1A patent/CN112327645A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103902026A (en) * | 2012-12-25 | 2014-07-02 | 鸿富锦精密工业(武汉)有限公司 | System and method for automatically adjusting display screen |
| CN106155289A (en) * | 2015-04-14 | 2016-11-23 | 鸿富锦精密工业（深圳）有限公司 | Vehicle control system and operational approach thereof |
| CN105485852A (en) * | 2015-12-30 | 2016-04-13 | 美的集团武汉制冷设备有限公司 | Air conditioner control method and device based on body surface temperature |
| CN107544272A (en) * | 2017-09-18 | 2018-01-05 | 广东美的制冷设备有限公司 | terminal control method, device and storage medium |
| CN109991859A (en) * | 2017-12-29 | 2019-07-09 | 青岛有屋科技有限公司 | A kind of gesture instruction control method and intelligent home control system |
| CN108937952A (en) * | 2018-06-05 | 2018-12-07 | 上海东巍体育科技有限公司 | A kind of the elderly's motion state detection system and method based on thermal imaging |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113341737A (en) * | 2021-05-18 | 2021-09-03 | 珠海格力电器股份有限公司 | Control method, system, device, equipment and storage medium of intelligent household equipment |
| CN113341737B (en) * | 2021-05-18 | 2023-11-10 | 珠海格力电器股份有限公司 | Control method, system, device, equipment and storage medium of intelligent household equipment |
| CN113485146A (en) * | 2021-07-30 | 2021-10-08 | 重庆海尔空调器有限公司 | Control method and control device for household appliance and household appliance |
| CN113639432A (en) * | 2021-07-30 | 2021-11-12 | 青岛海尔空调器有限总公司 | Method and device for controlling air conditioner, air conditioner and readable storage medium |
| CN113639432B (en) * | 2021-07-30 | 2022-09-02 | 青岛海尔空调器有限总公司 | Method and device for controlling air conditioner, air conditioner and readable storage medium |
| WO2023005391A1 (en) * | 2021-07-30 | 2023-02-02 | 重庆海尔空调器有限公司 | Control method and control apparatus for household appliance, and household appliance |
| CN114415825A (en) * | 2021-12-13 | 2022-04-29 | 珠海格力电器股份有限公司 | Control method, control device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112327645A (en) | Control method and device for household appliance and household appliance | |
| CN112856771B (en) | Control method and control device for air conditioner and air conditioner | |
| CN107422859B (en) | Gesture-based regulation and control method and device, computer-readable storage medium and air conditioner | |
| CN107085380B (en) | Intelligent household system user position judgment method and electronic equipment | |
| JP6481249B2 (en) | Programmable display, control method, and program | |
| CN107678649A (en) | The method for information display and device of intelligent panel | |
| WO2022227775A1 (en) | Method and device for controlling air conditioner, and air conditioner | |
| CN110908340A (en) | Smart home control method and device | |
| CN110186167B (en) | Control method and device of air conditioner, air conditioner and storage medium | |
| CN111063067A (en) | Intelligent access control system based on voice control | |
| JP2015026316A (en) | Programmable display apparatus, display control method, and program | |
| JP2016070514A (en) | Operation terminal and control method | |
| CN110895934A (en) | Household appliance control method and device | |
| CN109268936A (en) | Control method, device, air conditioner and the storage medium of air conditioner | |
| CN113339965A (en) | Method and device for air conditioner control and air conditioner | |
| CN106016612A (en) | Air conditioner control method and device and air conditioner | |
| CN106502117A (en) | A kind of convenient intelligent domestic system | |
| CN103839358A (en) | Intelligent air conditioner and anti-theft monitoring method and device thereof | |
| CN107969143B (en) | Determination support device, determination support method, and recording medium | |
| CN105467864A (en) | Control system | |
| CN112965391A (en) | Household appliance control method, household appliance control system and wearable device | |
| US10452963B2 (en) | Arming and/or altering a home alarm system by specified positioning of everyday objects within view of a security camera | |
| CN108628527A (en) | A kind of household electric appliance control method | |
| CN113436367A (en) | Method and device for controlling child lock state of remote controller and remote controller | |
| CN113639434B (en) | Method and device for controlling air conditioner, air conditioner and readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210205 |