CN109991859B - Gesture instruction control method and intelligent home control system - Google Patents
Gesture instruction control method and intelligent home control system Download PDFInfo
- Publication number
- CN109991859B CN109991859B CN201711478628.2A CN201711478628A CN109991859B CN 109991859 B CN109991859 B CN 109991859B CN 201711478628 A CN201711478628 A CN 201711478628A CN 109991859 B CN109991859 B CN 109991859B
- Authority
- CN
- China
- Prior art keywords
- user
- gesture
- image information
- control
- acquiring
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B15/00—Systems controlled by a computer
- G05B15/02—Systems controlled by a computer electric
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS], computer integrated manufacturing [CIM]
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/20—Pc systems
- G05B2219/26—Pc applications
- G05B2219/2642—Domotique, domestic, home control, automation, smart house
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Abstract
The invention discloses a gesture instruction control method and an intelligent home control system, and belongs to the technical field of intelligent remote control. The control method comprises the following steps: acquiring gesture image information of a user hand; identifying a control instruction matched with the gesture image information; and sending a control instruction to at least one target device to control the target device to execute corresponding running operation. According to the gesture instruction control method provided by the invention, the gesture image can be collected, and the corresponding control instruction is sent to the corresponding target equipment according to the gesture image, so that the user can still control the running state of the target equipment under the condition of non-manual touch, the intellectualization of the control mode of the smart home is further improved, and the use experience of the user is improved.
Description
Technical Field
The invention relates to the technical field of intelligent remote control, in particular to a gesture instruction control method and an intelligent home control system.
Background
With the rapid development of smart home technology, more and more homes are beginning to introduce intelligent systems and devices. The intelligent home (English: smart home, home automation) is a management system which integrates facilities related to home life by using a home as a platform and utilizing a comprehensive wiring technology, a network communication technology, a security technology, an automatic control technology and an audio and video technology to construct efficient home facilities and home schedule affairs.
The intelligent control of the smart home is always an important research direction of the smart home technology, and most of the existing smart home control modes send control instructions to household appliances such as an air conditioner and a television in a home environment in a wireless or wired data transmission mode through devices such as a mobile phone, an ipad, a remote controller and a control panel. The control mode inevitably needs a user to manually operate entity control devices such as a mobile phone, an ipad, a remote controller, a control panel and the like to realize the input operation of the control instruction, and the operation is relatively inconvenient.
Disclosure of Invention
The invention provides a gesture instruction control method and an intelligent home control system, and aims to solve the problem that a user is inconvenient due to the fact that a manual touch input instruction is relied on in a conventional home control mode. The following presents a simplified summary in order to provide a basic understanding of some aspects of the disclosed embodiments. This summary is not an extensive overview and is intended to neither identify key/critical elements nor delineate the scope of such embodiments. Its sole purpose is to present some concepts in a simplified form as a prelude to the more detailed description that is presented later.
According to the first aspect of the present invention, there is also provided a gesture instruction control method for performing operation control on at least one target device, the control method including: acquiring gesture image information of a user hand; identifying a control instruction matched with the gesture image information; and sending a control instruction to at least one target device to control the target device to execute corresponding running operation.
In an optional implementation manner, before acquiring the gesture image information of the hand of the user, the control method further includes: determining an order user; controlling movement of the image capture device in response to the command user; the method for acquiring the gesture image information of the hand of the user comprises the step of acquiring the gesture image information of the order-giving user acquired by the image acquisition equipment.
In an alternative embodiment, determining the instructional user includes: acquiring physical sign information of a user; and determining the user conforming to the preset physical sign as a command giving user.
In an optional implementation, acquiring gesture image information of a hand of a user includes: acquiring gesture image information of at least one user hand in a preset area.
In an optional implementation, acquiring gesture image information of a hand of a user includes: acquiring gesture image information of a combination of at least two gesture actions of a hand of a user in a preset time.
In an optional implementation mode, the control instruction matched with the gesture image information is recognized, and the control instruction comprises: comparing the gesture image information with at least one gesture prestored image; and determining a control instruction matched with the gesture prestored image which is consistent with the gesture image information in comparison.
In an optional implementation manner, before the control instruction matched with the gesture image information is identified, the control method further includes: acquiring the current running state of at least one target device; determining a control instruction matched with a gesture prestored image which is consistent with the gesture image information in comparison, wherein the control instruction comprises the following steps: selecting one of at least two control instructions matched with the gesture prestored image as a current control instruction according to the current running state; sending a control instruction to at least one target device, comprising: and sending the current control instruction to at least one target device.
According to a second aspect of the present invention, there is also provided an intelligent home control system, including: the acquisition module is used for acquiring gesture image information of the hand of the user; the recognition module is used for recognizing the control instruction matched with the gesture image information; and the sending module is used for sending a control instruction to at least one target device so as to control the target device to execute corresponding operation.
In an alternative embodiment, the control system further comprises: the determining module is used for determining the order-giving user before the acquiring module acquires the gesture image information of the hand of the user; the response module is used for controlling the image acquisition equipment to respond to the movement of the order user; the acquisition module is specifically used for acquiring gesture image information of an order applying user acquired by the image acquisition equipment.
In an optional implementation manner, the obtaining module is specifically configured to: acquiring gesture image information of a combination of at least two gesture actions of a hand of a user in a preset time.
In an optional implementation manner, the determination module is specifically configured to obtain sign information of a user, and determine that the user who meets a preset sign is a command-giving user.
In an optional implementation manner, the obtaining module is specifically configured to: acquiring gesture image information of at least one user hand in a preset area.
In an optional implementation manner, the identification module is specifically configured to: comparing the gesture image information with at least one gesture prestored image; and determining a control instruction matched with the gesture prestored image which is consistent with the gesture image information in comparison.
In an optional implementation manner, the obtaining module is further configured to obtain a current operating state of the at least one target device before identifying the control instruction matched with the gesture image information; the identification module is further configured to: selecting one of at least two control instructions matched with the gesture prestored image as a current control instruction according to the current running state; the sending module is further configured to send the current control instruction to at least one target device.
The invention adopts the technical scheme and has the beneficial effects that:
according to the gesture instruction control method provided by the invention, the gesture image can be collected, and the corresponding control instruction is sent to the corresponding target equipment according to the gesture image, so that the user can still control the running state of the target equipment under the condition of non-manual touch, the intellectualization of the control mode of the intelligent home is further promoted, and the use experience of the user is promoted.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention, as claimed.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.
FIG. 1 is a first flowchart illustrating a control method of the present invention according to an exemplary embodiment;
fig. 2 is a first structural block diagram of the smart home control system according to an exemplary embodiment of the present invention;
fig. 3 is a second structural block diagram of the smart home control system according to an exemplary embodiment of the present invention.
Detailed Description
The following description and the drawings sufficiently illustrate specific embodiments of the invention to enable those skilled in the art to practice them. Other embodiments may incorporate structural, logical, electrical, process, and other changes. The examples merely typify possible variations. Individual components and functions are optional unless explicitly required, and the sequence of operations may vary. Portions and features of some embodiments may be included in or substituted for those of others. The scope of embodiments of the invention encompasses the full ambit of the claims, as well as all available equivalents of the claims. Embodiments may be referred to, individually or collectively, herein by the term "invention" merely for convenience and without intending to voluntarily limit the scope of this application to any single invention or inventive concept if more than one is in fact disclosed. Herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method or apparatus that comprises the element. The embodiments are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. As for the methods, products and the like disclosed by the embodiments, the description is simple because the methods correspond to the method parts disclosed by the embodiments, and the related parts can be referred to the method parts for description.
The control method can be applied to an intelligent home control system, the intelligent home control system can perform instruction interaction with a user according to the control method, acquire the instruction of the user in a non-manual touch mode, and control related household electrical equipment according to the instruction.
In an application scenario of the present invention, the home appliances disposed in the home environment of the user include, but are not limited to: the air conditioner can refrigerate and cool the indoor environment in a refrigeration mode and heat and warm the indoor environment in a heating mode, and the working modes (the refrigeration mode, the heating mode or the dehumidification mode, and the like) of actual operation and specific operation parameters (such as wind speed, temperature, wind direction and the like) in each working mode can be controlled and adjusted by a user; the refrigerator can be used for storing food, drinks and the like at low temperature, and parameters such as storage temperature, humidity and the like of a fresh-keeping chamber, a refrigerating chamber and/or a freezing chamber of the refrigerator can be controlled and adjusted by a user; the range hood is arranged in an indoor place such as a kitchen and the like which is easy to generate oil smoke, can extract indoor air mixed with the oil smoke during operation and discharge the air into an outdoor environment through a smoke discharge pipeline, and parameters such as an operation gear of the range hood and the like can be controlled and adjusted by a user; the household video and audio equipment can play audio, video and other programs for users, switch programs, and operate parameters (program playing progress, volume, display brightness, and the like) of the video and audio equipment, and can also be controlled and adjusted by the users.
The home environment is also provided with wireless equipment such as a router and the like, the intelligent home control system can perform data interactive communication with one or more household appliances through a home local area network where the wireless router is erected, for example, the intelligent home control system can send relevant instruction information of a user to the household appliances through the local area network, and the household appliances adjust the running state or running parameters of the household appliances according to the received instructions, such as switching the on/off state of the air conditioner, or increasing or decreasing the refrigerating temperature in a refrigerating mode, and the like; or the household appliance can also send the state information of the household appliance to the intelligent home control system through the local area network, and the range hood can send the current running state information of the household appliance, such as the on-off state, running gear and the like of the range hood, to the intelligent home control system, so that the intelligent home control system can further adjust the running of the range hood according to the instruction of the user and the current running state information of the range hood.
In an application scenario of this embodiment, an independent image acquisition device, such as a high definition camera, is disposed in a home environment, and the image acquisition device may be configured to acquire image information in a set sensing region, where the image information includes static information and dynamic information, where the static information includes an image such as a instantly-captured picture, and the dynamic information is image information within a set time length; meanwhile, the image acquisition equipment can also be accessed into the intelligent home control system through a local area network, and can send the acquired image information to the intelligent home control system.
Or, in other embodiments, some of the home appliances are configured with image capturing devices themselves, for example, image capturing devices such as mini cameras are installed on tops of some home refrigerator products and television products, so that the smart home control system may further perform data communication with the image capturing devices of the some home appliances to obtain image information of sensing areas corresponding to the image capturing devices.
It can be understood that the data communication method between the smart home control system and the home appliances, the image capturing devices, and the like in this embodiment is not limited to the local area network communication established by the router, and the related instruction information, state information, and image information may be mutually transmitted through data transmission paths such as data lines in a wired connection manner.
Fig. 1 is a first flowchart illustrating a control method of the present invention according to an exemplary embodiment.
As shown in fig. 1, the present invention provides a gesture instruction control method, which may be used in an intelligent home control system to perform operation control on at least one target device in a home environment, where in this embodiment, the target device includes, but is not limited to, the aforementioned household appliances such as an air conditioner, a refrigerator, and a range hood; specifically, the flow steps of the control method mainly include:
s101, acquiring gesture image information of a user hand;
in this embodiment, the instruction input mode of the user to the home appliance is non-manual touch control, that is, the user may indicate the control intention of the user on the target device by the change of the gesture action without directly contacting the control device of the remote controller or the control panel.
Specifically, in this embodiment, the gesture actions that the user can make include, but are not limited to: the first gesture action of gripping the five fingers, the second gesture action of extending one finger, the third gesture action of extending two fingers, the fourth gesture action of extending three fingers, the fifth gesture action of extending four fingers, the sixth gesture action of stretching the five fingers and the like.
In this embodiment, in step S101, gesture image information of the hand of the user is acquired by the image acquisition device, and the gesture image information is sent to the smart home control system; since the sensing region of the image capturing device is fixed, the user needs to make a change in gesture motion within the effective sensing region of the image capturing device in order to facilitate image capturing by the image capturing device;
in this embodiment, the image information in the sensing region of the image capturing device is generally captured once at a set time interval, preferably, the set time interval may be set to 2s, 3s, and the like with a short duration, so as to avoid the occurrence of a problem that the user makes a gesture motion change within the set time interval and is not captured by the image capturing device, and through a multiple image capturing manner at a short time interval, the possibility that the gesture motion of the user is missed and not captured can be reduced, thereby improving the response sensitivity of the smart home to the user instruction input.
In this embodiment, the image information that the image acquisition equipment will gather every interval set time length all sends intelligent house control system to carry out screening discernment by intelligent house control system, and generate corresponding control command.
Optionally, the image acquisition device may include a white light camera, an infrared camera, and/or a camera with both white light and infrared camera functions, where the white light camera may acquire common image information, and the infrared camera may acquire infrared image information or sense whether thermal imaging exists in the target area; in an optional embodiment, a white light camera and an infrared camera which sense the same region are respectively arranged in a home environment, wherein when the infrared camera senses that thermal imaging information exists in the region, namely a user enters or is in the sensing region, the white light camera is switched to a working state or a starting state, collects image information in the sensing region in real time, and sends the collected image information to an intelligent home control system; and when the infrared camera does not sense that the thermal imaging information exists in the region, namely no user exists in the sensing region, the infrared camera is switched to a dormant state or a power-off state, and at the moment, the intelligent home control system does not input new image information. In this embodiment, the infrared camera may be replaced by another component having a thermal sensing function, as long as the infrared camera has a function of sensing whether the user is present or not through information such as temperature or heat.
In an embodiment, the process of sensing whether thermal imaging information exists by the infrared camera includes: acquiring image information in the sensing region, comparing the heat value of the image information with a set heat value, and judging that a user exists in the sensing region when the heat value in the image information is higher than the set heat value; specifically, the set heat value may be set according to the common body surface heat data of the user counted by the big data, or may be set according to the historical data of the body surface heat of the user collected in the current home environment.
Alternatively, other sound sensing functional components can be used to replace the infrared camera, and whether the user exists or not can be judged by sensing the volume parameters such as decibels in the target area of the indoor environment.
Therefore, under the condition that no user exists in the indoor environment, the intelligent home control system can control the image acquisition device to be in a low-energy-consumption state such as dormancy or shutdown through the thermal sensing functional component such as the infrared camera or the sound sensing functional component such as the microphone, so that the resource consumption is reduced, and the use cost of the user is reduced.
S102, identifying a control instruction matched with the gesture image information;
the intelligent home control system receives image information which is sent continuously at intervals of set time length by the image acquisition equipment, and screens and processes the image information; in an alternative embodiment, the processing of the image information comprises: and intercepting a part image of the hand of the user in the image information, and carrying out processing operations such as zooming, enhancing, normalizing and the like on the part image so as to improve the accuracy of identifying the specific gesture action of the hand of the user in the subsequent process.
Optionally, because the user generally wears clothes, the human body part with the higher heat sensed by the infrared camera is mainly the exposed hand and head of the user, and preferably, the white light camera can be controlled to respond to the part with the higher heat sensed by the infrared camera and acquire image information, so that the white light camera can mainly acquire the image information of the hand and head of the user, and then the image information of the head is removed by screening through the contour shape, and thus, the gesture image information meeting the requirement can be screened out.
Specifically, the smart home system prestores a plurality of gesture prestored images, including but not limited to a first gesture prestored image held by five fingers, a second gesture prestored image extending out of one finger, a third gesture prestored image extending out of two fingers, a fourth gesture prestored image extending out of three fingers, a fifth gesture prestored image extending out of four fingers and a sixth prestored gesture image extending out of five fingers, wherein the number of types of the specific gesture prestored images can be increased, decreased and set according to the actual control requirement; in this embodiment, each gesture pre-stored image is matched with at least one control instruction corresponding to at least one household appliance (current target device), for example, when the target device is a range hood, the control instruction matched with the first gesture pre-stored image information is on/off, the control instruction matched with the second gesture pre-stored image information is an upshift of a wind speed of the range hood, the control instruction matched with the third gesture pre-stored image information is a downshift of a wind speed of the range hood, and the like.
In this way, in step S102, the smart home control system may compare the gesture image information with at least one gesture pre-stored image according to a plurality of pre-stored gesture image information, specifically, in actual application, the gesture image information is compared with all pre-stored image information in the system; and determining a control instruction matched with the gesture prestored image which is consistent with the gesture image information in comparison, wherein the control instruction is the control operation on the target equipment currently expected by the user.
For example, the target device is a range hood, the sensing area of the image acquisition device is a kitchen, when oil smoke in a kitchen environment is too large, a user can make a second gesture motion of stretching out a finger through a hand, the image acquisition device acquires gesture image information of the user, and compares a second gesture pre-stored image consistent with the second gesture motion through processing, screening, identifying and other operations, so that a control instruction matched with the second gesture pre-stored image of the control operation expected to be performed on the range hood by the user, namely the wind speed upshift of the range hood, can be determined.
In addition, since the image acquisition device acquires the gesture action images of the hand of the user within a short time interval, the situation that the intelligent home control system receives a plurality of same gesture action images within a short time may occur, and the user only expects to perform one control operation; therefore, in order to avoid the problem of misoperation that the same instruction is repeatedly executed in a short time, the invention can also be set to generate or send the control instruction once when the same control instruction is continuously and repeatedly recognized within a specific time length.
For example, if the second gesture motion of extending one finger of the hand of the user lasts for 6 seconds, 3 gesture image information with the second gesture motion are collected by the image collection device which collects image information at a set time interval of 2 seconds and are sent to the smart home control system, and the set rule of the smart home control system is as follows: when the same control command is recognized continuously within 10s, the control command is transmitted only once. Therefore, after the intelligent home control system receives the 3 pieces of gesture image information with the second gesture action, the control instruction matched with the 3 times of second pre-stored gesture pre-stored images can be recognized, and the control instruction is sent to the outside only once according to the rule set by the intelligent home control system.
S103, sending a control instruction to at least one target device to control the target device to execute corresponding operation.
In most embodiments of the present invention, generally, one target device to which a control instruction is directed is used each time a flow of the control method is executed, for example, a user performs a control operation on an air conditioner once, performs a control operation on a range hood once, and the like; in other embodiments, the control instruction may further execute a plurality of target devices, for example, when the target device desired by the user is a plurality of associated heating-related household electrical appliance sets, for example, the water heater, the air conditioner, the electric heater, and the like may be associated with the heating-related household electrical appliance sets, when the hand of the user makes a first gesture action of holding with five fingers, the smart home control system recognizes a start-up instruction matched with the first gesture pre-stored image according to gesture action image information acquired by the image acquisition device, and then the smart home control system sends the start-up instruction to the heating-related household electrical appliance sets, that is, sends the start-up instruction to the water heater, the air conditioner, and the electric heater, respectively executes corresponding start-up operations after receiving the start-up instruction.
In one embodiment, the camera adopted by the invention can also convert the sensing area in a rotating mode so as to expand the range of the sensing area; in addition, before acquiring the gesture image information of the user hand, the control method further comprises the following steps: determining an order application user, wherein the order application user is a user with a hand part making a gesture action to indicate an expected control operation to the intelligent home control system, namely a current user who executes a control flow triggering execution of the control method; meanwhile, the intelligent home control system can control the image acquisition equipment to respond to the movement of the order user, for example, the camera is controlled to rotate in real time along with the movement of the order user, so that the user can be always in the sensing area of the camera.
In this way, the gesture image information of the user' S hand acquired in step S101 is actually the gesture image information of the command user acquired by the image acquisition apparatus.
Specifically, the step of determining the order user includes: acquiring physical sign information of a user; and determining the user conforming to the preset physical sign as a command giving user.
For example, when a plurality of users exist in the sensing area, the image information acquired by the image acquisition device includes images of the plurality of users, the smart home control system determines the user who successfully matches the gesture image as the order-giving user, and selects one or more pieces of sign information, such as a face, a clothing color or a pattern, from the local image of the order-giving user, and the sign information is set as a preset sign; when the image acquisition equipment acquires the images of the users again, the intelligent home control system screens out the users meeting the preset signs, determines the users as order-giving users, only recognizes the gesture image information of the hands of the users, and matches out corresponding control instructions.
In addition, the smart home control system may further control the image capturing device to respond to the movement of the command user, and one implementation manner of the smart home control system is as follows: controlling the image acquisition equipment to respond to the movement of the user according with the preset physical sign; for example, the intelligent home control system can select a static object in the sensing area as a reference object, and by comparing image information acquired for a plurality of times before and after the comparison, the distance position between the user and the reference object is applied to determine the position of the sensing area where the user is located, and when the user deviates from the reference object by a set distance, the rotation angle of the camera is determined, so that the user can be always located in the sensing area of the rotated camera.
Preferably, after the camera is rotated, the smart home control system may select a static object from the new sensing area again as a new reference object for the sensing area.
In an embodiment of the present invention, the acquiring gesture image information of the user' S hand in step S101 includes: acquiring gesture image information of at least one user hand in a preset area; the preset region is a sensing region of the image acquisition device.
The above embodiments all use single static gesture image information for recognition; optionally, in other embodiments of the present invention, the gesture image information obtained in step S101 is gesture image information obtained by combining at least two gesture actions of the hand of the user within a preset time duration, for example, the user makes the aforementioned second gesture action and third gesture action within 4S (preset time duration), and the image acquisition device also acquires the gesture image information with the second gesture action and the gesture image information with the third gesture action respectively, and sends the acquired gesture image information and the gesture image information with the third gesture action to the smart home control system; the intelligent home control system also prestores one or more gesture prestored images combined by at least two gesture prestored actions, and each gesture prestored image is associated with at least one control instruction; therefore, the intelligent home control system can obtain a gesture pre-stored image which is consistent with the comparison result of the gesture pre-stored image by matching according to the gesture image information combined by the second gesture action and the third gesture action, further determine a control instruction associated with the gesture pre-stored image, and send the control instruction to the corresponding target device for execution.
Therefore, by adopting the image acquisition and recognition mode of the gesture action combination, the problem that the number of control instructions is small due to the fact that the gesture action types covered by single static gesture image information are too few can be solved, and diversification of the control instructions is realized.
In an embodiment of the present invention, before identifying the control instruction matched with the gesture image information, the control method further includes:
acquiring the current running state of at least one target device;
determining a control instruction matched with a gesture prestored image which is consistent with the gesture image information in comparison, wherein the control instruction comprises the following steps: selecting one of at least two control instructions matched with the gesture prestored image as a current control instruction according to the current running state;
sending a control instruction to at least one target device, comprising: and sending the current control instruction to at least one target device.
For example, when the target device is a range hood and the range hood is in an operating state, the intelligent home control system can acquire the current operating state of the range hood in real time so as to control and adjust the current operating state of the range hood according to a new instruction output by a user; when a user makes a first gesture action of five-finger gripping, the intelligent home control system identifies that a control instruction matched with the intelligent home control system is a starting or shutdown instruction, selects a shutdown instruction matched with a first gesture prestored image which is consistent with the first gesture action as a current control instruction according to the starting running state of the range hood, and sends the shutdown instruction to the range hood; and after the range hood receives the shutdown instruction, controlling to close the operation of the range hood.
Generally, in most embodiments of the present invention, each gesture pre-stored image matches only one control command; by the control method, the matching of a plurality of control instructions of the pre-stored images of the same gesture can be realized, so that when a user makes the same gesture, the intelligent home control system can select the control instructions which accord with the actual running state of the target equipment, and the control diversity of the intelligent home control system is further enriched.
In an embodiment of the present invention, the control method further includes: when none of the associated devices is operated, identifying at least one target device matched with the gesture image information; and starting to operate at least one target device.
Specifically, the gesture prestored images prestored in the intelligent home control system can also be matched with target equipment, for example, the first gesture prestored image is a range hood, the second gesture prestored image is an air conditioner, and the third gesture prestored image is a television; therefore, when the household appliances associated with the intelligent home control system are all running, the intelligent home control system can determine the target equipment which is expected to be started by the user to run according to the gesture image information collected by the image collecting equipment and control the target equipment to start running. And after the target equipment starts to operate, the gesture pre-stored image is associated with the control instruction again, and the operation of the target equipment is controlled and adjusted according to the collected new gesture image information of the user.
Fig. 2 is a first structural block diagram of the smart home control system according to an exemplary embodiment of the present invention.
The invention also provides an intelligent home control system, and the control system 200 comprises:
an obtaining module 201, configured to obtain gesture image information of a hand of a user;
the recognition module 202 is used for recognizing the control instruction matched with the gesture image information;
the sending module 203 is configured to send a control instruction to at least one target device to control the target device to execute a corresponding operation.
The intelligent home control system provided by the invention can collect the gesture images and send corresponding control instructions to the corresponding target equipment according to the gesture images, so that the user can still control the running state of the target equipment under the condition of non-manual touch, the intellectualization of the control mode of the intelligent home is further promoted, and the use experience of the user is promoted.
Fig. 3 is a second structural block diagram of the smart home control system according to an exemplary embodiment of the present invention.
The invention also provides an intelligent home control system, wherein the control system 300 comprises an acquisition module, a recognition module and a sending module, wherein the acquisition module 310 is used for acquiring gesture image information of a hand of a user; the recognition module 320 is used for recognizing the control instruction matched with the gesture image information; the sending module 330 is configured to send a control instruction to at least one target device to control the target device to execute a corresponding operation.
In an embodiment of the present invention, the control system 300 further comprises:
the determining module 340 is configured to determine the order-giving user before the obtaining module 310 obtains the gesture image information of the hand of the user;
a response module 350 for controlling movement of the image capture device in response to the command user;
the obtaining module 310 is specifically configured to obtain gesture image information of an order-applying user, which is collected by an image collection device.
In an embodiment of the present invention, the obtaining module 310 is specifically configured to: acquiring gesture image information of a combination of at least two gesture actions of a hand of a user in a preset time.
In an embodiment of the present invention, the determining module 340 is specifically configured to obtain sign information of a user, and determine that a user meeting a preset sign is a command-giving user.
In an embodiment of the present invention, the obtaining module 310 is specifically configured to: acquiring gesture image information of at least one user hand in a preset area.
In an embodiment of the present invention, the identifying module 320 is specifically configured to: comparing the gesture image information with at least one gesture prestored image; and determining a control instruction matched with the gesture prestored image which is consistent with the gesture image information in comparison.
In an embodiment of the present invention, the obtaining module 310 is further configured to, before identifying the control instruction matched with the gesture image information, obtain a current operating state of at least one target device;
the identification module 320 is further configured to: selecting one of at least two control instructions matched with the gesture prestored image as a current control instruction according to the current running state;
the sending module 330 is further configured to send the current control command to at least one target device.
The specific implementation of the control system to implement the above functions may refer to the related description of the control method, which is not described herein again.
It is to be understood that the present invention is not limited to the procedures and structures described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the invention is limited only by the appended claims.
Claims (8)
1. A gesture instruction control method is used for performing operation control on at least one target device, and is characterized by comprising the following steps:
acquiring gesture image information of a user hand acquired by image acquisition equipment, wherein the image acquisition equipment comprises a white light camera and an infrared camera which are used for sensing the same area;
identifying at least one control instruction of at least one target device in the corresponding home environment matched with the gesture image information;
sending the control instruction to the at least one target device to control the target device to execute corresponding operation;
the acquiring gesture image information of the user hand acquired by the image acquisition device comprises: when the infrared camera senses that a user enters or is in a sensing area, the white light camera is switched to a working or starting state, and gesture image information of the hand of the user, which is acquired by the white light camera, is acquired;
the control instruction matched with the gesture image information is identified, and the control instruction comprises the following steps:
comparing the gesture image information with at least one gesture prestored image;
determining a control instruction matched with the gesture prestored image which is consistent with the gesture image information in comparison;
before identifying the control instruction matched with the gesture image information, the control method further comprises the following steps: acquiring the current running state of the at least one target device;
the determining the control instruction matched with the gesture prestored image which is consistent with the gesture image information in comparison comprises the following steps: selecting one of at least two control instructions matched with the gesture prestored image as a current control instruction according to the current running state;
the sending the control instruction to the at least one target device includes: sending the current control instruction to the at least one target device;
the user entering or being in the sensing region may be sensed by:
acquiring image information within the sensing region;
comparing the heat value of the image information with a set heat value, and when the heat value in the image information is higher than the set heat value, determining that a user exists in the sensing region;
the set heat value can be set according to common body surface heat data of the user counted by the big data, or set according to historical data of the body surface heat of the user collected in the current home environment.
2. The control method according to claim 1, wherein before the acquiring gesture image information of the user's hand, the control method further comprises:
determining a command user;
controlling movement of the image capture device in response to the command user;
the step of acquiring the gesture image information of the hand of the user comprises the step of acquiring the gesture image information of the order applying user acquired by the image acquisition equipment.
3. The control method according to claim 2, wherein the determining an instructing user includes:
acquiring physical sign information of a user;
and determining the user meeting the preset physical sign as the order giving user.
4. The control method according to claim 1, wherein the acquiring gesture image information of the user's hand comprises:
and acquiring the gesture image information of at least one user hand in a preset area.
5. The control method according to claim 1, wherein the acquiring gesture image information of the user's hand comprises:
and acquiring gesture image information combined by at least two gesture actions of the hand of the user within a preset time length.
6. The utility model provides an intelligence house control system which characterized in that, control system includes:
the acquisition module is used for acquiring gesture image information of the hand of the user;
the recognition module is used for recognizing the control instruction matched with the gesture image information;
and the sending module is used for sending the control instruction to the at least one target device so as to control the target device to execute corresponding operation.
7. The control system of claim 6, further comprising:
the determining module is used for determining the order-giving user before the acquiring module acquires the gesture image information of the hand of the user;
a response module for controlling the image capture device to respond to the movement of the order-applying user;
the acquisition module is specifically configured to acquire the gesture image information of the order applying user acquired by the image acquisition device.
8. The control system of claim 6, wherein the acquisition module is specifically configured to:
and acquiring gesture image information combined by at least two gesture actions of the hand of the user within a preset time length.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711478628.2A CN109991859B (en) | 2017-12-29 | 2017-12-29 | Gesture instruction control method and intelligent home control system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711478628.2A CN109991859B (en) | 2017-12-29 | 2017-12-29 | Gesture instruction control method and intelligent home control system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109991859A CN109991859A (en) | 2019-07-09 |
| CN109991859B true CN109991859B (en) | 2022-08-23 |
Family
ID=67109052
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711478628.2A Active CN109991859B (en) | 2017-12-29 | 2017-12-29 | Gesture instruction control method and intelligent home control system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109991859B (en) |
Families Citing this family (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110426962A (en) * | 2019-07-30 | 2019-11-08 | 苏宁智能终端有限公司 | A kind of control method and system of smart home device |
| CN110602197A (en) * | 2019-09-06 | 2019-12-20 | 北京海益同展信息科技有限公司 | Internet of things control device and method and electronic equipment |
| CN110645609A (en) * | 2019-09-16 | 2020-01-03 | 华帝股份有限公司 | Gesture recognition control device and control method of range hood |
| CN110794695A (en) * | 2019-11-04 | 2020-02-14 | 佛山市云米电器科技有限公司 | Gesture linkage control system of household appliance |
| CN111414294A (en) * | 2020-03-04 | 2020-07-14 | 佛山市顺德区美的洗涤电器制造有限公司 | Monitoring device and method for dish washer |
| CN111431775A (en) * | 2020-03-11 | 2020-07-17 | 青岛海尔智能技术研发有限公司 | Control method and device for household electrical appliance and range hood |
| CN111399644A (en) * | 2020-03-12 | 2020-07-10 | 长虹美菱股份有限公司 | Control method of universal gesture motion recognition remote controller |
| CN111464677B (en) * | 2020-03-30 | 2022-07-15 | 维沃移动通信有限公司 | Electronic device, control method and control device thereof |
| CN111639603B (en) * | 2020-05-29 | 2023-12-15 | 广东正扬传感科技股份有限公司 | Function triggering method, system, terminal and storage medium using hand action |
| CN113766177A (en) * | 2020-06-05 | 2021-12-07 | 惠州视维新技术有限公司 | Camera sharing method, intelligent home control method and system |
| CN111736693B (en) * | 2020-06-09 | 2024-03-22 | 海尔优家智能科技（北京）有限公司 | Gesture control method and device of intelligent equipment |
| CN113473198B (en) * | 2020-06-23 | 2023-09-05 | 青岛海信电子产业控股股份有限公司 | Control method of intelligent equipment and intelligent equipment |
| CN111857345A (en) * | 2020-07-23 | 2020-10-30 | 上海纯米电子科技有限公司 | Gesture-based control method and device |
| CN111857346A (en) * | 2020-07-23 | 2020-10-30 | 上海纯米电子科技有限公司 | Gesture control method and device |
| CN112180849A (en) * | 2020-08-28 | 2021-01-05 | 星络智能科技有限公司 | Sign language control method, computer equipment and readable storage medium |
| CN112244705B (en) * | 2020-09-10 | 2023-05-23 | 北京石头创新科技有限公司 | Intelligent cleaning device, control method and computer storage medium |
| CN112327645A (en) * | 2020-11-03 | 2021-02-05 | 海尔(深圳)研发有限责任公司 | Control method and device for household appliance and household appliance |
| CN113791548A (en) * | 2021-09-26 | 2021-12-14 | 北京市商汤科技开发有限公司 | Device control method, device, electronic device and storage medium |
| CN114363384B (en) * | 2021-12-22 | 2023-04-07 | 珠海格力电器股份有限公司 | Device pointing control method, device, system, electronic device and storage medium |
| CN115616928A (en) * | 2022-10-21 | 2023-01-17 | 广州视声智能股份有限公司 | Control panel control method and device based on artificial intelligence |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103425238A (en) * | 2012-05-21 | 2013-12-04 | 刘鸿达 | Control system cloud system with gestures as input |
| CN103729057A (en) * | 2013-12-18 | 2014-04-16 | 京东方科技集团股份有限公司 | Method and system for controlling postures of display device by using gestures |
| CN104360736A (en) * | 2014-10-30 | 2015-02-18 | 广东美的制冷设备有限公司 | Gesture-based terminal control method and system |
| CN104615004A (en) * | 2014-12-31 | 2015-05-13 | 北京海尔广科数字技术有限公司 | Intelligent household electrical appliance operating authorization control method and device |
| CN104966013A (en) * | 2015-06-16 | 2015-10-07 | 努比亚技术有限公司 | Unlocking method and apparatus |
| CN105929827A (en) * | 2016-05-20 | 2016-09-07 | 北京地平线机器人技术研发有限公司 | Mobile robot and positioning method thereof |
| CN106155305A (en) * | 2015-05-15 | 2016-11-23 | 三星电子株式会社 | Electronic installation and control method thereof |
| CN106444415A (en) * | 2016-12-08 | 2017-02-22 | 湖北大学 | Smart home control method and system |
| CN106502381A (en) * | 2016-09-21 | 2017-03-15 | 北京光年无限科技有限公司 | A kind of multi-modal output intent of the robot for visual capacity |
| CN106527469A (en) * | 2016-12-29 | 2017-03-22 | 新奥（中国）燃气投资有限公司 | Interactive intelligent robot control system, control method and interactive intelligent robot |
| CN206363164U (en) * | 2016-12-29 | 2017-07-28 | 新奥（中国）燃气投资有限公司 | Interactive intelligent robot control system and interactive intelligent robot |
| CN107465649A (en) * | 2016-06-02 | 2017-12-12 | 中兴通讯股份有限公司 | Control method of electronic device, terminal and control system |
| CN108748172A (en) * | 2018-05-29 | 2018-11-06 | 塔米智能科技（北京）有限公司 | A kind of robot welcome method, apparatus, equipment and medium |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102681643B (en) * | 2011-03-08 | 2015-11-25 | 联想(北京)有限公司 | Pick-up unit, computing machine and detection method |
| EP2853989A1 (en) * | 2012-05-21 | 2015-04-01 | Huawei Technologies Co., Ltd. | Contactless gesture-based control method and apparatus |
| CN106012417A (en) * | 2016-07-29 | 2016-10-12 | 无锡小天鹅股份有限公司 | Washing machine and control device and control method thereof |
| CN106793397B (en) * | 2016-12-19 | 2019-10-22 | 北京小米移动软件有限公司 | Illumination control method and terminal |
| CN107493428A (en) * | 2017-08-09 | 2017-12-19 | 广东欧珀移动通信有限公司 | Filming control method and device |
-
2017
- 2017-12-29 CN CN201711478628.2A patent/CN109991859B/en active Active
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103425238A (en) * | 2012-05-21 | 2013-12-04 | 刘鸿达 | Control system cloud system with gestures as input |
| CN103729057A (en) * | 2013-12-18 | 2014-04-16 | 京东方科技集团股份有限公司 | Method and system for controlling postures of display device by using gestures |
| CN104360736A (en) * | 2014-10-30 | 2015-02-18 | 广东美的制冷设备有限公司 | Gesture-based terminal control method and system |
| CN104615004A (en) * | 2014-12-31 | 2015-05-13 | 北京海尔广科数字技术有限公司 | Intelligent household electrical appliance operating authorization control method and device |
| CN106155305A (en) * | 2015-05-15 | 2016-11-23 | 三星电子株式会社 | Electronic installation and control method thereof |
| CN104966013A (en) * | 2015-06-16 | 2015-10-07 | 努比亚技术有限公司 | Unlocking method and apparatus |
| CN105929827A (en) * | 2016-05-20 | 2016-09-07 | 北京地平线机器人技术研发有限公司 | Mobile robot and positioning method thereof |
| CN107465649A (en) * | 2016-06-02 | 2017-12-12 | 中兴通讯股份有限公司 | Control method of electronic device, terminal and control system |
| CN106502381A (en) * | 2016-09-21 | 2017-03-15 | 北京光年无限科技有限公司 | A kind of multi-modal output intent of the robot for visual capacity |
| CN106444415A (en) * | 2016-12-08 | 2017-02-22 | 湖北大学 | Smart home control method and system |
| CN106527469A (en) * | 2016-12-29 | 2017-03-22 | 新奥（中国）燃气投资有限公司 | Interactive intelligent robot control system, control method and interactive intelligent robot |
| CN206363164U (en) * | 2016-12-29 | 2017-07-28 | 新奥（中国）燃气投资有限公司 | Interactive intelligent robot control system and interactive intelligent robot |
| CN108748172A (en) * | 2018-05-29 | 2018-11-06 | 塔米智能科技（北京）有限公司 | A kind of robot welcome method, apparatus, equipment and medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109991859A (en) | 2019-07-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109991859B (en) | Gesture instruction control method and intelligent home control system | |
| CN103375880B (en) | The remote control of air-conditioner and method | |
| CN105373020B (en) | Intelligent easy sticker electric switch | |
| CN105843054A (en) | Method for controlling household devices, intelligent household system and mobile device | |
| CN106909396A (en) | A kind of interface display method and device of Intelligent housing application | |
| CN104483953A (en) | Control method and wearable electronic equipment | |
| CN104483851A (en) | Context awareness control device, system and method | |
| CN106016612B (en) | Air conditioning control method and device and air-conditioning | |
| CN110196557B (en) | Equipment control method, device, mobile terminal and storage medium | |
| CN105546748B (en) | Air-conditioning control method and device | |
| CN108061359B (en) | Air conditioner control method and device | |
| CN106647305A (en) | Control method and terminal | |
| CN110426962A (en) | A kind of control method and system of smart home device | |
| CN113339965A (en) | Method and device for air conditioner control and air conditioner | |
| CN105912632A (en) | Device service recommending method and device | |
| CN110057054A (en) | A kind of control method of air-conditioning, device, storage medium and air-conditioning | |
| CN109814395B (en) | Control method and device of electric appliance and door lock | |
| CN112696806B (en) | Air conditioner operation method and device | |
| CN105511279B (en) | Household electrical appliance long-range control method and system, household electrical appliance and server | |
| CN104880953A (en) | Control method and intelligent household control device | |
| CN105041701A (en) | Intelligent fan, and control method and control device of intelligent fan | |
| CN111306091B (en) | Intelligent household equipment, intelligent air outlet system and control method for change of air outlet section of intelligent air outlet system | |
| CN108131790A (en) | Control method, device, storage medium and the processor of air-conditioning | |
| CN112365633A (en) | Control method, device and system of household appliance and computer readable storage medium | |
| CN112015099A (en) | Permission adjusting method and device of intelligent switch, intelligent switch and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |