CN106019958B - Gesture recognition control method, gesture recognition control device and household appliance - Google Patents

Gesture recognition control method, gesture recognition control device and household appliance Download PDF

Info

Publication number
CN106019958B
CN106019958B CN201610383341.0A CN201610383341A CN106019958B CN 106019958 B CN106019958 B CN 106019958B CN 201610383341 A CN201610383341 A CN 201610383341A CN 106019958 B CN106019958 B CN 106019958B
Authority
CN
China
Prior art keywords
gesture
identity information
user identity
characteristic value
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201610383341.0A
Other languages
Chinese (zh)
Other versions
CN106019958A (en
Inventor
梁文潮
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Midea Group Co Ltd
GD Midea Air Conditioning Equipment Co Ltd
Original Assignee
Midea Group Co Ltd
GD Midea Air Conditioning Equipment Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Midea Group Co Ltd, GD Midea Air Conditioning Equipment Co Ltd filed Critical Midea Group Co Ltd
Priority to CN202010102382.4A priority Critical patent/CN111290285B/en
Priority to CN201610383341.0A priority patent/CN106019958B/en
Publication of CN106019958A publication Critical patent/CN106019958A/en
Application granted granted Critical
Publication of CN106019958B publication Critical patent/CN106019958B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B15/00—Systems controlled by a computer
    • G05B15/02—Systems controlled by a computer electric
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00—Programme-control systems
    • G05B19/02—Programme-control systems electric
    • G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/20—Pc systems
    • G05B2219/26—Pc applications
    • G05B2219/2642—Domotique, domestic, home control, automation, smart house
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Manufacturing & Machinery (AREA)
  • Quality & Reliability (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The invention provides a gesture recognition control method, a gesture recognition control device and a household appliance, wherein the gesture recognition control method comprises the following steps: when gesture actions are recognized, determining at least one characteristic value of the gesture actions, and judging whether user identity information matched with the at least one characteristic value is prestored according to the at least one characteristic value; and if the user identity information matched with at least one characteristic value is prestored, controlling the equipment to operate according to the operating parameters corresponding to the user identity information. Through the technical scheme of the invention, the condition that the user can set the equipment to the state desired by the user only by performing gesture actions for many times is avoided, so that the user experience is improved.

Description

Gesture recognition control method, gesture recognition control device and household appliance
Technical Field
The invention relates to the technical field of equipment, in particular to a gesture recognition control method, a gesture recognition control device and equipment.
Background
In the related art, a low-cost infrared gesture recognition device is constructed by two or three infrared emission tubes, photodiodes and gesture sensing chips. Firstly, the infrared transmitting tube emits modulated infrared light outwards, then the modulated infrared light is reflected back to the photodiode through an external object (such as a hand of a user), the photodiode converts a received optical signal into an electric signal and compares the electric signal with a signal of the other compensating tube and then transmits the electric signal to the gesture sensing chip, and the gesture sensing chip recognizes gesture actions according to the change trend and the change quantity of the signal.
At present, each gesture can only control equipment to perform one operation, if a power-on and power-off gesture is made to start the air conditioner, then a gesture for adjusting the temperature is made to enable the set temperature of the air conditioner to reach the set temperature required by a user, and if the air speed of the air conditioner needs to be adjusted, a gesture for adjusting the air speed needs to be made again. Therefore, the user can reach the state that the user wants to set by making several gesture actions in the process of starting up the computer every time, and the experience of the user is greatly influenced.
Therefore, how to avoid that the user can set the device to the state that the user wants only by performing the gesture for multiple times is to improve the user experience, which becomes a technical problem to be solved urgently.
Disclosure of Invention
The present invention is directed to solving at least one of the problems of the prior art or the related art.
To this end, an object of the present invention is to provide a gesture recognition control method.
Another object of the present invention is to provide a gesture recognition control device.
It is a further object of the invention to propose a device.
To achieve at least one of the above objects, according to an embodiment of a first aspect of the present invention, there is provided a gesture recognition control method including: when gesture actions are recognized, determining at least one characteristic value of the gesture actions, and judging whether user identity information matched with the at least one characteristic value is prestored according to the at least one characteristic value; and if the user identity information matched with at least one characteristic value is prestored, controlling the equipment to operate according to the operating parameters corresponding to the user identity information.
According to the gesture recognition control method provided by the embodiment of the invention, because the gesture actions performed by different users are different, for example, the speed of some users during gesture actions is higher, and the speed of some users during gesture actions is lower, the user identity information can be determined according to the characteristic values of the performed gesture actions, so that the equipment is automatically controlled according to the operation parameters corresponding to the user identity information, the condition that the equipment can be set to the state desired by the user only after the user performs gesture actions for many times is avoided, and the user experience is improved.
The gesture recognition control method according to the above embodiment of the present invention may further have the following technical features:
according to an embodiment of the present invention, the step of determining whether the user identity information matching with at least one of the feature values is prestored includes: judging the category of each feature value in at least one feature value, and judging whether each feature value meets a preset condition corresponding to the category to which each feature value belongs; if each characteristic value meets a preset condition corresponding to the characteristic value, judging that the user identity information is prestored, wherein the user identity information is information corresponding to the preset condition; and if any one of the characteristic values does not meet the corresponding preset condition, judging that the user identity information is not prestored.
According to the gesture recognition control method provided by the embodiment of the invention, if each characteristic value meets the corresponding preset condition, and the preset condition met by each characteristic value belongs to the identity information of the same user, the user identity information is stored in advance, so that the identity of the user performing the gesture action can be accurately determined.
According to one embodiment of the invention, the categories include gesture speed and gesture magnitude.
According to an embodiment of the present invention, when the category of the feature value is the gesture amplitude, the feature value is a difference between times respectively corresponding to two adjacent peaks in an intensity value curve of the infrared reflection signal when the gesture action is performed, and when the category of the feature value is the gesture speed, the feature value is a difference between times respectively corresponding to a maximum signal intensity value and a minimum signal intensity value in an ascending curve segment in the intensity value curve.
According to the gesture recognition control method provided by the embodiment of the invention, the difference value of the time corresponding to each of the two adjacent wave crests in the intensity value curve of the infrared reflection signal during the gesture action reflects the amplitude of the gesture action performed by the user, and if the difference value of the time corresponding to each of the two adjacent wave crests is larger, the amplitude of the gesture action performed by the user is larger. In addition, the smaller the difference between the time corresponding to the maximum signal intensity value and the time corresponding to the minimum signal intensity value in the ascending curve segment in the intensity value curve is, the greater the speed of the gesture action performed by the user is. Therefore, the amplitude and the speed of the gesture action performed by the user can be accurately reflected through the two difference values.
According to an embodiment of the present invention, further comprising: if the user identity information matched with at least one characteristic value does not exist, new user identity information is created for the current user, at least one characteristic value and the new user identity information are correspondingly stored, and the new user identity information and the operation parameters set by the current user are correspondingly stored.
According to the gesture recognition control method provided by the embodiment of the invention, if no user identity information matched with the characteristic value exists, which indicates that the current user does not pass through the gesture action control equipment before, new user identity information is created for the current user, and the new user identity information, the characteristic value and the set operation parameters are correspondingly stored, so that when the user passes through the gesture action control equipment again, the identity information of the user can be recognized, and the equipment can be directly controlled.
According to an embodiment of the present invention, further comprising: judging whether an instruction for changing the operation parameters of the equipment is received within the preset time for setting the operation parameters of the equipment by the current user; if the instruction for changing the operation parameters of the equipment is not received, the new user identity information and the set operation parameters are correspondingly stored; and if an instruction for changing the operation parameters of the equipment is received, the new user identity information and the changed operation parameters are correspondingly stored.
According to the gesture recognition control method provided by the embodiment of the invention, if an instruction for changing the operation parameters of the equipment is received within the preset time for setting the operation parameters of the equipment by the current user, the set operation parameters are not in accordance with the use habit of the user, and the new user identity information and the changed operation parameters are correspondingly stored, so that the stored operation parameters are the operation parameters which are most in accordance with the use habit of the user. Therefore, the next time the gesture action of the user is recognized to control the equipment, and the control of the equipment can be ensured to be more in line with the use habit of the user.
According to an embodiment of the second aspect of the present invention, there is provided a gesture recognition control apparatus including: the first judgment unit is used for determining at least one characteristic value of the gesture action when the gesture action is recognized, and judging whether user identity information matched with the at least one characteristic value is prestored according to the at least one characteristic value; and the control unit is used for controlling the equipment to operate according to the operating parameters corresponding to the user identity information if the user identity information matched with the at least one characteristic value is prestored.
According to the gesture recognition control device provided by the embodiment of the invention, because the gesture actions performed by different users are different, for example, the speed of some users during gesture actions is higher, and the speed of some users during gesture actions is lower, the user identity information can be determined according to the characteristic values of the performed gesture actions, so that the equipment is automatically controlled according to the operation parameters corresponding to the user identity information, the condition that the equipment can be set to the state desired by the user only after the user performs gesture actions for multiple times is avoided, and the user experience is improved.
According to an embodiment of the present invention, the first determining unit is specifically configured to determine a category of each of the at least one feature value, and determine whether each of the feature values satisfies a preset condition corresponding to the category to which each of the feature values belongs, if each of the feature values satisfies the preset condition corresponding thereto, it is determined that the user identity information is prestored, and the user identity information is information corresponding to the preset condition, and if any one of the feature values does not satisfy the preset condition corresponding thereto, it is determined that the user identity information is not prestored.
According to the gesture recognition control device provided by the embodiment of the invention, if each characteristic value meets the corresponding preset condition and the preset condition met by each characteristic value belongs to the identity information of the same user, the user identity information is stored in advance, so that the identity of the user performing gesture action can be accurately determined.
According to one embodiment of the invention, the categories include gesture speed and gesture magnitude.
According to an embodiment of the present invention, when the category of the feature value is the gesture amplitude, the feature value is a difference between times respectively corresponding to two adjacent peaks in an intensity value curve of the infrared reflection signal when the gesture action is performed, and when the category of the feature value is the gesture speed, the feature value is a difference between times respectively corresponding to a maximum signal intensity value and a minimum signal intensity value in an ascending curve segment in the intensity value curve.
According to the gesture recognition control device provided by the embodiment of the invention, as the difference value of the time corresponding to each of the two adjacent wave crests in the intensity value curve of the infrared reflection signal during the gesture action reflects the amplitude of the gesture action performed by the user, the larger the difference value of the time corresponding to each of the two adjacent wave crests is, the larger the amplitude of the gesture action performed by the user is. In addition, the smaller the difference between the time corresponding to the maximum signal intensity value and the time corresponding to the minimum signal intensity value in the ascending curve segment in the intensity value curve is, the greater the speed of the gesture action performed by the user is. Therefore, the amplitude and the speed of the gesture action performed by the user can be accurately reflected through the two difference values.
According to an embodiment of the present invention, further comprising: and the storage unit is used for creating new user identity information for the current user if the user identity information matched with at least one characteristic value does not exist, correspondingly storing at least one characteristic value and the new user identity information, and correspondingly storing the new user identity information and the operating parameters set by the current user.
According to the gesture recognition control device provided by the embodiment of the invention, if the user identity information matched with the characteristic value does not exist, which indicates that the current user does not pass through the gesture action control equipment before, new user identity information is created for the current user, and the new user identity information, the characteristic value and the set operation parameters are correspondingly stored, so that when the user passes through the gesture action control equipment again, the identity information of the user can be recognized, and the equipment can be directly controlled.
According to an embodiment of the present invention, further comprising: the second judging unit is used for judging whether an instruction for changing the operation parameters of the equipment is received within the preset time for setting the operation parameters of the equipment by the current user; the memory cell includes: the first storage subunit is configured to, if an instruction to change the operating parameter of the device is not received, correspondingly store the new user identity information and the set operating parameter; and the second storage subunit is used for correspondingly storing the new user identity information and the changed operation parameters if an instruction for changing the operation parameters of the equipment is received.
According to the gesture recognition control device provided by the embodiment of the invention, if an instruction for changing the operation parameters of the equipment is received within the preset time for setting the operation parameters of the equipment by the current user, the set operation parameters are not in accordance with the use habit of the user, and the new user identity information and the changed operation parameters are correspondingly stored, so that the stored operation parameters are the operation parameters which are in accordance with the use habit of the user. Therefore, the next time the gesture action of the user is recognized to control the equipment, and the control of the equipment can be ensured to be more in line with the use habit of the user.
According to an embodiment of the third aspect of the present invention, an apparatus is provided, which includes the gesture recognition control device in any one of the above technical solutions, so that the apparatus has the same technical effects as the gesture recognition control device in any one of the above technical solutions, and details are not repeated here.
Additional aspects and advantages of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.
Drawings
The above and/or additional aspects and advantages of the present invention will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
FIG. 1 shows a schematic flow diagram of a gesture recognition control method according to one embodiment of the present invention;
FIG. 2 shows a schematic diagram of an intensity value curve of an infrared reflected signal according to an embodiment of the invention;
FIG. 3 shows a schematic flow diagram of a gesture recognition control method according to another embodiment of the invention;
FIG. 4 shows a schematic block diagram of a gesture recognition control apparatus according to an embodiment of the present invention;
fig. 5 shows a schematic block diagram of an apparatus according to an embodiment of the invention.
Detailed Description
In order that the above objects, features and advantages of the present invention can be more clearly understood, a more particular description of the invention will be rendered by reference to the appended drawings. It should be noted that the embodiments and features of the embodiments of the present application may be combined with each other without conflict.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention, however, the present invention may be practiced in other ways than those specifically described herein, and therefore the scope of the present invention is not limited by the specific embodiments disclosed below.
Fig. 1 shows a schematic flow diagram of a gesture recognition control method according to an embodiment of the invention.
As shown in fig. 1, a gesture recognition control method according to an embodiment of the present invention includes:
and 102, when the gesture action is recognized, determining at least one characteristic value of the gesture action, and judging whether user identity information matched with the at least one characteristic value is prestored according to the at least one characteristic value.
Further, step 102 comprises: judging the category of each characteristic value in at least one characteristic value, and judging whether each characteristic value meets a preset condition corresponding to the category to which each characteristic value belongs; if each characteristic value meets the corresponding preset condition, judging that the user identity information is prestored, wherein the user identity information is the information corresponding to the preset condition; and if any characteristic value does not meet the corresponding preset condition, judging that no user identity information is prestored.
Further, the categories include gesture speed and gesture magnitude.
Further, when the type of the feature value is gesture amplitude, the feature value is a difference between times corresponding to two adjacent peaks in an intensity value curve of the infrared reflection signal when the gesture action is performed, and when the type of the feature value is gesture speed, the feature value is a difference between times corresponding to a maximum signal intensity value and a minimum signal intensity value in a rising curve segment in the intensity value curve.
As shown in fig. 2, T2 is a difference between times corresponding to two adjacent peaks in an intensity value curve of the infrared reflection signal when the user 1 performs a gesture motion, where two points on the intensity value curve where the two adjacent peaks are located are (X1, Y1) and (X2, Y2), T1 is a difference between times corresponding to a maximum signal intensity value and a minimum signal intensity value in a rising curve segment in the intensity value curve of the infrared reflection signal when the user 1 performs the gesture motion, T2 'is a difference between times corresponding to two adjacent peaks in the intensity value curve of the infrared reflection signal when the user 2 performs the gesture motion, and T1' is a difference between times corresponding to a maximum signal intensity value and a minimum signal intensity value in a rising curve segment in the intensity value curve of the infrared reflection signal when the user 2 performs the gesture motion.
In the above scheme, since the difference between the times corresponding to the two adjacent peaks in the intensity value curve of the infrared reflection signal during the gesture motion reflects the amplitude of the gesture motion performed by the user, if the difference between the times corresponding to the two adjacent peaks is larger, the amplitude of the gesture motion performed by the user is larger. In addition, the smaller the difference between the time corresponding to the maximum signal intensity value and the time corresponding to the minimum signal intensity value in the ascending curve segment in the intensity value curve is, the greater the speed of the gesture action performed by the user is.
The first embodiment is as follows: the method comprises the steps of collecting intensity value curves of infrared reflection signals of A, B, C three users during gesture actions, respectively extracting time differences corresponding to the maximum signal intensity value and the minimum signal intensity value in an ascending curve section in the intensity value curve of each user, and obtaining differences of A, B, C three users, wherein the differences are respectively M1, M2 and M3, the types of the differences belong to gesture speeds, and preset conditions corresponding to the gesture speeds comprise: A. b, C, the preset conditions corresponding to the gesture speed of the user A are more than M1-delta M and less than M1+ delta M, the preset conditions corresponding to the gesture speed of the user B are more than M2-delta M and less than M2+ delta M, and the preset conditions corresponding to the gesture speed of the user C are more than M3-delta M and less than M3+ delta M. And respectively extracting the time difference values corresponding to two adjacent wave crests in the intensity value curve of each user, wherein the obtained time difference values of A, B, C three users are respectively N1, N2 and N3, the category of the difference values belongs to gesture amplitude, and the preset condition corresponding to the gesture amplitude comprises the following steps: A. b, C, the gesture amplitude of the user A corresponds to a preset condition that is larger than N1-delta N and smaller than N1+ delta N, the gesture amplitude of the user B corresponds to a preset condition that is larger than N2-delta N and smaller than N2+ delta N, and the gesture amplitude of the user C corresponds to a preset condition that is larger than N3-delta N and smaller than N3+ delta N.
When a current user carries out gesture motion, acquiring an intensity value curve of an infrared reflection signal when the current user carries out the gesture motion, extracting a difference value M of time corresponding to the maximum signal intensity value and the minimum signal intensity value in a rising curve section in the intensity value curve respectively, and extracting a difference value N of time corresponding to two adjacent wave crests in the intensity value curve respectively, wherein if M is in a range which is larger than M2-delta M and smaller than M2+ delta M, and N is in a range which is larger than N2-delta N and smaller than N2 +/delta N, the range which is larger than M2-delta M and smaller than M2 delta M and the range which is larger than N2-delta N and smaller than N2 +/delta N belong to a user B, and therefore the user currently carrying out the gesture motion is judged to be the user B.
Example two: the method comprises the steps of collecting intensity value curves of infrared reflection signals of A, B, C three users during gesture motions, respectively extracting time differences corresponding to the maximum signal intensity value and the minimum signal intensity value in the ascending curve segment in the intensity value curve of each user, and obtaining differences of A, B, C three users, namely M1, M2 and M3, wherein the types of the differences belong to gesture speeds. And respectively extracting the time difference values corresponding to two adjacent wave crests in the intensity value curve of each user to obtain A, B, C difference values of the three users, namely N1, N2 and N3, wherein the type of the difference values belongs to gesture amplitude.
When a current user carries out gesture motion, collecting an intensity value curve of an infrared reflection signal when the gesture motion is carried out, extracting time difference values M corresponding to the maximum signal intensity value and the minimum signal intensity value in a rising curve section in the intensity value curve respectively, and extracting time difference values N corresponding to two adjacent wave crests in the intensity value curve respectively. Respectively calculating the difference value between M and each value in M1, M2 and M3, respectively calculating the difference value between N and each value in N1, N2 and N3, if the difference value between M and M1 is smaller than a first preset value, the difference value between N and N1 is smaller than a second preset value, and M1 and N1 both correspond to the user A, indicating that the gesture action performed by the current user is similar to the gesture action performed by the user A, and judging that the user performing the gesture action is the user A.
And 104, if the user identity information matched with the at least one characteristic value is prestored, controlling the equipment to operate according to the operating parameters corresponding to the user identity information.
The first embodiment is as follows: when the current user carries out gesture action, the gesture action is recognized as the gesture action of starting, the user carrying out the gesture action is determined to be the user A according to the characteristic value of the gesture action, the temperature set by the user A during starting is directly called, and preferably, the temperature is set by the user A during the latest starting. Therefore, after the control equipment is started, the equipment can be directly controlled to operate at the temperature, so that the temperature of the equipment during starting is more in accordance with the personal requirements of the user, and the condition that the user needs to perform gesture action to adjust the temperature when the current set temperature of the equipment does not meet the requirements of the user after the gesture action of starting is performed by the user is avoided.
Example two: if the current user performs a gesture action, recognizes the gesture action as a gesture action for switching to the heating mode, and determines that the user performing the gesture action is a user B according to a characteristic value of the gesture action, the wind speed set by the user B when switching to the heating mode is directly called, and preferably, the wind speed is the wind speed set by the user B when switching to the heating mode last time. Therefore, when the control device is switched to the heating mode, the direct control device operates at the wind speed, and resetting of the wind speed in switching to the heating mode is avoided.
Further, if there is no user identity information that matches with at least one of the feature values, new user identity information is created for the current user, the at least one feature value is stored in correspondence with the new user identity information, and the new user identity information is stored in correspondence with the operating parameters set by the current user, so that when the user controls the device through the gesture again, the user identity information can be recognized, and the device can be directly controlled.
Wherein, the user identity information may be a character string, for example, A, B, C, D, when creating new user identity information, the new user identity information is E, and for example, 001, 002, 003, 004, when creating new user identity information, the new user identity information is 005. Of course, the user identity information may also be a facial image of the user collected when the user performs a gesture.
Further, judging whether an instruction for changing the operation parameters of the equipment is received within the preset time for setting the operation parameters of the equipment by the current user; if the instruction for changing the operating parameters of the equipment is not received, storing the new user identity information and the set operating parameters correspondingly; and if an instruction for changing the operating parameters of the equipment is received, storing the new user identity information and the changed operating parameters correspondingly so that the stored operating parameters are the operating parameters which are most in line with the use habits of the user. Therefore, the next time the gesture action of the user is recognized to control the equipment, and the control of the equipment can be ensured to be more in line with the use habit of the user.
In the technical scheme, because the gesture actions performed by different users are different, for example, the speed of some users during the gesture actions is high, and the speed of some users during the gesture actions is low, the user identity information can be determined according to the characteristic values of the performed gesture actions, so that the equipment is automatically controlled according to the running parameters corresponding to the user identity information, the condition that the equipment can be set to the state desired by the user only when the user performs the gesture actions for many times is avoided, and the user experience is improved.
Fig. 3 shows a schematic flow diagram of a gesture recognition control method according to another embodiment of the invention.
As shown in fig. 3, a gesture recognition control method according to another embodiment of the present invention includes:
step 302, an intensity value curve of the infrared reflection signal is collected for a period of time.
Step 304, determining whether the gesture is a power-on gesture, if so, entering step 306, otherwise, entering step 302 again.
And step 306, extracting the characteristic values of the speed and the amplitude of the gesture action. The characteristic value of the amplitude refers to the difference of the time corresponding to two adjacent wave crests in the intensity value curve of the infrared reflection signal when the gesture action is performed, and the characteristic value of the speed refers to the difference of the time corresponding to the maximum signal intensity value and the minimum signal intensity value in the rising curve section in the intensity value curve.
Step 308, searching whether a matched characteristic value exists in the memory, and if so, entering step 312, otherwise, entering step 310.
And step 310, creating new user identity information and storing the operating parameters of the air conditioner.
Step 312, invoking an operation parameter corresponding to the user identity information, and controlling the air conditioner to operate according to the operation parameter, wherein the user identity information is identity information corresponding to the matched speed and amplitude.
And step 314, judging whether the operation parameters of the air conditioner are changed within the preset time, if so, entering step 316, otherwise, ending the process.
Step 316, update and save the operating parameters.
Fig. 4 shows a schematic block diagram of a gesture recognition control apparatus according to an embodiment of the present invention.
As shown in fig. 4, the gesture recognition control apparatus 400 according to the embodiment of the present invention includes: a first judgment unit 402 and a control unit 404.
The first determining unit 402 is configured to determine at least one feature value of the gesture motion when the gesture motion is recognized, and determine whether user identity information matching with the at least one feature value is prestored according to the at least one feature value.
Further, the first determining unit 402 is specifically configured to determine a category of each feature value in the at least one feature value, and determine whether each feature value satisfies a preset condition corresponding to the category to which each feature value belongs, if each feature value satisfies the preset condition corresponding to the feature value, it is determined that the user identity information is prestored, and the user identity information is information corresponding to the preset condition, and if any feature value does not satisfy the preset condition corresponding to the feature value, it is determined that the user identity information is not prestored.
Further, the categories include gesture speed and gesture magnitude.
Further, when the type of the feature value is gesture amplitude, the feature value is a difference between times corresponding to two adjacent peaks in an intensity value curve of the infrared reflection signal when the gesture action is performed, and when the type of the feature value is gesture speed, the feature value is a difference between times corresponding to a maximum signal intensity value and a minimum signal intensity value in a rising curve segment in the intensity value curve.
In the above scheme, since the difference between the times corresponding to the two adjacent peaks in the intensity value curve of the infrared reflection signal during the gesture motion reflects the amplitude of the gesture motion performed by the user, if the difference between the times corresponding to the two adjacent peaks is larger, the amplitude of the gesture motion performed by the user is larger. In addition, the smaller the difference between the time corresponding to the maximum signal intensity value and the time corresponding to the minimum signal intensity value in the ascending curve segment in the intensity value curve is, the greater the speed of the gesture action performed by the user is. Therefore, the amplitude and the speed of the gesture action performed by the user can be accurately reflected through the two difference values.
The first embodiment is as follows: the method comprises the steps of collecting intensity value curves of infrared reflection signals of A, B, C three users during gesture actions, respectively extracting time differences corresponding to the maximum signal intensity value and the minimum signal intensity value in an ascending curve section in the intensity value curve of each user, and obtaining differences of A, B, C three users, wherein the differences are respectively M1, M2 and M3, the types of the differences belong to gesture speeds, and preset conditions corresponding to the gesture speeds comprise: A. b, C, the preset conditions corresponding to the gesture speed of the user A are more than M1-delta M and less than M1+ delta M, the preset conditions corresponding to the gesture speed of the user B are more than M2-delta M and less than M2+ delta M, and the preset conditions corresponding to the gesture speed of the user C are more than M3-delta M and less than M3+ delta M. And respectively extracting the time difference values corresponding to two adjacent wave crests in the intensity value curve of each user, wherein the obtained time difference values of A, B, C three users are respectively N1, N2 and N3, the category of the difference values belongs to gesture amplitude, and the preset condition corresponding to the gesture amplitude comprises the following steps: A. b, C, the gesture amplitude of the user A corresponds to a preset condition that is larger than N1-delta N and smaller than N1+ delta N, the gesture amplitude of the user B corresponds to a preset condition that is larger than N2-delta N and smaller than N2+ delta N, and the gesture amplitude of the user C corresponds to a preset condition that is larger than N3-delta N and smaller than N3+ delta N.
When a current user carries out gesture motion, acquiring an intensity value curve of an infrared reflection signal when the current user carries out the gesture motion, extracting a difference value M of time corresponding to the maximum signal intensity value and the minimum signal intensity value in a rising curve section in the intensity value curve respectively, and extracting a difference value N of time corresponding to two adjacent wave crests in the intensity value curve respectively, wherein if M is in a range which is larger than M2-delta M and smaller than M2+ delta M, and N is in a range which is larger than N2-delta N and smaller than N2 +/delta N, the range which is larger than M2-delta M and smaller than M2 delta M and the range which is larger than N2-delta N and smaller than N2 +/delta N belong to a user B, and therefore the user currently carrying out the gesture motion is judged to be the user B.
Example two: the method comprises the steps of collecting intensity value curves of infrared reflection signals of A, B, C three users during gesture motions, respectively extracting time differences corresponding to the maximum signal intensity value and the minimum signal intensity value in the ascending curve segment in the intensity value curve of each user, and obtaining differences of A, B, C three users, namely M1, M2 and M3, wherein the types of the differences belong to gesture speeds. And respectively extracting the time difference values corresponding to two adjacent wave crests in the intensity value curve of each user to obtain A, B, C difference values of the three users, namely N1, N2 and N3, wherein the type of the difference values belongs to gesture amplitude.
When a current user carries out gesture motion, collecting an intensity value curve of an infrared reflection signal when the gesture motion is carried out, extracting time difference values M corresponding to the maximum signal intensity value and the minimum signal intensity value in a rising curve section in the intensity value curve respectively, and extracting time difference values N corresponding to two adjacent wave crests in the intensity value curve respectively. Respectively calculating the difference value between M and each value in M1, M2 and M3, respectively calculating the difference value between N and each value in N1, N2 and N3, if the difference value between M and M1 is smaller than a first preset value, the difference value between N and N1 is smaller than a second preset value, and M1 and N1 both correspond to the user A, indicating that the gesture action performed by the current user is similar to the gesture action performed by the user A, and judging that the user performing the gesture action is the user A.
A control unit 404, configured to control the device to operate according to an operation parameter corresponding to the user identity information if the user identity information matching with the at least one feature value is prestored.
The first embodiment is as follows: when the current user carries out gesture action, the gesture action is recognized as the gesture action of starting, the user carrying out the gesture action is determined to be the user A according to the characteristic value of the gesture action, the temperature set by the user A during starting is directly called, and preferably, the temperature is set by the user A during the latest starting. Therefore, after the control equipment is started, the equipment can be directly controlled to operate at the temperature, so that the temperature of the equipment during starting is more in accordance with the personal requirements of the user, and the condition that the user needs to perform gesture action to adjust the temperature when the current set temperature of the equipment does not meet the requirements of the user after the gesture action of starting is performed by the user is avoided.
Example two: if the current user performs a gesture action, recognizes the gesture action as a gesture action for switching to the heating mode, and determines that the user performing the gesture action is a user B according to a characteristic value of the gesture action, the wind speed set by the user B when switching to the heating mode is directly called, and preferably, the wind speed is the wind speed set by the user B when switching to the heating mode last time. Therefore, when the control device is switched to the heating mode, the direct control device operates at the wind speed, and resetting of the wind speed in switching to the heating mode is avoided.
Further, the gesture recognition control device 400 further includes: the storage unit 406 is configured to create new user identity information for the current user if there is no user identity information that matches the at least one feature value, store the at least one feature value and the new user identity information correspondingly, and store the new user identity information and the operating parameter set by the current user correspondingly. Therefore, when the user controls the equipment through the gesture again, the identity information of the user can be recognized, and the equipment can be directly controlled.
Wherein, the user identity information may be a character string, for example, A, B, C, D, when creating new user identity information, the new user identity information is E, and for example, 001, 002, 003, 004, when creating new user identity information, the new user identity information is 005. Of course, the user identity information may also be a facial image of the user collected when the user performs a gesture.
Further, the gesture recognition control device 400 further includes: the second judging unit 408 is configured to judge whether an instruction for changing the operation parameter of the device is received within a preset time for setting the operation parameter of the device by the current user; the storage unit 406 includes: a first storage subunit 4062, configured to, if an instruction to change an operating parameter of the device is not received, correspondingly store the new user identity information and the set operating parameter; the second storage sub-unit 4064 is configured to, if an instruction to change an operation parameter of the device is received, store the new user identity information and the changed operation parameter correspondingly.
If an instruction for changing the operating parameters of the equipment is received within the preset time for setting the operating parameters of the equipment by the current user, the set operating parameters do not conform to the use habit of the user, and the new user identity information and the changed operating parameters are correspondingly stored, so that the stored operating parameters are the operating parameters which most conform to the use habit of the user. Therefore, the next time the gesture action of the user is recognized to control the equipment, and the control of the equipment can be ensured to be more in line with the use habit of the user.
In the technical scheme, because the gesture actions performed by different users are different, for example, the speed of some users during the gesture actions is high, and the speed of some users during the gesture actions is low, the user identity information can be determined according to the characteristic values of the performed gesture actions, so that the equipment is automatically controlled according to the running parameters corresponding to the user identity information, the condition that the equipment can be set to the state desired by the user only when the user performs the gesture actions for many times is avoided, and the user experience is improved.
Fig. 5 shows a schematic block diagram of an apparatus according to an embodiment of the invention.
As shown in fig. 5, the apparatus 500 according to the embodiment of the present invention includes the gesture recognition control device 400 in any of the above technical solutions, and therefore, the apparatus 500 has the same technical effects as the gesture recognition control device 400 in any of the above technical solutions, and is not described again here.
Wherein the apparatus 500 comprises: household appliances, intelligent household equipment, for example, household appliances include air conditioner, refrigerator, TV set, air purifier etc. and intelligent household equipment includes intelligent cupboard, intelligent light etc..
The technical scheme of the invention is described in detail in combination with the drawings, and through the technical scheme of the invention, the situation that the user can set the equipment to the state desired by the user only by performing gesture actions for many times is avoided, so that the user experience is improved.
In the present invention, the terms "first", "second" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance; the term "plurality" means two or more. The specific meanings of the above terms in the present invention can be understood by those skilled in the art according to specific situations.
The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims (6)

1. A gesture recognition control method, comprising:
when gesture actions are recognized, determining at least one characteristic value of the gesture actions, and judging whether user identity information matched with the at least one characteristic value is prestored according to the at least one characteristic value;
if the user identity information matched with at least one characteristic value is prestored, controlling the equipment to operate according to the operating parameters corresponding to the user identity information;
further comprising:
if the user identity information matched with at least one characteristic value does not exist, new user identity information is created for the current user, at least one characteristic value and the new user identity information are correspondingly stored, and the new user identity information and the operation parameters set by the current user are correspondingly stored;
the step of judging whether the user identity information matched with at least one characteristic value is prestored comprises the following steps:
judging the category of each feature value in at least one feature value, and judging whether each feature value meets a preset condition corresponding to the category to which each feature value belongs;
if each characteristic value meets a preset condition corresponding to the characteristic value, judging that the user identity information is prestored, wherein the user identity information is information corresponding to the preset condition;
if any one of the characteristic values does not meet the corresponding preset condition, judging that the user identity information is not prestored;
the categories include gesture speed and gesture magnitude;
when the type of the characteristic value is the gesture amplitude, the characteristic value is a time difference value corresponding to each of two adjacent wave crests in an intensity value curve of the infrared reflection signal during the gesture action, and when the type of the characteristic value is the gesture speed, the characteristic value is a time difference value corresponding to each of a maximum signal intensity value and a minimum signal intensity value in an ascending curve section in the intensity value curve.
2. The gesture recognition control method according to claim 1, further comprising:
judging whether an instruction for changing the operation parameters of the equipment is received within the preset time for setting the operation parameters of the equipment by the current user;
if the instruction for changing the operation parameters of the equipment is not received, the new user identity information and the set operation parameters are correspondingly stored;
and if an instruction for changing the operation parameters of the equipment is received, the new user identity information and the changed operation parameters are correspondingly stored.
3. A gesture recognition control apparatus, comprising:
the first judgment unit is used for determining at least one characteristic value of the gesture action when the gesture action is recognized, and judging whether user identity information matched with the at least one characteristic value is prestored according to the at least one characteristic value;
the control unit is used for controlling the equipment to operate according to the operating parameters corresponding to the user identity information if the user identity information matched with at least one characteristic value is prestored;
further comprising:
the storage unit is used for creating new user identity information for the current user if the user identity information matched with at least one characteristic value does not exist, correspondingly storing at least one characteristic value and the new user identity information, and correspondingly storing the new user identity information and the operating parameters set by the current user;
the first determination unit is specifically configured to,
judging the category of each characteristic value in at least one characteristic value, judging whether each characteristic value meets a preset condition corresponding to the category to which each characteristic value belongs, if so, judging that the user identity information is prestored, wherein the user identity information is information corresponding to the preset condition, and if any one characteristic value does not meet the preset condition corresponding to the characteristic value, judging that the user identity information is not prestored;
the categories include gesture speed and gesture magnitude;
when the type of the characteristic value is the gesture amplitude, the characteristic value is a time difference value corresponding to each of two adjacent wave crests in an intensity value curve of the infrared reflection signal during the gesture action, and when the type of the characteristic value is the gesture speed, the characteristic value is a time difference value corresponding to each of a maximum signal intensity value and a minimum signal intensity value in an ascending curve section in the intensity value curve.
4. The gesture recognition control device according to claim 3, further comprising:
the second judging unit is used for judging whether an instruction for changing the operation parameters of the equipment is received within the preset time for setting the operation parameters of the equipment by the current user;
the memory cell includes:
the first storage subunit is configured to, if an instruction to change the operating parameter of the device is not received, correspondingly store the new user identity information and the set operating parameter;
and the second storage subunit is used for correspondingly storing the new user identity information and the changed operation parameters if an instruction for changing the operation parameters of the equipment is received.
5. A household appliance, characterized in that it comprises: gesture recognition control means according to claim 3 or 4.
6. The utility model provides an intelligent household equipment which characterized in that includes: gesture recognition control means according to claim 3 or 4.
CN201610383341.0A 2016-05-31 2016-05-31 Gesture recognition control method, gesture recognition control device and household appliance Active CN106019958B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202010102382.4A CN111290285B (en) 2016-05-31 2016-05-31 Gesture recognition control method, gesture recognition control device and equipment
CN201610383341.0A CN106019958B (en) 2016-05-31 2016-05-31 Gesture recognition control method, gesture recognition control device and household appliance

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610383341.0A CN106019958B (en) 2016-05-31 2016-05-31 Gesture recognition control method, gesture recognition control device and household appliance

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN202010102382.4A Division CN111290285B (en) 2016-05-31 2016-05-31 Gesture recognition control method, gesture recognition control device and equipment

Publications (2)

Publication Number Publication Date
CN106019958A CN106019958A (en) 2016-10-12
CN106019958B true CN106019958B (en) 2021-08-31

Family

ID=57093185

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201610383341.0A Active CN106019958B (en) 2016-05-31 2016-05-31 Gesture recognition control method, gesture recognition control device and household appliance
CN202010102382.4A Active CN111290285B (en) 2016-05-31 2016-05-31 Gesture recognition control method, gesture recognition control device and equipment

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN202010102382.4A Active CN111290285B (en) 2016-05-31 2016-05-31 Gesture recognition control method, gesture recognition control device and equipment

Country Status (1)

Country Link
CN (2) CN106019958B (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107742069A (en) * 2017-09-18 2018-02-27 广东美的制冷设备有限公司 terminal control method, device and storage medium
CN107655154A (en) * 2017-09-18 2018-02-02 广东美的制冷设备有限公司 Terminal control method, air conditioner and computer-readable recording medium
CN108595007A (en) * 2018-04-25 2018-09-28 四川斐讯信息技术有限公司 The method and system of wireless relay based on gesture identification, wireless routing device
CN111638651A (en) * 2020-06-02 2020-09-08 深圳市欧瑞博科技股份有限公司 Intelligent household control panel, setting method thereof, server and storage medium
CN112379776A (en) * 2020-11-23 2021-02-19 南京科盈信息科技有限公司 Control method for improving recognition accuracy of gesture recognition system in exhibition hall

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103034429A (en) * 2011-10-10 2013-04-10 北京千橡网景科技发展有限公司 Identity authentication method and device for touch screen
CN103136508A (en) * 2011-12-05 2013-06-05 联想(北京)有限公司 Gesture identification method and electronic equipment
CN103246836A (en) * 2013-04-03 2013-08-14 李健 Finger slide identification unlocking method for touch screen
CN103761466A (en) * 2014-02-14 2014-04-30 上海云享科技有限公司 Method and device for identity authentication
WO2015008164A2 (en) * 2013-06-27 2015-01-22 Eyesight Mobile Technologies Ltd. Systems and methods of direct pointing detection for interaction with a digital device

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8693726B2 (en) * 2011-06-29 2014-04-08 Amazon Technologies, Inc. User identification by gesture recognition
US20130159939A1 (en) * 2011-10-12 2013-06-20 Qualcomm Incorporated Authenticated gesture recognition
CN103399632B (en) * 2013-07-16 2018-01-23 深圳市金立通信设备有限公司 The method and mobile terminal of a kind of gesture control
CN104392160A (en) * 2014-09-22 2015-03-04 贵阳朗玛信息技术股份有限公司 Identity authentication method and identity authentication device
CN104834907A (en) * 2015-05-06 2015-08-12 江苏惠通集团有限责任公司 Gesture recognition method, apparatus, device and operation method based on gesture recognition
CN105353876B (en) * 2015-11-09 2018-07-06 深圳市云腾智慧科技有限公司 A kind of space gesture control system for identifying and method based on multiple spot light sensation

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103034429A (en) * 2011-10-10 2013-04-10 北京千橡网景科技发展有限公司 Identity authentication method and device for touch screen
CN103136508A (en) * 2011-12-05 2013-06-05 联想(北京)有限公司 Gesture identification method and electronic equipment
CN103246836A (en) * 2013-04-03 2013-08-14 李健 Finger slide identification unlocking method for touch screen
WO2015008164A2 (en) * 2013-06-27 2015-01-22 Eyesight Mobile Technologies Ltd. Systems and methods of direct pointing detection for interaction with a digital device
CN103761466A (en) * 2014-02-14 2014-04-30 上海云享科技有限公司 Method and device for identity authentication

Also Published As

Publication number Publication date
CN111290285A (en) 2020-06-16
CN111290285B (en) 2023-04-07
CN106019958A (en) 2016-10-12

Similar Documents

Publication Publication Date Title
CN106019958B (en) Gesture recognition control method, gesture recognition control device and household appliance
EP3599605B1 (en) Home appliance and speech recognition server system and method for controlling thereof
EP3958070A1 (en) Smart home device control method, medium, mobile terminal, and apparatus
CN109974235B (en) Method and device for controlling household appliance and household appliance
EP2375527B1 (en) Demand Response Method and Demand Response System
CN106369755B (en) Air conditioner control method and device of terminal and intelligent terminal
JP6140214B2 (en) CONTROL DEVICE, CONTROL DEVICE CONTROL METHOD, CONTROL SYSTEM, ENVIRONMENT CONTROL DEVICE, AND CONTROL PROGRAM
CN106839290A (en) The control method and control device and air-conditioner of gesture identification
CN104483851A (en) Context awareness control device, system and method
CN103268150A (en) Intelligent robot management and control system and intelligent robot management and control method on basis of facial expression recognition
CN106980359B (en) Household appliance control method and system, head-mounted device and server
CN105446156A (en) Method, device and system for controlling household electric appliance based on artificial intelligence
CN103686339A (en) Self-adaptive volume adjustment method and device
CN112230611A (en) Control method and device of intelligent household equipment, electronic equipment and storage medium
CN110491379B (en) Voice control method and voice controller of household appliance and air conditioner
US20220100464A1 (en) Methods and systems for execution of voice commands
EP2651078B1 (en) Method and apparatus for managing electronic appliance
CN107241247A (en) Method for network access and device, the intelligent appliance of intelligent appliance
CN107742520B (en) Voice control method, device and system
CN106020486B (en) Control method, device and equipment of infrared gesture recognition device
CN108644969A (en) Method, device and system for controlling compressor and air conditioner
CN110708219A (en) Household appliance control method and household appliance
EP3779618B1 (en) Smart apparatus control method, apparatus, computer storage medium, and smart apparatus control apparatus
CN104238746A (en) Information processing method and electronic equipment
CN114999484A (en) Election method and system of interactive voice equipment

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant