CN106225174B - Air conditioner control method and system and air conditioner - Google Patents
Air conditioner control method and system and air conditioner Download PDFInfo
- Publication number
- CN106225174B CN106225174B CN201610703667.7A CN201610703667A CN106225174B CN 106225174 B CN106225174 B CN 106225174B CN 201610703667 A CN201610703667 A CN 201610703667A CN 106225174 B CN106225174 B CN 106225174B
- Authority
- CN
- China
- Prior art keywords
- information
- image information
- air conditioner
- current image
- current
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 39
- 230000003993 interaction Effects 0.000 claims abstract description 18
- 230000007613 environmental effect Effects 0.000 claims description 16
- 238000013507 mapping Methods 0.000 claims description 16
- 238000012545 processing Methods 0.000 claims description 14
- 238000001514 detection method Methods 0.000 claims description 13
- 238000000605 extraction Methods 0.000 claims description 6
- 230000000694 effects Effects 0.000 abstract description 4
- 230000009471 action Effects 0.000 description 14
- 230000002452 interceptive effect Effects 0.000 description 6
- 230000008569 process Effects 0.000 description 6
- 238000004891 communication Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Images
Landscapes
- Air Conditioning Control Device (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses an air conditioner control method and system and an air conditioner, wherein the method comprises the following steps: collecting current image information; reading current image information, acquiring corresponding voice prompt information according to the current image information, and outputting the voice prompt information; broadcasting voice prompt information; receiving an operation signal input according to the voice prompt information, and controlling the running state of the air conditioner according to the received operation signal; wherein, the form of the operation signal is an image form and/or a voice form. The purpose that the user can be automatically reminded according to the collected current scene is achieved through the combination of image recognition and voice, the effect of effective interaction between the air conditioner and the user is achieved, the flexibility of a control mode is improved, and the problem that the traditional air conditioner has certain limitation when adopting voice control or gesture control based on image recognition is finally effectively solved.
Description
Technical Field
The invention relates to the technical field of household appliance control, in particular to an air conditioner control method and system and an air conditioner.
Background
With the development of smart home technology, the control mode of home appliances has gradually changed from a contact control (e.g., remote controller) mode to a non-contact control mode. Such as: when the air conditioner is controlled, the non-contact control mode of the air conditioner is usually realized by two modes of voice control or gesture control based on image recognition at present. However, when the air conditioner is controlled by the traditional voice control mode and the gesture control mode based on the image recognition, the traditional voice control mode and the gesture control mode based on the image recognition both adopt a single control mode generally, and the interaction function between the air conditioner and a user cannot be realized, so that the traditional voice control mode or the gesture control mode based on the image recognition has certain limitation.
Disclosure of Invention
Therefore, it is necessary to provide an air conditioner control method and system and an air conditioner, aiming at the problem that the conventional air conditioner has certain limitations when adopting voice control or gesture control based on image recognition.
The invention provides an air conditioner control method for realizing the aim, which comprises the following steps:
collecting current image information;
reading the current image information, acquiring corresponding voice prompt information according to the current image information, and outputting the voice prompt information;
broadcasting the voice prompt information;
receiving an operation signal input according to the voice prompt information, and controlling the running state of the air conditioner according to the received operation signal;
wherein the operation signal is in the form of an image and/or a voice.
In one embodiment, the reading the current image information and obtaining the corresponding voice prompt information according to the current image information includes the following steps:
identifying the current image information and judging whether the current image information is effective information or not;
when the current image information is judged to be effective information, the step of acquiring corresponding voice prompt information according to the current image information is executed;
and when the current image information is judged to be invalid information, returning to the step of acquiring the current image information, and continuing to acquire the image information.
In one embodiment, the determining whether the current image information is valid information includes the following steps:
extracting the characteristics of the current image information, and matching the characteristics of the current image information with each image information in a pre-stored image information base;
when the matching is successful, determining the current image information as effective information;
and when the matching is unsuccessful, determining that the current image information is invalid information.
In one embodiment, when obtaining the corresponding voice prompt information according to the current image information, the method further includes the following steps:
acquiring the current state of the air conditioner and the current environmental condition in the space where the air conditioner is located;
comprehensively analyzing and processing the current image information, the current state of the air conditioner and the current environmental condition to obtain corresponding indication information;
and acquiring the corresponding voice prompt information according to the indication information.
In one embodiment, after controlling the operation state of the air conditioner according to the operation signal, the method further comprises the steps of obtaining the current operation state of the air conditioner and feeding back the current operation state through voice.
Correspondingly, the invention also provides an air conditioner control system, which comprises an image acquisition device, a processor, a voice broadcast device and a voice acquisition device;
the image acquisition device, the voice broadcast device and the voice acquisition device are all electrically connected with the processor; moreover, the processor internally comprises an interaction control module;
the image acquisition device is used for acquiring current image information;
the interactive control module is used for reading the current image information, acquiring corresponding voice prompt information according to the current image information, and outputting the voice prompt information to the voice broadcasting device;
the voice broadcasting device is used for broadcasting the voice prompt information;
the interactive control module is also used for receiving an operation signal input according to the voice prompt information and controlling the running state of the air conditioner according to the received operation signal;
wherein the operation signal is acquired by the image acquisition device and/or the voice acquisition device.
In one embodiment, the processor further comprises an image recognition module;
the image identification module is used for identifying the current image information and judging whether the current image information is effective information or not;
the interactive control module is further configured to, when the image recognition module determines that the current image information is valid information, obtain corresponding voice prompt information according to the current image information, and output the voice prompt information to the voice broadcast device;
and the image identification module is also used for returning to the image acquisition device when the current image information is judged to be invalid information, and the image acquisition device continues to acquire the image information.
In one embodiment, the image recognition module comprises a feature extraction sub-module and a matching judgment sub-module;
the feature extraction submodule is used for extracting features of the current image information;
the matching judgment sub-module is used for matching the characteristics of the current image information with the image information in a pre-stored image information base;
the matching judgment sub-module is also used for determining the current image information as effective information when the matching is successful; and when the matching is unsuccessful, determining the current image information as invalid information.
In one embodiment, the system further comprises a state detection module and an environment detection module which are electrically connected with the processor;
the interaction control module comprises a comprehensive processing sub-module and a prompt information acquisition sub-module;
the state detection module is used for detecting and acquiring the current state of the air conditioner;
the environment detection module is used for detecting and acquiring the current environment condition in the space where the air conditioner is located;
the comprehensive processing submodule is used for comprehensively analyzing and processing the current image information, the current state of the air conditioner and the current environmental condition to obtain corresponding indication information;
and the prompt information acquisition submodule is used for acquiring the corresponding voice prompt information according to the indication information.
Correspondingly, the invention also provides an air conditioner, which comprises the air conditioner control system.
According to the air conditioner control method, the current image information is collected, the corresponding voice prompt information is obtained according to the collected current image information, and the voice prompt information is broadcasted, so that a user can perform corresponding control operation according to the broadcasted voice prompt information, and the purpose of automatically prompting the user of the operation required to be executed currently is achieved. Meanwhile, after the voice prompt information is broadcasted, the running state of the air conditioner is controlled according to the received operation signal corresponding to the voice prompt information, so that the air conditioner is controlled. Wherein, the form of the operation signal comprises an image form and/or a voice form. From this, it is through gathering current image information, in order to carry out corresponding speech information's report according to the current image information who gathers, simultaneously control the running state of air conditioner according to received operating signal after broadcasting speech information, the purpose that the mode that image recognition and pronunciation combined together carried out the control of air conditioner has been realized, thereby through the association between image recognition and the pronunciation between the two, the purpose that can remind the user according to the current scene automation of gathering has been realized, the effect of effective interaction between air conditioner and the user has been reached, thereby the flexibility of control mode has been improved, finally effectively when having solved traditional air conditioner and adopting speech control or gesture control based on image recognition, the problem that has certain limitation.
Drawings
FIG. 1 is a flow chart of an embodiment of an air conditioner control method according to the present invention;
FIG. 2 is a flow chart illustrating an air conditioner control method according to another embodiment of the present invention;
FIG. 3 is a schematic diagram of an embodiment of an air conditioner control system according to the present invention;
fig. 4 is a schematic structural diagram of another embodiment of an air conditioner control system according to the present invention.
Detailed Description
In order to make the technical solution of the present invention clearer, the present invention is further described in detail below with reference to the accompanying drawings and specific embodiments.
First, in the air conditioner control method of the present invention, the collected current image information may be at least one of collected gesture information, face information, information on the number of people in the space where the air conditioner is located, and current scene information of the space where the air conditioner is located. Wherein the gesture action information comprises a plurality of different gestures, such as: raise the palm, lower the palm, swing the arm left and right or up and down, etc. The face information refers to the collected face feature information of the person. The number of people refers to the total number of people in the current space. The current scene information refers to the current environmental conditions in the space where the air conditioner is located, such as: indoor temperature, humidity, current time, etc.
Referring to fig. 1, as an embodiment of the air conditioner control method of the present invention, it first includes step S100 of collecting current image information. The current image information can be acquired by directly adopting a camera and other devices. Namely, the corresponding camera is arranged on the air conditioner, and the camera shoots the image in the set area, so that the current image information is acquired.
When the current image information is acquired, step S200 may be executed to read the current image information, obtain corresponding voice prompt information according to the read current image information, and output the obtained voice prompt information.
Referring to fig. 2, it should be noted that, in order to effectively reduce power consumption during the air conditioner control process and improve the control efficiency of the air conditioner, when step S200 is executed, current image information is read, and corresponding voice prompt information is obtained according to the read current image information, the following steps may be specifically implemented.
First, after the collected current image information is read in step S210, the current image information is identified and it is determined whether the current image information is valid information in step S220. When the current image information is judged to be valid information, it is indicated that the current image information collected by the camera at this time can be effectively identified, so that corresponding voice prompt information can be acquired and output according to the current image information through step S230, so as to realize the broadcast of the voice prompt information. When the current image information is judged to be invalid information, the current image information collected by the camera at the moment can not be effectively identified, namely, the corresponding voice prompt information can not be obtained through the current image information. Therefore, at this time, since the operation of acquiring the voice prompt information does not need to be executed any more, in order to avoid unnecessary operations, reduce the corresponding power consumption and save the control time, at this time, the process may directly return to step S100, and the current image information may be continuously acquired. Preferably, when the current image information is judged to be invalid information, in order to further improve the human-computer interaction effect between the air conditioner and the user and to achieve the purpose of accelerating the re-operation of the air conditioner, the prompt information with invalid operation can be sent out at the moment so as to achieve the purpose of prompting the user.
As an embodiment of the air conditioner of the present invention, in step S220, the current image information is identified, and whether the current image information is valid information is determined by extracting features of the image information and determining according to the extracted features. That is, by extracting the features of the current image information and matching the features of the current image information with the image information in the image information library stored in advance, when the matching is successful, it is indicated that the current image information can be effectively recognized, and thus it is determined that the current image information is effective information. When the matching is unsuccessful, the current image information can not be effectively identified, so that the current image information can be directly determined to be invalid information.
More specifically, for example: and after the current image information is read, preliminarily determining the category attribute of the current image information according to the extracted characteristics of the current image information by extracting the characteristics of the current image information. And after the current image information is preliminarily determined to be the gesture action information, matching and judging the current image information and the gesture action information stored in the gesture action sub-data in the image information base, and if the matching is successful (namely, the current image information exists in the gesture action sub-data), indicating that the current image information is a legal gesture for operating and controlling the air conditioner, so that the current image information can be determined to be effective information. If the matching fails, the current image information does not exist in the gesture action sub-database, which indicates that the current image information is not a legal gesture for controlling the air conditioner, so that the current image information can be directly confirmed as invalid information.
The method comprises the steps of extracting the characteristics of the current image information, primarily judging the attribute type of the current image information according to the extracted characteristics of the current image information, selecting a corresponding sub-database according to the judged attribute type after primarily judging the attribute type of the current image information, and further matching the current image information with data stored in the corresponding sub-database, so that the effect of gradually identifying the current image information is achieved. And the current image information is gradually identified, so that the accuracy of the identification result is ensured, the identification rate can be increased, and the identification power consumption is reduced. Finally, the accuracy and the reliability of the control of the air conditioner are effectively ensured.
After the current image information is identified and determined through the above steps, as a specific embodiment of the air conditioner control method according to the present invention, when step S230 is executed, and the corresponding voice prompt information is obtained according to the current image information, it may be implemented by searching a preset mapping table. The mapping table includes mapping relations between various image information and corresponding voice prompt information.
That is, as an embodiment of the air conditioner control method of the present invention, the obtaining of the voice prompt information may be implemented by searching a mapping table set in advance according to the current image information. That is, by searching a preset mapping table (the mapping table stores mapping relationships between various image information and corresponding voice prompt information), when the voice prompt information matched with the current image information is found in the mapping table, the found matched voice prompt information is directly output, so as to broadcast the voice prompt information. When the matching voice prompt information is not found in the mapping table, it indicates that the corresponding voice prompt information is not set for the current image information, which may be because the image information is not accurately identified in the previous identification, and at this time, the step S100 is returned to continue to collect the current image information.
Preferably, when the matching voice prompt information cannot be effectively acquired by searching the mapping table, a voice signal with failed operation or invalid current image information can be output at the moment to prompt the user that the currently input image information cannot be effectively identified, so that the purpose of reminding the user is achieved.
In addition, in order to further improve the intelligence and humanization of the air conditioner control method of the present invention, when the step S230 is executed to obtain the corresponding voice prompt information according to the current image information, the method further includes the step of obtaining the current state of the air conditioner and the current environmental condition in the space where the air conditioner is located. According to the method, the step of acquiring the current state of the air conditioner and the current environmental condition in the space where the air conditioner is located is added, when corresponding voice prompt information is acquired, comprehensive analysis processing can be performed on the current image information, the current state of the air conditioner and the current environmental condition, corresponding indication information is obtained according to the result of the comprehensive analysis processing, and after the corresponding indication information is obtained, the corresponding voice prompt information is acquired according to the obtained indication information, so that the finally acquired voice prompt information is more in line with the current environmental condition, and the air conditioner can be controlled more effectively and accurately.
Specifically, for example: when the collected current image information is the face information, after the face information is analyzed and identified to be a legal user, the current state of the air conditioner and the environmental conditions in the space where the air conditioner is located are detected, if the air conditioner is in the power-off state at present and the indoor temperature is high, the indication information for inquiring whether the air conditioner is started is obtained after the information is comprehensively analyzed and processed, and then the corresponding voice prompt information for judging whether the air conditioner is started or not can be obtained according to the indication information so as to remind the user whether the air conditioner needs to be started or not.
The method and the device have the advantages that the steps of obtaining the current state of the air conditioner and the current environmental condition in the space where the air conditioner is located are added in the process of obtaining the corresponding voice prompt information according to the current image information, and the current state of the air conditioner, the current environmental condition in the space where the air conditioner is located and the current image information are comprehensively processed, so that the accuracy of the voice prompt information is effectively improved, and the running state of the air conditioner can be more quickly adjusted when a user inputs an operation signal according to the voice prompt information in the follow-up process, so that the running state of the air conditioner is more consistent with the current environmental condition.
Further, referring to fig. 1, after the corresponding voice prompt message is output through the above steps to achieve the purpose of prompting the user to execute what kind of operation, in order to achieve the purpose of controlling the air conditioner, at this time, the method further includes step S300 of receiving an operation signal corresponding to the voice prompt message input by the user, and after receiving the operation signal, controlling the operation state of the air conditioner according to the received operation signal. Here, the operation signal is an operation signal input by the user based on the voice guidance information. The form of the signal can be an image form signal or a voice form signal. Further, it should be noted that the operation signal may specifically be a signal for controlling operations of the air conditioner such as turning on and off, mode switching, wind speed adjustment, and temperature adjustment.
Such as: when the output voice prompt message is 'whether to start up', the user can directly answer 'start up' when confirming that the start up operation is needed after receiving the voice prompt message of 'whether to start up', and at the moment, after receiving the operation signal of 'start up' input by the user through voice, the user can output a corresponding operation instruction to the air conditioner according to the received start up operation signal so as to control the air conditioner to start up. The user can also make a gesture action corresponding to the 'startup', and further recognizes the gesture action image as a startup operation signal after receiving the startup gesture action image, and outputs a corresponding startup operation instruction according to the recognized startup operation signal so as to control the air conditioner to be started.
In addition, when the operation state of the air conditioner is controlled according to the received operation signal, it is preferable that it is first determined whether or not the received operation signal coincides with the voice guidance information. Such as: when the output voice prompt message is the prompt message of 'whether to start up', the user inputs the operation signal through voice or gesture action, and the like, at this moment, whether the operation signal input by the user is the start up needs to be judged, if the operation signal is the start up, the operation signal input by the user is an accurate and effective signal, and then a corresponding operation instruction is obtained according to the operation signal, and the operation instruction is output to the air conditioner, so that the purpose of controlling the running state of the air conditioner is achieved. If the operation signal input by the user is judged not to be the operation signal of starting (namely, the operation signal is inconsistent with the voice prompt information), the operation signal input by the user is indicated to be an error signal or an invalid signal, so that the user is prompted to input the error or invalid through voice prompt at the moment so as to prompt the user to re-input the operation signal, and the step of continuously waiting for receiving the operation signal is returned to be executed until the correct and valid operation signal is received, so that the air conditioner is controlled.
Furthermore, after controlling the operation state of the air conditioner according to the received operation signal, the method also comprises the steps of acquiring the current operation state of the air conditioner and feeding back the current operation state through voice. Such as: when an operation signal of starting up is received, which is input by a user through voice or gesture operation, and an operation instruction corresponding to the operation signal is output to the air conditioner, whether the air conditioner is started up or not is detected, and when the air conditioner is detected to be started up, a corresponding voice signal of 'the air conditioner is started up' is fed back, so that the aim of further prompting the user is fulfilled.
It should be noted that, as will be understood by those skilled in the art, all or part of the processes in the methods of the above embodiments may be implemented by a computer program to instruct related hardware, where the program may be stored in a computer-readable storage medium, and when executed, the program may include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.
Correspondingly, the invention also provides an air conditioner control system based on the principle of any one of the air conditioner control methods. Since the working principle of the air conditioner control system provided by the invention is the same as or similar to that of the air conditioner control method provided by the invention, repeated descriptions are omitted.
Referring to fig. 3, an embodiment of the air conditioner control system 100 according to the present invention includes an image capturing device 110, a processor 120, a voice broadcasting device 130, and a voice capturing device 140. Wherein, image acquisition device 110, voice broadcast device 130 and voice acquisition device 140 all are connected with processor 120 is electric. The processor 120 is also adapted to be connected to the main control board 200 of the air conditioner for data transmission with the main control board 200 of the air conditioner. Also, the processor 120 includes an interactive control module 121 therein.
Specifically, the image capturing device 110 is configured to capture current image information. And the interaction control module 121 is configured to read current image information, obtain corresponding voice prompt information according to the current image information, and output the voice prompt information to the voice broadcast device 130. And the voice broadcasting device 130 is used for broadcasting voice prompt information. The interactive control module 121 is further configured to receive an operation signal input by the user according to the voice prompt information, and control the operation state of the air conditioner according to the operation signal after receiving the operation signal.
Here, it should be noted that the operation signal may be acquired by the image acquisition device 110 and/or the voice acquisition device 140. That is, the form of the operation signal may be at least one of an image form and a voice form. When the form of the operation signal is an image form, it may be acquired by the image acquisition device 110. When the operation signal is in the form of voice, the operation signal can be collected by the voice collecting device 140. Further, the image capturing device 110 may be directly implemented by a camera, and the voice capturing device 140 may be implemented by a microphone. The voice broadcasting device 130 can be directly implemented by using a sound box. The structure is simple and easy to realize.
Further, referring to fig. 4, as another specific embodiment of the air conditioner control system 100 of the present invention, the processor 120 further includes an image recognition module 122. The image recognition module 122 is configured to recognize current image information and determine whether the current image information is valid information. The interaction control module 121 is further configured to, when the image recognition module 122 determines that the current image information is valid information, obtain corresponding voice prompt information according to the current image information, and output the voice prompt information to the voice broadcast device 130. The image recognition module 122 is further configured to, when it is determined that the current image information is invalid information, return to the image acquisition device 110, and continue to acquire the image information by the image acquisition device 110.
Accordingly, referring to fig. 4, in the air conditioner control system 100 of the present invention, when the operation signal is in the form of voice, the processor 120 thereof further includes a voice recognition module 123. The voice recognition module 123 is electrically connected between the voice collecting device 140 and the interactive control module 121, and is configured to perform corresponding recognition on the voice information collected by the voice collecting device 140, so as to achieve the purpose that the user performs control operation of the air conditioner through a voice signal.
Further, the image recognition module 122 includes a feature extraction sub-module and a matching judgment sub-module (neither shown). The feature extraction submodule is used for extracting features of current image information. And the matching judgment sub-module is used for matching the characteristics of the current image information with the image information in the pre-stored image information base. The matching judgment sub-module is also used for determining the current image information as effective information when the matching is successful; and when the matching is unsuccessful, determining the current image information as invalid information.
In addition, in the air conditioner control system 100 of the present invention, it further includes a state detection module and an environment detection module (neither of which is shown in the drawing) both electrically connected to the processing point. Correspondingly, the interaction control module 121 inside the processor 120 further includes a comprehensive processing sub-module and a prompt information obtaining sub-module (neither shown in the figure). The state detection module is used for detecting and acquiring the current state of the air conditioner. The environment detection module is used for detecting and acquiring the current environment condition in the space where the air conditioner is located. The environment detection module can be a temperature sensor, a humidity sensor, a timer and the like. And the comprehensive processing submodule is used for comprehensively analyzing and processing the current image information, the current state of the air conditioner and the current environmental condition to obtain corresponding indication information. And the prompt information acquisition submodule is used for acquiring corresponding voice prompt information according to the indication information.
Specifically, in order to more clearly describe the technical solution of the air conditioner control system 100 of the present invention, the air conditioner control system 100 of the present invention will be specifically described below with three specific embodiments.
When the air conditioner control device of the invention is adopted to carry out operation guidance on the air conditioner, such as: when the user inputs a corresponding gesture wake-up action through the image acquisition device 110, it indicates that the user needs to adopt the gesture action air conditioner at this time. After the image capturing device 110 captures the gesture, the image recognition module 122 in the processor 120 reads the image of the gesture, and recognizes the read image of the gesture. When the gesture motion image is judged to be valid information, the gesture motion image is input to the interaction control module 121 of the processor 120, and the interaction control module 121 obtains corresponding voice prompt information according to the gesture motion image. At this time, the interaction control module 121 obtains the voice prompt information corresponding to the gesture motion image as a ding-dong prompt sound, so that the obtained ding-dong prompt sound is output to the voice broadcasting device 130, and the voice broadcasting device 130 sends out a ding-dong sound, so as to prompt the user to wake up the gesture control mode and perform gesture control. After the user hears the ding-dong prompt sound, the gesture control mode can be determined to be entered, and therefore the air conditioner can be controlled by inputting a corresponding gesture operation signal. Such as: when the gesture operation signal input by the user is to adjust the temperature to 28 ℃, the processor 120 outputs an operation instruction for adjusting the temperature to 28 ℃ to the air conditioner according to the received gesture operation signal, so that the operating temperature of the air conditioner is 28 ℃, and meanwhile, the voice prompt message of "adjust to 28 ℃ for you" is returned through the voice broadcast device 130.
Furthermore, the air conditioner control device can also realize the function of scene recognition of the air conditioner. Specifically, for example: when the image acquisition device 110 acquires the face features in the current space, the image identification module 122 identifies that the acquired face feature images are legal users, and also acquires that the current air conditioner is in a shutdown state, and when the indoor temperature is high, the voice broadcast device 130 is used for prompting the user whether to start the air conditioner, that is, the voice broadcast device 130 is used for performing voice broadcast on whether to start the air conditioner. After hearing the voice prompt, the user confirms that the air conditioner needs to be started, at this time, the user can answer the 'start-up' through voice, and after the voice acquisition device 140 acquires an operation signal of the 'start-up', the processor 120 outputs a start-up operation instruction to the air conditioner according to the received operation signal, so as to realize the start-up operation of the air conditioner. After the user hears the voice prompt message of "whether to start up" or not, the user can also make a gesture corresponding to "start up", and after the gesture is acquired by the image acquisition device 110, the processor 120 outputs a start-up operation instruction to the air conditioner according to the received operation in the gesture action form, so as to start up the air conditioner.
Further, as another specific embodiment of the scene recognition, when the image capturing device 110 captures the number of people in the current space, the image recognition module 122 recognizes that the number of people captured is less than a preset number of people (for example, 3 people), and further obtains the operating temperature of the current air conditioner of 24 degrees celsius, and when the indoor temperature is low, the voice broadcasting device 130 reminds the user whether the temperature needs to be increased, that is, the voice broadcasting device 130 performs the voice broadcasting of "whether the temperature needs to be increased". After the user hears the voice prompt, the user confirms that the temperature needs to be adjusted, at this time, the user can answer 'increase the temperature to 28 ℃ by voice, and after the operation signal of' increase the temperature to 28 ℃ is acquired by the voice acquisition device 140, the processor 120 outputs a start-up operation instruction to the air conditioner according to the received operation signal, so as to realize the operation of adjusting the temperature. After hearing the voice prompt, the user can also adjust the temperature by corresponding gesture actions when confirming that the temperature needs to be adjusted, and the principle of the method is the same as that of the above embodiment, and is not described again here.
In addition, referring to fig. 4, as another embodiment of the air conditioner control system 100 of the present invention, a communication module 150 is further included. The communication module 150 is used for data communication with the mobile terminal, so that a user can perform operations such as remote control of the air conditioner through an APP (application software) installed on the mobile terminal, which further improves the flexibility and intelligence of the air conditioner control system 100. Wherein, the communication module 150 may be a WIFI module, a bluetooth module, etc.
Meanwhile, it should be noted that, various technical features of the above-mentioned embodiments may be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above-mentioned embodiments are not described, however, as long as there is no contradiction between the combinations of the technical features, the scope of the present description should be considered as being described in the present specification.
Correspondingly, the invention also provides an air conditioner, which comprises the air conditioner control system 100. The processor 120 in the air conditioner control system 100 may be disposed independently from the main control board of the air conditioner, or may be integrated on the main control board of the air conditioner. Meanwhile, the image capturing device 110, the voice capturing device 140 and the voice broadcasting device 130 in the air conditioner control system 100 may be respectively disposed on the housing of the air conditioner.
Any one of the air conditioner control systems 100 is arranged on the air conditioner, so that the control of the air conditioner can be separated from a contact control mode (namely, a remote controller control mode), and a non-contact control mode is completely adopted. And when the non-contact control mode is adopted, the voice and image recognition can be fused to realize the function complementation of the voice and image recognition, so that the operation guidance and the intelligent control of the air conditioner can be completed through the mutual matching of the voice and the image recognition, the interaction function between the air conditioner and a user is effectively improved, and the user experience is improved.
The above-mentioned embodiments only express several embodiments of the present invention, and the description thereof is more specific and detailed, but not construed as limiting the scope of the present invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (8)
1. A control method of an air conditioner is characterized by comprising the following steps:
collecting current image information;
reading the current image information, acquiring corresponding voice prompt information according to the current image information, and outputting the voice prompt information;
when corresponding voice prompt information is obtained according to the current image information, the corresponding voice prompt information is obtained by searching a preset mapping table, wherein the mapping table comprises mapping relations between various different image information and the corresponding voice prompt information, and the voice prompt information corresponding to the different image information is different;
when obtaining the corresponding voice prompt information according to the current image information, the method also comprises the following steps:
acquiring the current state of the air conditioner and the current environmental condition in the space where the air conditioner is located;
comprehensively analyzing and processing whether the current image information, the current state of the air conditioner and the current environmental condition are suitable or not to obtain corresponding indication information;
acquiring corresponding voice prompt information according to the indication information;
broadcasting the voice prompt information;
receiving an operation signal input according to the voice prompt information, and controlling the running state of the air conditioner according to the received operation signal; wherein the operation signal is in the form of an image and/or a voice.
2. The air conditioner control method according to claim 1, wherein said reading said current image information and obtaining corresponding voice prompt information according to said current image information comprises the steps of:
identifying the current image information and judging whether the current image information is effective information or not;
when the current image information is judged to be effective information, the step of acquiring corresponding voice prompt information according to the current image information is executed;
and when the current image information is judged to be invalid information, returning to the step of acquiring the current image information, and continuing to acquire the image information.
3. The air conditioner control method according to claim 2, wherein said judging whether the current image information is valid information comprises the steps of:
extracting the characteristics of the current image information, and matching the characteristics of the current image information with each image information in a pre-stored image information base;
when the matching is successful, determining the current image information as effective information;
and when the matching is unsuccessful, determining that the current image information is invalid information.
4. The air conditioner controlling method according to claim 1, further comprising the step of obtaining a current operation state of the air conditioner and feeding back the current operation state through voice after controlling the operation state of the air conditioner according to the operation signal.
5. An air conditioner control system (100) is characterized by comprising an image acquisition device (110), a processor (120), a voice broadcast device (130) and a voice acquisition device (140);
the image acquisition device (110), the voice broadcast device (130) and the voice acquisition device (140) are all electrically connected with the processor (120); and, the processor (120) internally comprises an interaction control module (121);
the image acquisition device (110) is used for acquiring current image information;
the interaction control module (121) is configured to read the current image information, obtain corresponding voice prompt information according to the current image information, and output the voice prompt information to the voice broadcast device (130); when corresponding voice prompt information is obtained according to the current image information, the corresponding voice prompt information is obtained by searching a preset mapping table, wherein the mapping table comprises mapping relations between various different image information and the corresponding voice prompt information, and the voice prompt information corresponding to the different image information is different;
the voice broadcasting device (130) is used for broadcasting the voice prompt information;
the interaction control module (121) is further configured to receive an operation signal input according to the voice prompt information, and control the operation state of the air conditioner according to the received operation signal;
wherein the operation signal is acquired by the image acquisition device (110) and/or the voice acquisition device (140);
further comprising a status detection module and an environment detection module electrically connected to the processor (120);
the interaction control module (121) comprises a comprehensive processing sub-module and a prompt information acquisition sub-module;
the state detection module is used for detecting and acquiring the current state of the air conditioner;
the environment detection module is used for detecting and acquiring the current environment condition in the space where the air conditioner is located;
the comprehensive processing submodule is used for comprehensively analyzing and processing the current image information, the current state of the air conditioner and whether the current environmental condition is suitable or not to obtain corresponding indication information;
and the prompt information acquisition submodule is used for acquiring the corresponding voice prompt information according to the indication information.
6. The air conditioner control system (100) of claim 5, wherein the processor (120) further comprises an image recognition module (122);
the image identification module (122) is used for identifying the current image information and judging whether the current image information is effective information;
the interaction control module (121) is further configured to, when the image recognition module (122) determines that the current image information is valid information, obtain corresponding voice prompt information according to the current image information, and output the voice prompt information to the voice broadcast device (130);
the image identification module (122) is further configured to, when the current image information is judged to be invalid information, return to the image acquisition device (110), and continue to acquire the image information by the image acquisition device (110).
7. The air conditioner control system (100) of claim 6, wherein the image recognition module (122) includes a feature extraction sub-module and a match determination sub-module;
the feature extraction submodule is used for extracting features of the current image information;
the matching judgment sub-module is used for matching the characteristics of the current image information with the image information in a pre-stored image information base;
the matching judgment sub-module is also used for determining the current image information as effective information when the matching is successful; and when the matching is unsuccessful, determining the current image information as invalid information.
8. An air conditioner characterized by comprising the air conditioner control system (100) according to any one of claims 5 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610703667.7A CN106225174B (en) | 2016-08-22 | 2016-08-22 | Air conditioner control method and system and air conditioner |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610703667.7A CN106225174B (en) | 2016-08-22 | 2016-08-22 | Air conditioner control method and system and air conditioner |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106225174A CN106225174A (en) | 2016-12-14 |
| CN106225174B true CN106225174B (en) | 2020-10-13 |
Family
ID=57554208
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610703667.7A Active CN106225174B (en) | 2016-08-22 | 2016-08-22 | Air conditioner control method and system and air conditioner |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106225174B (en) |
Families Citing this family (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106705385A (en) * | 2017-02-14 | 2017-05-24 | 珠海格力电器股份有限公司 | Control method, control device and control system of air conditioner |
| CN107367016B (en) * | 2017-06-21 | 2019-10-11 | 珠海格力电器股份有限公司 | Intelligent control method and device for air conditioner and air conditioner |
| CN107276864B (en) * | 2017-07-25 | 2020-09-11 | 广东美的制冷设备有限公司 | Method, device and system for controlling household appliances by intelligent voice equipment |
| JP6771681B2 (en) * | 2017-10-11 | 2020-10-21 | 三菱電機株式会社 | Air conditioning controller |
| CN108154877B (en) * | 2017-12-13 | 2021-12-17 | 广东美的制冷设备有限公司 | Voice broadcasting method and device of air conditioner |
| CN108154142B (en) * | 2018-01-29 | 2021-02-26 | 杭州美界科技有限公司 | Skin wrinkle evaluation method and system based on voice recognition |
| CN108510986A (en) * | 2018-03-07 | 2018-09-07 | 北京墨丘科技有限公司 | Voice interactive method, device, electronic equipment and computer readable storage medium |
| CN109859751A (en) * | 2018-12-03 | 2019-06-07 | 珠海格力电器股份有限公司 | A method of it controlling equipment and its executes instruction |
| CN110471296B (en) * | 2019-07-19 | 2022-05-13 | 深圳绿米联创科技有限公司 | Device control method, device, system, electronic device and storage medium |
| CN110500681A (en) * | 2019-08-22 | 2019-11-26 | 宁波奥克斯电气股份有限公司 | It is a kind of convenient for the air-conditioner control system of family health care management, method and air conditioner |
| CN110825002A (en) * | 2019-11-29 | 2020-02-21 | 广东美的制冷设备有限公司 | Air conditioner and control method and control system thereof |
| CN113028597B (en) * | 2021-03-19 | 2022-04-05 | 珠海格力电器股份有限公司 | Voice control method and device |
| CN113357778A (en) * | 2021-05-31 | 2021-09-07 | 青岛海尔空调器有限总公司 | Method and device for controlling air conditioner and air conditioner |
| CN113447710A (en) * | 2021-05-31 | 2021-09-28 | 南京昊飞软件有限公司 | Man-machine interactive electric energy meter |
| CN113244009B (en) * | 2021-06-17 | 2021-11-09 | 深圳市弘玉信息技术有限公司 | Oral health management system for adjusting electric toothbrush based on artificial intelligence image recognition |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201443839U (en) * | 2009-06-18 | 2010-04-28 | 赵知宇 | Wireless intelligent air-conditioning control system |
| CN102692068A (en) * | 2012-06-15 | 2012-09-26 | 海尔集团公司 | Voice-controlled air conditioner with voice interaction function |
| CN103050001A (en) * | 2012-03-26 | 2013-04-17 | 青岛海信电器股份有限公司 | Control device, electrical household appliance and remote controller |
| CN103292437A (en) * | 2013-06-17 | 2013-09-11 | 广东美的制冷设备有限公司 | Voice interactive air conditioner and control method thereof |
| CN103375880A (en) * | 2012-04-27 | 2013-10-30 | 珠海格力电器股份有限公司 | Remote control device and method for air conditioner |
| CN103954025A (en) * | 2014-05-21 | 2014-07-30 | 江苏新科电器有限公司 | Intelligent control system of air conditioner and intelligent control method thereof |
| JP2015154085A (en) * | 2014-02-10 | 2015-08-24 | 三菱電機株式会社 | air conditioning system |
| CN105100898A (en) * | 2015-08-13 | 2015-11-25 | 海信集团有限公司 | Intelligent television starting method and system |
| CN105700372A (en) * | 2016-03-11 | 2016-06-22 | 珠海格力电器股份有限公司 | Intelligent device and control method thereof |
| WO2017221342A1 (en) * | 2016-06-22 | 2017-12-28 | 三菱電機株式会社 | Air conditioner |
-
2016
- 2016-08-22 CN CN201610703667.7A patent/CN106225174B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201443839U (en) * | 2009-06-18 | 2010-04-28 | 赵知宇 | Wireless intelligent air-conditioning control system |
| CN103050001A (en) * | 2012-03-26 | 2013-04-17 | 青岛海信电器股份有限公司 | Control device, electrical household appliance and remote controller |
| CN103375880A (en) * | 2012-04-27 | 2013-10-30 | 珠海格力电器股份有限公司 | Remote control device and method for air conditioner |
| CN102692068A (en) * | 2012-06-15 | 2012-09-26 | 海尔集团公司 | Voice-controlled air conditioner with voice interaction function |
| CN103292437A (en) * | 2013-06-17 | 2013-09-11 | 广东美的制冷设备有限公司 | Voice interactive air conditioner and control method thereof |
| JP2015154085A (en) * | 2014-02-10 | 2015-08-24 | 三菱電機株式会社 | air conditioning system |
| CN103954025A (en) * | 2014-05-21 | 2014-07-30 | 江苏新科电器有限公司 | Intelligent control system of air conditioner and intelligent control method thereof |
| CN105100898A (en) * | 2015-08-13 | 2015-11-25 | 海信集团有限公司 | Intelligent television starting method and system |
| CN105700372A (en) * | 2016-03-11 | 2016-06-22 | 珠海格力电器股份有限公司 | Intelligent device and control method thereof |
| WO2017221342A1 (en) * | 2016-06-22 | 2017-12-28 | 三菱電機株式会社 | Air conditioner |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106225174A (en) | 2016-12-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106225174B (en) | Air conditioner control method and system and air conditioner | |
| CN107370649B (en) | Household appliance control method, system, control terminal and storage medium | |
| US11223497B2 (en) | Method and apparatus for providing notification by interworking plurality of electronic devices | |
| CN103292437B (en) | Voice interactive air conditioner and control method thereof | |
| CN110535732B (en) | Equipment control method and device, electronic equipment and storage medium | |
| CN110308660B (en) | Intelligent equipment control method and device | |
| CN110730115B (en) | Voice control method and device, terminal and storage medium | |
| CN107544272B (en) | Terminal control method, device and storage medium | |
| CN110726210A (en) | Air conditioner control method and device, air conditioner and air conditioning system | |
| CN104896656A (en) | Method and device for starting air conditioner | |
| CN110853619A (en) | Man-machine interaction method, control device, controlled device and storage medium | |
| CN111638651A (en) | Intelligent household control panel, setting method thereof, server and storage medium | |
| WO2020135334A1 (en) | Television application theme switching method, television, readable storage medium, and device | |
| CN107085380A (en) | A kind of intelligent domestic system customer location determination methods and electronic equipment | |
| CN111197841A (en) | Control method, control device, remote control terminal, air conditioner, server and storage medium | |
| CN113671846B (en) | Intelligent device control method and device, wearable device and storage medium | |
| WO2021082131A1 (en) | Air conditioning device, and temperature control method and apparatus | |
| CN110738994A (en) | Control method, device, robot and system for smart homes | |
| WO2020192215A1 (en) | Interactive method and wearable interactive device | |
| CN108932947B (en) | Voice control method and household appliance | |
| CN114373462A (en) | Voice interaction equipment and control method and control device thereof | |
| CN111006261A (en) | Range hood control method and device, range hood and storage medium | |
| CN112908321A (en) | Device control method, device, storage medium, and electronic apparatus | |
| CN113446717B (en) | Smart page display method and device and electronic equipment | |
| CN110989378A (en) | Intelligent home controller, interaction method thereof and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |