CN107702273B - Air conditioner control method and device - Google Patents
Air conditioner control method and device Download PDFInfo
- Publication number
- CN107702273B CN107702273B CN201710858102.0A CN201710858102A CN107702273B CN 107702273 B CN107702273 B CN 107702273B CN 201710858102 A CN201710858102 A CN 201710858102A CN 107702273 B CN107702273 B CN 107702273B
- Authority
- CN
- China
- Prior art keywords
- air conditioner
- lip language
- control
- controlling
- instruction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 36
- 238000012549 training Methods 0.000 claims abstract description 46
- 238000010801 machine learning Methods 0.000 claims abstract description 10
- 238000004378 air conditioning Methods 0.000 claims description 24
- 238000003384 imaging method Methods 0.000 claims description 5
- 238000010586 diagram Methods 0.000 description 8
- 230000009471 action Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000013473 artificial intelligence Methods 0.000 description 2
- 238000005034 decoration Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000001815 facial effect Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012790 confirmation Methods 0.000 description 1
- 238000001816 cooling Methods 0.000 description 1
- 230000002354 daily effect Effects 0.000 description 1
- 238000007791 dehumidification Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000003203 everyday effect Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
- G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Data Mining & Analysis (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Evolutionary Computation (AREA)
- Bioinformatics & Computational Biology (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Artificial Intelligence (AREA)
- Life Sciences & Earth Sciences (AREA)
- Evolutionary Biology (AREA)
- General Health & Medical Sciences (AREA)
- Psychiatry (AREA)
- Social Psychology (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Air Conditioning Control Device (AREA)
Abstract
The invention discloses an air conditioner control method and device. Wherein, the method comprises the following steps: acquiring a lip language for controlling an air conditioner; through instruction identification model, confirm the control command that the lip language that acquires carried out control to the air conditioner, wherein, instruction identification model is for using multiunit data to obtain through machine learning training, and every group data in the multiunit data all includes: the control system comprises a lip language and a control instruction for identifying the lip language to control the air conditioner; and controlling the air conditioner according to the determined control instruction. The invention solves the technical problems of complex operation and unidentifiable instruction caused by the control of the air conditioner by a remote controller and voice control.
Description
Technical Field
The invention relates to the field of air conditioner control, in particular to an air conditioner control method and device.
Background
Air conditioners, one of the essential electrical appliances for modern families, have occupied an increasingly important position in people's daily life. The ease of operation of air conditioning controls is of particular importance in everyday use due to the frequent use. Like a television and an electric fan, most air conditioners are controlled in a remote controller mode, but the remote controller is small in size and can be scattered in a certain corner frequently, so that a user cannot use the air conditioner normally due to the fact that the user cannot find the remote controller when the user needs to use the air conditioner. In order to solve the problem, some manufacturers have introduced an air-conditioning voice control system, but this also creates a new problem, that is, because of the problems of the accent and dialect of the user, the air-conditioning control system cannot recognize the control instruction contained in the voice of the user, so that the voice control cannot be used normally, and the inconvenience of the air-conditioning operation is further aggravated.
Aiming at the problems that the air conditioner is controlled by a remote controller and controlled by voice, the operation is complicated and the instruction cannot be identified, an effective solution is not provided at present.
Disclosure of Invention
The embodiment of the invention provides an air conditioner control method and device, which at least solve the technical problems of complex operation and unidentifiable instructions caused by the fact that an air conditioner is controlled by a remote controller and controlled by voice.
According to an aspect of an embodiment of the present invention, there is provided an air conditioner control method including: acquiring a lip language for controlling an air conditioner; through instruction identification model, confirm the control command that the lip language that acquires carried out control to the air conditioner, wherein, instruction identification model is for using multiunit data to obtain through machine learning training, and every group data in the multiunit data all includes: the control system comprises a lip language and a control instruction for identifying the lip language to control the air conditioner; and controlling the air conditioner according to the determined control instruction.
Optionally, the lip language for controlling the air conditioner may be acquired by at least one of the following methods: the method comprises the steps that lip language used for controlling the air conditioner is obtained in a mode of photographing the mouth of a lip language speaker of the lip language; the method comprises the steps that lip language used for controlling the air conditioner is obtained in a mode of recording the mouth of a lip language speaker of the lip language; the lip language used for controlling the air conditioner is acquired by emitting light to the side face of the mouth of a lip language speaker and acquiring the mode that the emitted light forms an image on the mouth.
Optionally, before determining the control instruction for controlling the air conditioner by the obtained lip language through the instruction recognition model, the method further includes: acquiring a plurality of training labial uttered by labial utterers with different ages, different sexes and different mouth shapes, and a plurality of training control instructions for controlling the air conditioner corresponding to the identified labial; and training the training lip languages and the training control instructions to obtain an instruction recognition model.
Optionally, the determining, by using the instruction recognition model, the control instruction for controlling the air conditioner by the obtained lip language includes: under the condition that a plurality of control instructions are determined through the instruction identification model, lip language used for carrying out the same control on the air conditioner is collected for a plurality of times; identifying a plurality of control instructions corresponding to the lip language acquired for multiple times respectively through an instruction identification model; and determining the control instruction with the most times of the same control instructions as the acquired control instruction for controlling the air conditioner by the lip language.
According to another aspect of the embodiments of the present invention, there is also provided an air conditioning control apparatus including: the system comprises an acquisition module, a control module and a control module, wherein the acquisition module is used for acquiring lip language for controlling the air conditioner; the determining module is used for determining a control instruction for controlling the air conditioner by the acquired lip language through an instruction recognition model, wherein the instruction recognition model is obtained by using a plurality of groups of data through machine learning training, and each group of data in the plurality of groups of data comprises: the control system comprises a lip language and a control instruction for identifying the lip language to control the air conditioner; and the control module is used for controlling the air conditioner according to the determined control instruction.
Optionally, the acquisition module includes at least one of the following units: the photographing unit is used for acquiring the lip language for controlling the air conditioner in a mode of photographing the mouth of a lip language speaker of the lip language; the device comprises a video recording unit, a control unit and a control unit, wherein the video recording unit is used for acquiring the lip language for controlling the air conditioner in a mode of recording the mouth of a lip language speaker of the lip language; and the imaging unit is used for acquiring the lip language for controlling the air conditioner in a mode of emitting light to the side face of the mouth of the lip language speaker and acquiring the image of the emitted light to the mouth.
Optionally, the control device further includes: the system comprises an acquisition module, a judgment module and a control module, wherein the acquisition module is used for acquiring a plurality of training lip languages sent by lip language senders with different ages, different sexes and different mouth shapes and a plurality of training control instructions for controlling the air conditioner corresponding to the identified lip languages respectively; and the training module is used for training a plurality of training lip languages and a plurality of training control instructions to obtain an instruction recognition model.
Optionally, the control module includes: the acquisition unit is used for acquiring lip language for performing the same control on the air conditioner for multiple times under the condition that the control instructions determined by the instruction identification model are multiple; the identification unit is used for identifying a plurality of control instructions corresponding to the lip language acquired for multiple times through the instruction identification model; and the determining unit is used for determining the control instruction with the most same times in the plurality of control instructions as the acquired control instruction for controlling the air conditioner by the lip language.
According to another aspect of an embodiment of the present invention, there is also provided a storage medium including a stored program, wherein the program executes the air-conditioning control method of any one of the above.
According to another aspect of the embodiment of the present invention, there is provided a processor, configured to execute a program, where the program executes the air conditioner control method according to any one of the above.
In the embodiment of the invention, lip language for controlling an air conditioner is acquired, a control instruction for controlling the air conditioner by the acquired lip language is determined through an instruction identification model, and the air conditioner is controlled according to the determined control instruction, wherein the instruction identification model is obtained by using a plurality of groups of data through machine learning training, and each group of data in the plurality of groups of data comprises: the control system comprises a lip language and a control instruction for identifying the lip language to control the air conditioner. The mode of adopting artificial intelligence has reached the purpose that relies on user's lip language control air conditioner through acquireing analysis user's lip language control command to solved because the air conditioner relies on the technical problem that complex operation and instruction can't be discerned that remote controller control and speech control caused, and then realized the technological effect that air conditioner control is convenient, swift, easy operation.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:
fig. 1 is a flowchart of an air conditioner control method according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of an air conditioning control apparatus according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of the collection module 22 in the air conditioning control device according to the embodiment of the present invention;
fig. 4 is a schematic diagram of a preferred structure of an air conditioning control device according to an embodiment of the invention;
fig. 5 is a schematic structural diagram of the control module 26 in the air conditioning control device according to the embodiment of the present invention.
Detailed Description
In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
The following embodiments may be applied to various electrical devices, and the types of the electrical devices are not particularly limited, including but not limited to: an air conditioner, a television, an electric fan, and the like, and embodiments of the present invention will be described in detail with reference to the air conditioner as an example.
The following embodiments may be applied to various air conditioning apparatuses, wherein the type of air conditioner is not limited in the present invention, and may include, but is not limited to: wall-mounted air conditioners, cabinet air conditioners, ceiling air conditioners, window air conditioners, mobile air conditioners, embedded air conditioners and the like.
Meanwhile, in order to facilitate the user's understanding of the present invention, some terms or nouns related to the present invention are explained as follows:
pixel: the minimum unit which can be displayed on a computer screen is used for representing the unit of an image, and the unit refers to an array of horizontal and vertical pixels which can be displayed, and the more pixel points in the screen, the higher the resolution of the picture, the more exquisite and vivid the image;
pixel point: refers to the value of the pixel.
In accordance with an embodiment of the present invention, there is provided an embodiment of a method for air conditioning control, it is noted that the steps illustrated in the flowchart of the drawings may be performed in a computer system, such as a set of computer-executable instructions, and that while a logical order is illustrated in the flowchart, in some cases the steps illustrated or described may be performed in an order different than presented herein.
Fig. 1 is a flowchart of an air conditioner control method according to an embodiment of the present invention, as shown in fig. 1, the method including the steps of:
and step S102, lip language for controlling the air conditioner is acquired.
Step S104, determining a control instruction for controlling the air conditioner by the acquired lip language through an instruction identification model, wherein the instruction identification model is obtained by using multiple groups of data through machine learning training, and each group of data in the multiple groups of data comprises: the control system comprises a lip language and a control instruction for identifying the lip language to control the air conditioner.
And step S106, controlling the air conditioner according to the determined control command.
Through the steps, the control instruction for controlling the air conditioner by the acquired lip language can be determined through the instruction identification model, and the air conditioner is controlled according to the determined control instruction. The method adopts an artificial intelligence mode, achieves the purpose of controlling the air conditioner by depending on the lip language of the user by acquiring and analyzing the lip language control instruction of the user, thereby solving the technical problems of complex operation and incapability of identifying the instruction caused by the fact that the air conditioner depends on remote controller control and voice control, and further realizing the technical effects of convenient, rapid and easy operation of air conditioner control.
Optionally, in step S102, the lip language of the user controlling the air conditioner may be acquired by using an information acquisition module installed in the air conditioner or at a certain distance from the air conditioner, and meanwhile, the voice uttered together with the lip language may also be acquired, and compared with the identified lip language control instruction, the accuracy of the device control is improved.
Optionally, in step S104, a control instruction included in the lip language may be determined according to the obtained lip language information, where the control instruction includes some or all of the air conditioner operation commands such as start-up, shut-down, cooling, and dehumidification. The system establishes a rich model in advance by utilizing machine learning through a large amount of data counted in the early stage, and determines air conditioner control instructions represented by various lip languages, so that rapid identification and model selection are carried out according to the identified lip language details, and the air conditioner is controlled correspondingly.
When the lip language for controlling the air conditioner is acquired, the lip language for controlling the air conditioner may be acquired in various manners, for example, in at least one of the following manners: the method comprises the steps that lip language used for controlling the air conditioner is obtained in a mode of photographing the mouth of a lip language speaker of the lip language; the method comprises the steps that lip language used for controlling the air conditioner is obtained in a mode of recording the mouth of a lip language speaker of the lip language; the lip language used for controlling the air conditioner is acquired by emitting light to the side face of the mouth of a lip language speaker and acquiring the mode that the emitted light forms an image on the mouth.
The air conditioner can collect the facial actions of the user in the modes of camera shooting, camera video recording and ray imaging, one of the modes can be used independently, and the mode of combining two or three modes can be adopted. Meanwhile, the acquisition equipment can be arranged in the air conditioner equipment, can also be arranged at a position which is at a certain distance from the air conditioner, and is connected with the air conditioner control equipment in a specific information interaction mode. The lip action is accurately captured in a multi-mode and multi-angle layout mode that acquisition equipment acquires lip information, and the step effectively ensures acquisition and confirmation of the lip action of a user.
Preferably, before determining the acquired control command for controlling the air conditioner by the lip language through the command recognition model, the method further includes: acquiring a plurality of training labial uttered by labial utterers with different ages, different sexes and different mouth shapes, and a plurality of training control instructions for controlling the air conditioner corresponding to the identified labial; and training the training lip languages and the training control instructions to obtain an instruction recognition model.
For the above embodiment, the training data may be obtained through a laboratory, or may be continuously collected, accumulated and reported in the process of using a large amount of air-conditioning device for lip language control, and the sold air conditioners are tracked, so that a large amount of data can be obtained for training. Optionally, a communication module may be preset in the air conditioner capable of being controlled by lip language, and a plurality of air conditioners may upload data acquired in real time to the server for machine training. The communication module may include, but is not limited to: wireless network card, bluetooth, etc. Meanwhile, pixel analysis is carried out on the collected images, the mouth part is identified from the facial images, and then the control instruction related to each lip action is identified from a plurality of continuous images or videos, so that in order to ensure that the identification accuracy is not influenced by distance, a high-precision image identification module can be arranged in a lip-language-controllable air conditioner, the information of each pixel is ensured to be captured without loss, and further, when the distance between a user and the air conditioner is far, the complete lip action of the user in the collected images or videos can be accurately identified, and the identification accuracy of the control instruction is ensured.
Preferably, the determining, by the instruction recognition model, the acquired control instruction for controlling the air conditioner by the lip language includes: under the condition that a plurality of control instructions are determined through the instruction identification model, lip language used for carrying out the same control on the air conditioner is collected for a plurality of times; identifying a plurality of control instructions corresponding to the lip language acquired for multiple times respectively through an instruction identification model; and determining the control instruction with the most times of the same control instructions as the acquired control instruction for controlling the air conditioner by the lip language.
Through the implementation mode, when the user lip language simultaneously contains a plurality of control instructions, the control instructions can be successfully determined in a correct sequence and high recognition precision, and the air conditioner is controlled to correctly and orderly execute the user commands.
It should be noted that, when a user lip language control instruction is recognized, voice simultaneous acquisition can be set, a voice instruction recognition model established through machine learning training is set, the corresponding voice control instruction is recognized while the lip language control instruction is recognized, the lip language control instruction and the corresponding voice control instruction are compared, if the two recognized control instructions are the same, the control instruction is directly executed, if the two recognized control instructions are different, the control instruction is fed back to the user sending the instruction in a voice broadcasting mode, and after the user reconfirms, the confirmed control instruction is executed. The method can further ensure the execution precision of the control command.
According to another aspect of the embodiment of the present invention, there is also provided an air conditioning control device, and fig. 2 is a schematic structural diagram of the air conditioning control device according to the embodiment of the present invention, as shown in fig. 2, the air conditioning control device includes: an acquisition module 22, a determination module 24, and a control module 26. The air conditioning control device will be described in detail below.
The acquisition module 22 is used for acquiring lip language for controlling the air conditioner;
the determining module 24 is configured to be connected to the acquiring module 22, and determine, through an instruction recognition model, a control instruction for controlling the air conditioner by the acquired lip language, where the instruction recognition model is obtained by using multiple sets of data through machine learning training, and each set of data in the multiple sets of data includes: the control system comprises a lip language and a control instruction for identifying the lip language to control the air conditioner;
and the control module 26 is connected to the determining module 24 and used for controlling the air conditioner according to the determined control instruction.
Fig. 3 is a schematic structural diagram of the collection module 22 in the air conditioning control device according to the embodiment of the present invention, and as shown in fig. 3, the collection module 22 includes at least one of the following units: the photographing unit 32, the recording unit 34, and the imaging unit 36, which will be described in detail below with respect to the capturing module 22.
The photographing unit 32 is configured to acquire a lip language for controlling an air conditioner by photographing a mouth of a lip language speaker of the lip language;
a recording unit 34 configured to acquire a lip language for controlling an air conditioner by recording a mouth of a lip language speaker of the lip language;
the imaging unit 36 is configured to acquire the lip language for controlling the air conditioner by emitting light to a side of the mouth of the lip language speaker and acquiring an image of the mouth with the emitted light.
Fig. 4 is a schematic diagram of a preferred structure of an air conditioning control device according to an embodiment of the present invention, and as shown in fig. 4, the device further includes: an acquisition module 42 and a training module 44, which are described in detail below.
The acquisition module 42 is configured to acquire a plurality of training lips uttered by lips utterers of different ages, different sexes, and different mouth shapes, and a plurality of training control instructions for controlling an air conditioner corresponding to the respective identified lips;
and the training module 44 is connected to the obtaining module 42, and is configured to train multiple training lip languages and multiple training control instructions to obtain an instruction recognition model.
Fig. 5 is a schematic structural diagram of a control module 26 in an air conditioning control device according to an embodiment of the present invention, and as shown in fig. 5, the control module 26 includes: an acquisition unit 52, a recognition unit 54 and a determination unit 56, which are described in detail below with respect to the control module 26.
An acquisition unit 52, configured to acquire lip language for performing the same control on the air conditioner for multiple times when there are multiple control instructions determined by the instruction recognition model;
a recognition unit 54, connected to the acquisition unit 52, for recognizing a plurality of control commands corresponding to the lip language acquired for multiple times through a command recognition model;
and the determining unit 56 is connected to the identifying unit 54 and is used for determining the control command with the largest number of times among the control commands as the control command for controlling the air conditioner by the acquired lip language.
The air conditioner control device comprises a processor and a memory, wherein the acquisition module 22, the determination module 24, the control module 26 and the like are stored in the memory as program units, and the processor executes the program units stored in the memory to realize corresponding functions.
According to another embodiment of the present invention, there is also provided a storage medium including a stored program, wherein the program executes the air-conditioning control method of any one of the above.
According to another embodiment of the present invention, there is also provided a processor for executing a program, wherein the program executes the air conditioner control method according to any one of the above.
The processor comprises a kernel, and the kernel calls a corresponding program unit from the memory. The inner core can be set to be one or more than one, and the air conditioner control is realized by adjusting the inner core parameters.
The memory may include volatile memory in a computer readable medium, Random Access Memory (RAM) and/or nonvolatile memory such as Read Only Memory (ROM) or flash memory (flash RAM), and the memory includes at least one memory chip.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
In the above embodiments of the present invention, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In the embodiments provided in the present application, it should be understood that the disclosed technology can be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units may be a logical division, and in actual implementation, there may be another division, for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, units or modules, and may be in an electrical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.
The foregoing is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, various modifications and decorations can be made without departing from the principle of the present invention, and these modifications and decorations should also be regarded as the protection scope of the present invention.
Claims (6)
1. An air conditioner control method, comprising:
acquiring a lip language for controlling the air conditioner;
determining a control instruction for controlling the air conditioner by the acquired lip language through an instruction identification model, wherein the instruction identification model is obtained by using multiple groups of data through machine learning training, and each group of data in the multiple groups of data comprises: the control instruction is used for identifying the lip language to control the air conditioner;
controlling the air conditioner according to the determined control instruction;
before determining the acquired control command for controlling the air conditioner by the lip language through the command recognition model, the method further includes:
acquiring a plurality of training lips sent by lip language senders with different ages, sexes and mouth shapes, and a plurality of training control instructions for controlling the air conditioner, which correspond to the plurality of training lips identified respectively;
training the training lip languages and the training control instructions to obtain the instruction recognition model;
the control instruction for controlling the air conditioner by the lip language determined and obtained through the instruction identification model comprises the following steps:
under the condition that a plurality of control instructions are determined through the instruction identification model, lip language used for carrying out the same control on the air conditioner is collected for a plurality of times;
identifying a plurality of control instructions corresponding to the lip language acquired for multiple times respectively through the instruction identification model;
and determining the control instruction with the most times in the control instructions as the acquired control instruction for controlling the air conditioner by the lip language.
2. The method of claim 1, wherein the lip language for controlling the air conditioner is acquired by at least one of:
acquiring the lip language for controlling the air conditioner in a mode of photographing the mouth of the lip language speaker of the lip language;
acquiring the lip language for controlling the air conditioner in a mode of recording the mouth of the lip language sender of the lip language;
the method comprises the steps of obtaining the lip language used for controlling the air conditioner by emitting light to the side face of the mouth of a lip language speaker of the lip language and obtaining the image of the emitted light to the mouth.
3. An air conditioning control device, characterized by comprising:
the acquisition module is used for acquiring lip language for controlling the air conditioner;
the determining module is used for determining a control instruction for controlling the air conditioner by the acquired lip language through an instruction recognition model, wherein the instruction recognition model is obtained by using multiple groups of data through machine learning training, and each group of data in the multiple groups of data comprises: the control instruction is used for identifying the lip language to control the air conditioner;
the control module is used for controlling the air conditioner according to the determined control instruction;
wherein the apparatus further comprises:
the acquisition module is used for acquiring a plurality of training labial utterers uttered by labial utterers of different ages, different sexes and different mouth shapes and a plurality of training control instructions for controlling the air conditioner, which correspond to the identified labial;
the training module is used for training the training lip languages and the training control instructions to obtain the instruction recognition model;
wherein the control module comprises:
the acquisition unit is used for acquiring lip language for performing the same control on the air conditioner for multiple times under the condition that the control instructions determined by the instruction identification model are multiple;
the identification unit is used for identifying a plurality of control instructions corresponding to the lip language acquired for multiple times respectively through the instruction identification model;
and the determining unit is used for determining the control instruction with the largest number of times in the plurality of control instructions as the acquired control instruction for controlling the air conditioner by the lip language.
4. The apparatus of claim 3, wherein the acquisition module comprises at least one of:
the photographing unit is used for acquiring the lip language for controlling the air conditioner in a mode of photographing the mouth of the lip language speaker of the lip language;
the video recording unit is used for acquiring the lip language for controlling the air conditioner in a mode of recording the mouth of the lip language sender of the lip language;
and the imaging unit is used for acquiring the lip language for controlling the air conditioner by emitting light to the side surface of the mouth of the lip language speaker of the lip language and acquiring the mode that the emitted light forms an image on the mouth.
5. A storage medium characterized by comprising a stored program, wherein the program executes the air-conditioning control method of claim 1 or 2.
6. A processor, characterized in that the processor is configured to run a program, wherein the program is executed to execute the air conditioning control method according to claim 1 or 2 when running.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710858102.0A CN107702273B (en) | 2017-09-20 | 2017-09-20 | Air conditioner control method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710858102.0A CN107702273B (en) | 2017-09-20 | 2017-09-20 | Air conditioner control method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107702273A CN107702273A (en) | 2018-02-16 |
| CN107702273B true CN107702273B (en) | 2020-06-16 |
Family
ID=61172962
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710858102.0A Active CN107702273B (en) | 2017-09-20 | 2017-09-20 | Air conditioner control method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107702273B (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107726540A (en) * | 2017-09-27 | 2018-02-23 | 珠海格力电器股份有限公司 | Air conditioner control method and device |
| CN108428453A (en) * | 2018-03-27 | 2018-08-21 | 王凯 | A kind of intelligent terminal control system based on lip reading identification |
| CN109241907A (en) * | 2018-09-03 | 2019-01-18 | 北京旷视科技有限公司 | Mask method, device and electronic equipment |
| CN110941188A (en) * | 2018-09-25 | 2020-03-31 | 珠海格力电器股份有限公司 | Intelligent household control method and device |
| CN111007806B (en) * | 2018-10-08 | 2022-04-08 | 珠海格力电器股份有限公司 | Smart home control method and device |
| CN110030704A (en) * | 2019-05-20 | 2019-07-19 | 珠海格力电器股份有限公司 | Control method and device of air conditioner, storage medium and air conditioner |
| CN110736231A (en) * | 2019-10-29 | 2020-01-31 | 珠海格力电器股份有限公司 | Air conditioner control method and device, air conditioner, storage medium and processor |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4769845A (en) * | 1986-04-10 | 1988-09-06 | Kabushiki Kaisha Carrylab | Method of recognizing speech using a lip image |
| JPH07306692A (en) * | 1994-05-13 | 1995-11-21 | Matsushita Electric Ind Co Ltd | Speech recognizer and sound inputting device |
| CN101937268A (en) * | 2009-06-30 | 2011-01-05 | 索尼公司 | Device control based on the identification of vision lip |
| CN102932212A (en) * | 2012-10-12 | 2013-02-13 | 华南理工大学 | Intelligent household control system based on multichannel interaction manner |
| CN103940042A (en) * | 2014-04-14 | 2014-07-23 | 美的集团股份有限公司 | Control equipment and control method |
| CN104409075A (en) * | 2014-11-28 | 2015-03-11 | 深圳创维－Rgb电子有限公司 | Voice identification method and system |
| CN105867148A (en) * | 2016-04-18 | 2016-08-17 | 浙江理工大学 | System and method for intelligent home control based on flexible electronic skin |
-
2017
- 2017-09-20 CN CN201710858102.0A patent/CN107702273B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4769845A (en) * | 1986-04-10 | 1988-09-06 | Kabushiki Kaisha Carrylab | Method of recognizing speech using a lip image |
| JPH07306692A (en) * | 1994-05-13 | 1995-11-21 | Matsushita Electric Ind Co Ltd | Speech recognizer and sound inputting device |
| CN101937268A (en) * | 2009-06-30 | 2011-01-05 | 索尼公司 | Device control based on the identification of vision lip |
| CN102932212A (en) * | 2012-10-12 | 2013-02-13 | 华南理工大学 | Intelligent household control system based on multichannel interaction manner |
| CN103940042A (en) * | 2014-04-14 | 2014-07-23 | 美的集团股份有限公司 | Control equipment and control method |
| CN104409075A (en) * | 2014-11-28 | 2015-03-11 | 深圳创维－Rgb电子有限公司 | Voice identification method and system |
| CN105867148A (en) * | 2016-04-18 | 2016-08-17 | 浙江理工大学 | System and method for intelligent home control based on flexible electronic skin |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107702273A (en) | 2018-02-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107702273B (en) | Air conditioner control method and device | |
| CN106657893B (en) | Recorded broadcast method and system with intelligent handoff functionality | |
| CN106650671A (en) | Human face identification method, apparatus and system | |
| CN109982054B (en) | Projection method and device based on positioning tracking, projector and projection system | |
| CN110868554B (en) | Method, device and equipment for changing faces in real time in live broadcast and storage medium | |
| CN104780308A (en) | Information processing method and electronic device | |
| CN108337471B (en) | Video picture processing method and device | |
| CN107622246B (en) | Face recognition method and related product | |
| CN107395957B (en) | Photographing method and device, storage medium and electronic equipment | |
| CN112151029A (en) | Voice awakening and recognition automatic test method, storage medium and test terminal | |
| CN104053060A (en) | Intelligent television and television program playing method thereof | |
| KR101077267B1 (en) | Stenography Input System And Method For Conference Using Face Recognition | |
| CN107404721A (en) | Internet of things equipment matches somebody with somebody network method, image-pickup method and equipment | |
| CN111401238B (en) | Method and device for detecting character close-up fragments in video | |
| CN103019369A (en) | Electronic device and method for playing documents based on facial expressions | |
| CN106331460A (en) | Image processing method and device, and terminal | |
| CN113759748A (en) | Intelligent home control method and system based on Internet of things | |
| JP2022105553A (en) | Information processing device, information processing method, and program | |
| CN105049714A (en) | Figure image preview method and device | |
| EP2575358B1 (en) | Display apparatus and control method thereof | |
| CN106162222B (en) | A kind of method and device of video lens cutting | |
| CN109286718A (en) | Screen recording method and device and electronic equipment | |
| CN104469249B (en) | A kind of information processing method and the first electronic equipment | |
| CN106775701B (en) | Client automatic evidence obtaining method and system | |
| US10541006B2 (en) | Information processor, information processing method, and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |