CN112002316A - Electric appliance control method and device, storage medium and terminal - Google Patents
Electric appliance control method and device, storage medium and terminal Download PDFInfo
- Publication number
- CN112002316A CN112002316A CN202010751763.5A CN202010751763A CN112002316A CN 112002316 A CN112002316 A CN 112002316A CN 202010751763 A CN202010751763 A CN 202010751763A CN 112002316 A CN112002316 A CN 112002316A
- Authority
- CN
- China
- Prior art keywords
- voice
- user
- image
- local area
- area network
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 238000000034 method Methods 0.000 title claims abstract description 37
- 238000000605 extraction Methods 0.000 claims abstract description 19
- 230000004044 response Effects 0.000 claims description 16
- 238000004590 computer program Methods 0.000 claims description 6
- 230000006870 function Effects 0.000 description 6
- 230000003993 interaction Effects 0.000 description 6
- 238000006243 chemical reaction Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 238000007781 pre-processing Methods 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000013528 artificial neural network Methods 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 238000007664 blowing Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000005406 washing Methods 0.000 description 2
- 230000007547 defect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/26—Speech to text systems
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/28—Constructional details of speech recognition systems
- G10L15/30—Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L17/00—Speaker identification or verification techniques
- G10L17/22—Interactive procedures; Man-machine interfaces
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
- H04L67/125—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks involving control of end-device applications over a network
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Computational Linguistics (AREA)
- Computing Systems (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Selective Calling Equipment (AREA)
- Telephonic Communication Services (AREA)
Abstract
The invention provides an electric appliance control method, an electric appliance control device, a storage medium and a terminal, wherein the method comprises the following steps: acquiring an image acquired by image acquisition equipment of an electric appliance in a local area network, and performing feature extraction on the image to obtain a corresponding feature image; acquiring user voice acquired by voice acquisition equipment of an electric appliance in a local area network, and identifying the user voice to obtain corresponding voice identification information; uploading the characteristic image to a cloud server for characteristic image recognition to obtain a corresponding image recognition result, and/or uploading the voice recognition information to the cloud server for processing to obtain a corresponding voice processing result; and transmitting the image recognition result and/or the voice processing result to a corresponding electric appliance in the local area network, and executing corresponding operation by the corresponding electric appliance according to the image recognition result and/or the voice processing result. The scheme provided by the invention can reduce the data volume uploaded through the network and reduce the network delay.
Description
Technical Field
The invention relates to the field of control, in particular to an electric appliance control method, an electric appliance control device, a storage medium and a terminal.
Background
At present, a household air conditioner has an offline function and an online function, the online function is that relevant data are read through a voice module or a visual module and uploaded to a cloud, the relevant data collected by a camera and a microphone are processed at the cloud, the data volume of network transmission is large, and thus network delay can be caused.
Disclosure of Invention
The invention mainly aims to overcome the defects of the prior art and provides an electric appliance control method, an electric appliance control device, a storage medium and a terminal, so as to solve the problems that data acquired by a camera and a microphone of an electric appliance in the prior art needs to be uploaded to a cloud for processing, the transmission data volume is large, and network delay is caused.
The invention provides an electric appliance control method on one hand, which comprises the following steps: acquiring an image acquired by image acquisition equipment of an electric appliance in a local area network, and performing feature extraction on the image to obtain a corresponding feature image, wherein the feature image comprises: the area image of the user and/or the gesture area image of the user; the method comprises the steps of obtaining user voice collected by voice collecting equipment of an electric appliance in a local area network, and identifying and processing the user voice to obtain corresponding voice recognition information, wherein the voice recognition information comprises the following steps: voice text information; uploading the characteristic image to a cloud server for characteristic image recognition to obtain a corresponding image recognition result, and/or uploading the voice recognition information to the cloud server for processing to obtain a corresponding voice processing result; and transmitting the image recognition result and/or the voice processing result to a corresponding electric appliance in the local area network, and executing corresponding operation by the corresponding electric appliance according to the image recognition result and/or the voice processing result.
Optionally, the image recognition result includes: a control instruction corresponding to the position of the user and/or the gesture of the user; and/or the voice processing result comprises: a control instruction corresponding to the user voice and a response voice corresponding to the user voice.
Optionally, the issuing the voice processing result to a corresponding electrical appliance in the local area network includes: when the voice processing result is an electric appliance awakening instruction, if the awakening instruction corresponds to more than two electric appliances in the local area network, determining the electric appliance which is closest to a user in the more than two electric appliances according to the voice energy of the user or the image processing result; the awakening instruction is issued to the electric appliance which is closest to the user in the more than two electric appliances so as to awaken the electric appliance which is closest to the user; and/or, the step of sending the image recognition result to the corresponding electric appliance in the local area network comprises the following steps: and when the image recognition result is the position of the user, the image recognition result is issued to the air conditioner in the local area network, so that the air conditioner can carry out wind-sheltering control or wind-following control according to the position of the user.
Optionally, the method further comprises: and storing the offline download resources of the electric appliances in the local area network so as to be used for sharing the offline download resources by the electric appliances in the local area network.
Another aspect of the present invention provides an electric appliance control apparatus, including: the image processing unit is used for acquiring images acquired by image acquisition equipment of the electrical appliance in the local area network, and performing feature extraction on the images to obtain corresponding feature images, wherein the feature images comprise: the area image of the user and/or the gesture area image of the user; the voice processing unit is used for acquiring user voice acquired by voice acquisition equipment of an electric appliance in a local area network, and recognizing and processing the user voice to obtain corresponding voice recognition information, wherein the voice recognition information comprises: voice text information; the uploading unit is used for uploading the characteristic image to a cloud server for characteristic image recognition to obtain a corresponding image recognition result, and/or uploading the voice recognition information to the cloud server for processing to obtain a corresponding voice processing result; and the sending unit is used for sending the image recognition result and/or the voice processing result to corresponding electric appliances in the local area network, and the corresponding electric appliances execute corresponding operations according to the image recognition result and/or the voice processing result.
Optionally, the image recognition result includes: a control instruction corresponding to the position of the user and/or the gesture of the user; and/or the voice processing result comprises: a control instruction corresponding to the user voice and a response voice corresponding to the user voice.
Optionally, the sending unit sends the voice processing result to a corresponding electrical appliance in the local area network, where the sending unit includes: when the voice processing result is an electric appliance awakening instruction, if the awakening instruction corresponds to more than two electric appliances in the local area network, determining the electric appliance which is closest to a user in the more than two electric appliances according to the voice energy of the user or the image processing result; the awakening instruction is issued to the electric appliance which is closest to the user in the more than two electric appliances so as to awaken the electric appliance which is closest to the user; and/or the sending unit issues the image identification result to a corresponding electric appliance in the local area network, and the sending unit comprises: and when the image recognition result is the position of the user, the image recognition result is issued to the air conditioner in the local area network, so that the air conditioner can carry out wind-sheltering control or wind-following control according to the position of the user.
Optionally, the method further comprises: and the storage unit is used for storing the offline download resources of all the electric appliances in the local area network so as to be used for sharing the offline download resources by all the electric appliances in the local area network.
A further aspect of the invention provides a storage medium having stored thereon a computer program which, when executed by a processor, carries out the steps of any of the methods described above.
A further aspect of the invention provides a terminal comprising a processor, a memory, and a computer program stored on the memory and executable on the processor, the processor implementing the steps of any of the methods described above when executing the program.
In another aspect, the invention provides a terminal comprising any one of the above electric appliance control devices.
According to the technical scheme, the collected image information is subjected to primary characteristic image extraction and then uploaded to the cloud for further identification to obtain an image identification result, and the voice information is subjected to primary text conversion and/or voice characteristic extraction and then uploaded to the cloud for further processing to obtain a corresponding voice processing result, so that the image identification result and/or the voice processing result are issued to corresponding electric appliances in the local area network, corresponding operation is executed, the data volume uploaded through the network can be reduced, the network delay is reduced, the processing speed of the image information and the voice information can be improved, the network burden is reduced, the cloud computing burden is reduced, and the user experience is improved. The invention can also realize that different household appliances share the off-line resources, and can also utilize more shared resources under the off-line condition.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the invention and not to limit the invention. In the drawings:
FIG. 1 is a method diagram of an embodiment of an appliance control method provided by the present invention;
fig. 2 is a schematic structural diagram of an embodiment of an electrical appliance control device provided in the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the technical solutions of the present invention will be clearly and completely described below with reference to the specific embodiments of the present invention and the accompanying drawings. It is to be understood that the described embodiments are merely exemplary of the invention, and not restrictive of the full scope of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
The invention provides an electric appliance control method. The electric appliance control method is used for controlling electric appliances in the same local area network. The control method can be implemented in a terminal device or a router, and the terminal device and the electric appliances in the same local area network are connected and communicated in a wired (for example, connected through a serial port) or wireless mode.
Fig. 1 is a schematic method diagram of an embodiment of an appliance control method provided by the present invention.
As shown in fig. 1, according to an embodiment of the present invention, the appliance control method includes at least step S110, step S120, and step S130.
Step S110, acquiring an image acquired by image acquisition equipment of an electric appliance in the local area network, and performing feature extraction on the image to obtain a corresponding feature image.
For example, electrical appliances such as an air conditioner, a refrigerator, and a washing machine are all connected to a home lan, and images acquired by image acquisition devices of the electrical appliances in the home lan are acquired. For example, an image collected by a camera of an air conditioner is received. And carrying out primary feature extraction on the obtained image to obtain a feature image. The feature image may specifically include: the image of the area where the user is located and/or the image of the gesture area of the user. For example, the acquired image is input into a neural network backbone network (e.g., Resnet or Resnext network) to perform feature extraction, so as to obtain a feature image and reduce useless information. For example, the image is subjected to image preprocessing, including adding image light or rotating the image, so that the degree of image recognition can be increased, and the characteristic image is obtained by performing convolution processing after the image preprocessing.
Step S120, obtaining user voice collected by voice collecting equipment of the electric appliance in the local area network, and identifying the user voice to obtain corresponding voice identification information.
The speech recognition information may specifically include: speech text information. Specifically, the speech text information corresponding to the speech information is obtained by recognizing the speech of the user.
Step S130, uploading the feature image to a cloud server for feature image recognition to obtain a corresponding image recognition result, and/or uploading the voice recognition information to the cloud server for processing to obtain a corresponding voice processing result.
Specifically, the characteristic image is uploaded to a cloud server, and the cloud server performs further image recognition on the characteristic image to obtain an image recognition result. The image recognition result may specifically include a position where the user is located and/or a control instruction corresponding to the user gesture. And uploading the voice recognition information to a cloud server, and further processing the voice recognition information by the cloud server to obtain a voice processing result. The voice processing result comprises: the control instruction corresponding to the user voice and/or the response voice corresponding to the user voice. For example, when the collected user voice information is a voice control instruction of the user, the cloud server performs semantic recognition on the voice text information to obtain corresponding semantic information, and then performs control instruction matching according to the semantic information obtained by recognition to obtain a control instruction corresponding to the user voice. The control instructions may include appliance wake-up instructions and appliance control instructions. For another example, when the collected user voice information is a voice interactive conversation, the cloud server performs semantic recognition on the voice text information to obtain corresponding semantic information, generates a corresponding response text according to the semantic information, and converts the response text into corresponding response voice through the TTS module.
Step S140, the image recognition result and/or the voice processing result are/is sent to the corresponding electric appliance in the local area network, and the corresponding electric appliance executes the corresponding operation according to the image recognition result and/or the voice processing result.
When the voice processing result is an electrical appliance wake-up instruction, the step of issuing the voice processing result to a corresponding electrical appliance in the local area network may include: if the awakening instruction corresponds to more than two electric appliances in the local area network, determining the electric appliance which is closest to the user in the more than two electric appliances according to the sound energy of the voice of the user or the image processing result; and issuing the awakening command to the electric appliance which is closest to the user in the more than two electric appliances so as to awaken the electric appliance which is closest to the user.
For example, when the local area network includes more than two air conditioners, if the wake-up words of the air conditioners are the same, when a user wants to wake up the air conditioner to say the wake-up words, the user obtains the voices of more than two users collected by the voice collection devices (e.g., microphones) of more than two air conditioners, determines that the electrical appliance corresponding to the voice of the user with the highest sound energy in the collected voices of more than two users (i.e., the electrical appliance where the voice collection device collecting the voices is located) is the electrical appliance closest to the user, and issues a wake-up instruction to the electrical appliance closest to the user in the more than two air conditioners. The electric appliance is awakened nearby, and confusion caused by simultaneous awakening of more than two air conditioners is avoided.
And when the voice processing result is an electrical appliance control instruction, transmitting the voice processing result (namely the electrical appliance control instruction) to the corresponding electrical appliance in the local area network according to the control target of the electrical appliance control instruction.
And when the voice processing result is response voice, namely the user carries out voice interaction conversation with a certain electric appliance, the voice processing result (namely the response voice) is sent to the electric appliance carrying out voice interaction conversation with the user, and the electric appliance plays the voice processing result so as to realize voice interaction with the user.
Issuing the image recognition result to a corresponding electric appliance in the local area network, wherein the image recognition result comprises the following steps: and when the image recognition result is the position of the user, the image recognition result is issued to the air conditioner in the local area network, so that the air conditioner can carry out wind-avoiding control or wind-blowing control according to the position of the user.
According to the embodiment of the invention, the collected image information is subjected to primary characteristic image extraction and then uploaded to the cloud for further identification to obtain an image identification result, and the voice information is subjected to primary text conversion and/or voice characteristic extraction and then uploaded to the cloud for further processing to obtain a corresponding voice processing result, so that the image identification result and/or the voice processing result is sent to a corresponding electric appliance in the local area network to execute corresponding operation, the data volume uploaded through the network can be reduced, the network delay is reduced, the processing speed of the image information and the voice information can be improved, the network burden is reduced, the cloud computing burden is reduced, and the user experience is improved. Besides, the electric appliance can be awakened nearby, and the intelligence of electric appliance control is improved.
Optionally, the method further comprises: and storing the offline download resources of the electric appliances in the local area network so as to be used for sharing the offline download resources by the electric appliances in the local area network.
For example, the present invention can be implemented in a terminal device, and offline download resources of each electrical appliance in a local area network can be stored in the terminal device side, and each household electrical appliance in the local area network can obtain offline download resources of other electrical appliances stored in the terminal device through a serial port or the local area network, so that more shared resources can be utilized under an offline condition. Therefore, the invention can also realize that different household appliances share the offline resources, for example, the offline resources stored by the household air conditioner and other appliances can be mutually used, such as downloaded music, videos and the like.
Optionally, when the electrical appliance in the local area network plays video and/or audio, the dolby sound effect is started.
The invention provides an electric appliance control device. The electric appliance control device is used for controlling electric appliances in the same local area network. The control device may be implemented in a terminal device or a router, and the terminal device and the electric appliances in the same local area network are connected and communicate in a wired (for example, connected through a serial port) or wireless manner.
Fig. 2 is a schematic structural diagram of an embodiment of an electrical appliance control device provided in the present invention. As shown in fig. 2, the electric appliance control apparatus 100 includes an image processing unit 110, a voice processing unit 120, an uploading unit 130, and a transmitting unit 140.
The image processing unit 110 is configured to obtain an image acquired by an image acquisition device of an electrical appliance in a local area network, and perform feature extraction on the image to obtain a corresponding feature image, where the feature image includes: the area image of the user and/or the gesture area image of the user;
for example, appliances such as air conditioners, refrigerators, and washing machines are connected to a home lan. The image processing unit 110 acquires images acquired by image acquisition devices of respective appliances in the home lan. For example, an image collected by a camera of an air conditioner is received, and a feature image is obtained by performing preliminary feature extraction on the obtained image. The feature image may specifically include: the image of the area where the user is located and/or the image of the gesture area of the user. For example, the acquired image is input into a neural network backbone network (e.g., Resnet or Resnext network) to perform feature extraction, so as to obtain a feature image and reduce useless information. For example, the image is subjected to image preprocessing, including adding image light or rotating the image, so that the degree of image recognition can be increased, and the characteristic image is obtained by performing convolution processing after the image preprocessing.
The voice processing unit 120 is configured to obtain a user voice collected by a voice collecting device of an electrical appliance in the local area network, and perform recognition processing on the user voice to obtain corresponding voice recognition information, where the voice recognition information includes: speech text information.
The speech recognition information may specifically include: speech text information. Specifically, the speech text information corresponding to the speech information is obtained by recognizing the speech of the user.
The uploading unit 130 is configured to upload the feature images to a cloud server to perform feature image recognition to obtain corresponding image recognition results, and/or upload the voice recognition information to the cloud server to perform processing to obtain corresponding voice processing results.
Specifically, the characteristic image is uploaded to a cloud server, and the cloud server performs further image recognition on the characteristic image to obtain an image recognition result. The image recognition result may specifically include a position where the user is located and/or a control instruction corresponding to the user gesture. And uploading the voice recognition information to a cloud server, and further processing the voice recognition information by the cloud server to obtain a voice processing result. The voice processing result comprises: the control instruction corresponding to the user voice and/or the response voice corresponding to the user voice. For example, when the collected user voice information is a voice control instruction of the user, the cloud server performs semantic recognition on the voice text information to obtain corresponding semantic information, and then performs control instruction matching according to the semantic information obtained by recognition to obtain a control instruction corresponding to the user voice. The control instructions may include appliance wake-up instructions and appliance control instructions. For another example, when the collected user voice information is a voice interactive conversation, the cloud server performs semantic recognition on the voice text information to obtain corresponding semantic information, generates a corresponding response text according to the semantic information, and converts the response text into corresponding response voice through the TTS module.
The sending unit 140 is configured to send the image recognition result and/or the voice processing result to a corresponding electrical appliance in the local area network, and the corresponding electrical appliance performs a corresponding operation according to the image recognition result and/or the voice processing result.
When the voice processing result is an electrical appliance wake-up instruction, the sending unit 140 issues the voice processing result to a corresponding electrical appliance in the local area network, and the sending unit may include: if the awakening instruction corresponds to more than two electric appliances in the local area network, determining the electric appliance which is closest to the user in the more than two electric appliances according to the sound energy of the voice of the user or the image processing result; and issuing the awakening command to the electric appliance which is closest to the user in the more than two electric appliances so as to awaken the electric appliance which is closest to the user.
For example, when the local area network includes more than two air conditioners, if the wake-up words of the air conditioners are the same, when a user wants to wake up the air conditioner to say the wake-up words, the user obtains the voices of more than two users collected by the voice collection devices (e.g., microphones) of more than two air conditioners, determines that the electrical appliance corresponding to the voice of the user with the highest sound energy in the collected voices of more than two users (i.e., the electrical appliance where the voice collection device collecting the voices is located) is the electrical appliance closest to the user, and issues a wake-up instruction to the electrical appliance closest to the user in the more than two air conditioners. The electric appliance is awakened nearby, and confusion caused by simultaneous awakening of more than two air conditioners is avoided.
When the voice processing result is an electrical appliance control instruction, the sending unit 140 sends the voice processing result (i.e., the electrical appliance control instruction) to the corresponding electrical appliance in the local area network according to the control target of the electrical appliance control instruction.
And when the voice processing result is response voice, namely the user carries out voice interaction conversation with a certain electric appliance, the voice processing result (namely the response voice) is sent to the electric appliance carrying out voice interaction conversation with the user, and the electric appliance plays the voice processing result so as to realize voice interaction with the user.
The sending unit 140 sends the image recognition result to the corresponding electrical appliance in the local area network, including: and when the image recognition result is the position of the user, the image recognition result is issued to the air conditioner in the local area network, so that the air conditioner can carry out wind-avoiding control or wind-blowing control according to the position of the user.
According to the embodiment of the invention, the collected image information is subjected to primary characteristic image extraction and then uploaded to the cloud for further identification to obtain an image identification result, and the voice information is subjected to primary text conversion and/or voice characteristic extraction and then uploaded to the cloud for further processing to obtain a corresponding voice processing result, so that the image identification result and/or the voice processing result is sent to a corresponding electric appliance in the local area network to execute corresponding operation, the data volume uploaded through the network can be reduced, the network delay is reduced, the processing speed of the image information and the voice information can be improved, the network burden is reduced, the cloud computing burden is reduced, and the user experience is improved. Besides, the electric appliance can be awakened nearby, and the intelligence of electric appliance control is improved.
Optionally, the apparatus 100 further comprises: a storage unit (not shown) for storing the offline download resources of the appliances in the local area network, so that the appliances in the local area network share the offline download resources.
For example, the present invention can be implemented in a terminal device, and offline download resources of each electrical appliance in a local area network can be stored in the terminal device side, and each household electrical appliance in the local area network can obtain offline download resources of other electrical appliances stored in the terminal device through a serial port or the local area network, so that more shared resources can be utilized under an offline condition. Therefore, the invention can also realize that different household appliances share the offline resources, for example, the offline resources stored by the household air conditioner and other appliances can be mutually used, such as downloaded music, videos and the like.
The invention also provides a storage medium corresponding to the appliance control method, on which a computer program is stored, which program, when executed by a processor, carries out the steps of any of the methods described above.
The invention also provides a terminal corresponding to the electric appliance control method, which comprises a processor, a memory and a computer program stored on the memory and capable of running on the processor, wherein the processor executes the program to realize the steps of any one of the methods.
The invention also provides a terminal corresponding to the electric appliance control device, which comprises any one of the electric appliance control devices.
According to the scheme provided by the invention, the collected image information is subjected to primary characteristic image extraction and then uploaded to the cloud for further identification to obtain an image identification result, and the voice information is subjected to primary text conversion and/or voice characteristic extraction and then uploaded to the cloud for further processing to obtain a corresponding voice processing result, so that the image identification result and/or the voice processing result are issued to corresponding electric appliances in the local area network, corresponding operation is executed, the data volume uploaded through the network can be reduced, the network delay is reduced, the processing speed of the image information and the voice information can be improved, the network burden is reduced, the cloud computing burden is reduced, and the user experience is improved. The invention can also realize that different household appliances share the off-line resources, and can also utilize more shared resources under the off-line condition.
The functions described herein may be implemented in hardware, software executed by a processor, firmware, or any combination thereof. If implemented in software executed by a processor, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Other examples and implementations are within the scope and spirit of the invention and the following claims. For example, due to the nature of software, the functions described above may be implemented using software executed by a processor, hardware, firmware, hardwired, or a combination of any of these. In addition, each functional unit may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
In the embodiments provided in the present application, it should be understood that the disclosed technology can be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units may be a logical division, and in actual implementation, there may be another division, for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, units or modules, and may be in an electrical or other form.
The units described as separate parts may or may not be physically separate, and the parts serving as the control device may or may not be physical units, may be located in one place, or may be distributed on a plurality of units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.
The above description is only an example of the present invention, and is not intended to limit the present invention, and it is obvious to those skilled in the art that various modifications and variations can be made in the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the scope of the claims of the present invention.
Claims (10)
1. An appliance control method, comprising:
acquiring an image acquired by image acquisition equipment of an electric appliance in a local area network, and performing feature extraction on the image to obtain a corresponding feature image, wherein the feature image comprises: the area image of the user and/or the gesture area image of the user;
the method comprises the steps of obtaining user voice collected by voice collecting equipment of an electric appliance in a local area network, and identifying and processing the user voice to obtain corresponding voice recognition information, wherein the voice recognition information comprises the following steps: voice text information;
uploading the characteristic image to a cloud server for characteristic image recognition to obtain a corresponding image recognition result, and/or uploading the voice recognition information to the cloud server for processing to obtain a corresponding voice processing result;
and transmitting the image recognition result and/or the voice processing result to a corresponding electric appliance in the local area network, and executing corresponding operation by the corresponding electric appliance according to the image recognition result and/or the voice processing result.
2. The method of claim 1,
the image recognition result comprises: a control instruction corresponding to the position of the user and/or the gesture of the user; and/or the presence of a gas in the gas,
the voice processing result comprises: a control instruction corresponding to the user voice and a response voice corresponding to the user voice.
3. The method of claim 1 or 2, wherein issuing the voice processing result to a corresponding appliance in the local area network comprises:
when the voice processing result is an electric appliance awakening instruction, if the awakening instruction corresponds to more than two electric appliances in the local area network, determining the electric appliance which is closest to a user in the more than two electric appliances according to the voice energy of the user or the image processing result;
the awakening instruction is issued to the electric appliance which is closest to the user in the more than two electric appliances so as to awaken the electric appliance which is closest to the user;
and/or the presence of a gas in the gas,
issuing the image recognition result to a corresponding electric appliance in the local area network, wherein the image recognition result comprises the following steps:
and when the image recognition result is the position of the user, the image recognition result is issued to the air conditioner in the local area network, so that the air conditioner can carry out wind-sheltering control or wind-following control according to the position of the user.
4. The method of claim 1 or 2, further comprising:
and storing the offline download resources of the electric appliances in the local area network so as to be used for sharing the offline download resources by the electric appliances in the local area network.
5. An appliance control device, comprising:
the image processing unit is used for acquiring images acquired by image acquisition equipment of the electrical appliance in the local area network, and performing feature extraction on the images to obtain corresponding feature images, wherein the feature images comprise: the area image of the user and/or the gesture area image of the user;
the voice processing unit is used for acquiring user voice acquired by voice acquisition equipment of an electric appliance in a local area network, and recognizing and processing the user voice to obtain corresponding voice recognition information, wherein the voice recognition information comprises: voice text information;
the uploading unit is used for uploading the characteristic image to a cloud server for characteristic image recognition to obtain a corresponding image recognition result, and/or uploading the voice recognition information to the cloud server for processing to obtain a corresponding voice processing result;
and the sending unit is used for sending the image recognition result and/or the voice processing result to corresponding electric appliances in the local area network, and the corresponding electric appliances execute corresponding operations according to the image recognition result and/or the voice processing result.
6. The apparatus of claim 5,
the image recognition result comprises: a control instruction corresponding to the position of the user and/or the gesture of the user; and/or the presence of a gas in the gas,
the voice processing result comprises: a control instruction corresponding to the user voice and a response voice corresponding to the user voice.
7. The apparatus of claim 5 or 6,
the sending unit sends the voice processing result to the corresponding electric appliance in the local area network, and the sending unit comprises:
when the voice processing result is an electric appliance awakening instruction, if the awakening instruction corresponds to more than two electric appliances in the local area network, determining the electric appliance which is closest to a user in the more than two electric appliances according to the voice energy of the user or the image processing result;
the awakening instruction is issued to the electric appliance which is closest to the user in the more than two electric appliances so as to awaken the electric appliance which is closest to the user;
and/or the presence of a gas in the gas,
the sending unit sends the image recognition result to the corresponding electrical appliance in the local area network, and the sending unit comprises:
and when the image recognition result is the position of the user, the image recognition result is issued to the air conditioner in the local area network, so that the air conditioner can carry out wind-sheltering control or wind-following control according to the position of the user.
8. The apparatus of claim 5 or 6, further comprising:
and the storage unit is used for storing the offline download resources of all the electric appliances in the local area network so as to be used for sharing the offline download resources by all the electric appliances in the local area network.
9. A storage medium, having stored thereon a computer program which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 4.
10. A terminal device comprising a processor, a memory, and a computer program stored on the memory and operable on the processor, the processor implementing the steps of the method according to any one of claims 1 to 4 when executing the program, or comprising an appliance control apparatus according to any one of claims 5 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010751763.5A CN112002316A (en) | 2020-07-30 | 2020-07-30 | Electric appliance control method and device, storage medium and terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010751763.5A CN112002316A (en) | 2020-07-30 | 2020-07-30 | Electric appliance control method and device, storage medium and terminal |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112002316A true CN112002316A (en) | 2020-11-27 |
Family
ID=73463301
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010751763.5A Withdrawn CN112002316A (en) | 2020-07-30 | 2020-07-30 | Electric appliance control method and device, storage medium and terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112002316A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113242163A (en) * | 2021-06-09 | 2021-08-10 | 思必驰科技股份有限公司 | Voice wake-up method and device |
| CN113469169A (en) * | 2021-07-26 | 2021-10-01 | 湖州师范学院 | Steel cylinder perforation code positioning and identifying system and identifying method |
| CN114110912A (en) * | 2021-11-08 | 2022-03-01 | 珠海格力电器股份有限公司 | Voice distributed recognition method combined with PLC |
| CN118675533A (en) * | 2024-08-21 | 2024-09-20 | 江西师范大学 | GMM and ResNext fused speaker confirmation method |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR101330671B1 (en) * | 2012-09-28 | 2013-11-15 | 삼성전자주식회사 | Electronic device, server and control methods thereof |
| CN103491157A (en) * | 2013-09-18 | 2014-01-01 | 华南理工大学 | Non-contact hotel light managing system and method |
| CN106440200A (en) * | 2016-09-26 | 2017-02-22 | 珠海格力电器股份有限公司 | Control method and device of air conditioner and control method and device of terminal equipment |
| CN106970905A (en) * | 2016-01-14 | 2017-07-21 | 芋头科技（杭州）有限公司 | A kind of semantic analysis |
| CN107544271A (en) * | 2017-09-18 | 2018-01-05 | 广东美的制冷设备有限公司 | Terminal control method, device and computer-readable recording medium |
| CN109817211A (en) * | 2019-02-14 | 2019-05-28 | 珠海格力电器股份有限公司 | Electric appliance control method and device, storage medium and electric appliance |
| CN111261159A (en) * | 2020-01-19 | 2020-06-09 | 百度在线网络技术（北京）有限公司 | Information indication method and device |
-
2020
- 2020-07-30 CN CN202010751763.5A patent/CN112002316A/en not_active Withdrawn
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR101330671B1 (en) * | 2012-09-28 | 2013-11-15 | 삼성전자주식회사 | Electronic device, server and control methods thereof |
| CN103491157A (en) * | 2013-09-18 | 2014-01-01 | 华南理工大学 | Non-contact hotel light managing system and method |
| CN106970905A (en) * | 2016-01-14 | 2017-07-21 | 芋头科技（杭州）有限公司 | A kind of semantic analysis |
| CN106440200A (en) * | 2016-09-26 | 2017-02-22 | 珠海格力电器股份有限公司 | Control method and device of air conditioner and control method and device of terminal equipment |
| CN107544271A (en) * | 2017-09-18 | 2018-01-05 | 广东美的制冷设备有限公司 | Terminal control method, device and computer-readable recording medium |
| CN109817211A (en) * | 2019-02-14 | 2019-05-28 | 珠海格力电器股份有限公司 | Electric appliance control method and device, storage medium and electric appliance |
| CN111261159A (en) * | 2020-01-19 | 2020-06-09 | 百度在线网络技术（北京）有限公司 | Information indication method and device |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113242163A (en) * | 2021-06-09 | 2021-08-10 | 思必驰科技股份有限公司 | Voice wake-up method and device |
| CN113469169A (en) * | 2021-07-26 | 2021-10-01 | 湖州师范学院 | Steel cylinder perforation code positioning and identifying system and identifying method |
| CN113469169B (en) * | 2021-07-26 | 2023-11-24 | 湖州师范学院 | Steel cylinder perforation code positioning and identifying system and identifying method |
| CN114110912A (en) * | 2021-11-08 | 2022-03-01 | 珠海格力电器股份有限公司 | Voice distributed recognition method combined with PLC |
| CN118675533A (en) * | 2024-08-21 | 2024-09-20 | 江西师范大学 | GMM and ResNext fused speaker confirmation method |
| CN118675533B (en) * | 2024-08-21 | 2024-10-29 | 江西师范大学 | GMM and ResNext fused speaker confirmation method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112002316A (en) | Electric appliance control method and device, storage medium and terminal | |
| CN106225174B (en) | Air conditioner control method and system and air conditioner | |
| CN108665897B (en) | Electric appliance control method and device, storage medium and server | |
| CN109032039B (en) | Voice control method and device | |
| CN109377995B (en) | Method and device for controlling equipment | |
| CN112051743A (en) | Device control method, conflict processing method, corresponding devices and electronic device | |
| CN105185378A (en) | Voice control method, voice control system and air conditioner capable of realizing voice control | |
| CN110808044B (en) | Voice control method and device for intelligent household equipment, electronic equipment and storage medium | |
| CN111312235A (en) | Voice interaction method, device and system | |
| CN109817211B (en) | Electric appliance control method and device, storage medium and electric appliance | |
| CN112151013A (en) | Intelligent equipment interaction method | |
| CN110932953A (en) | Intelligent household control method and device, computer equipment and storage medium | |
| CN108375911B (en) | Equipment control method and device, storage medium and equipment | |
| CN108932947B (en) | Voice control method and household appliance | |
| CN111197841A (en) | Control method, control device, remote control terminal, air conditioner, server and storage medium | |
| CN107742520B (en) | Voice control method, device and system | |
| CN108758989A (en) | A kind of air-conditioning and its application method | |
| CN113053369A (en) | Voice control method and device of intelligent household appliance and intelligent household appliance | |
| CN108521355A (en) | Method, intelligent terminal, household appliance and the device of self-defined voice control device | |
| CN106653020A (en) | Multi-business control method and system for smart sound and video equipment based on deep learning | |
| CN112908321A (en) | Device control method, device, storage medium, and electronic apparatus | |
| CN109343481B (en) | Method and device for controlling device | |
| CN113205802A (en) | Updating method of voice recognition model, household appliance and server | |
| CN111833584B (en) | Device control method, control device, control system, and storage medium | |
| CN111076347A (en) | Air conditioner control method and device, storage medium and air conditioner |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20210312 Address after: 519070 9 Building (Science and technology building) 789 Jinji Road, Qianshan, Zhuhai, Guangdong Applicant after: GREE GREEN REFRIGERATION TECHNOLOGY CENTER Co.,Ltd. OF ZHUHAI Address before: 519070, Jinji Hill Road, front hill, Zhuhai, Guangdong Applicant before: GREE ELECTRIC APPLIANCES,Inc.OF ZHUHAI |
|
| TA01 | Transfer of patent application right | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20201127 |
|
| WW01 | Invention patent application withdrawn after publication |