CN112861571A - Household appliance control method, control device and computer readable storage medium - Google Patents
Household appliance control method, control device and computer readable storage medium Download PDFInfo
- Publication number
- CN112861571A CN112861571A CN201911176261.8A CN201911176261A CN112861571A CN 112861571 A CN112861571 A CN 112861571A CN 201911176261 A CN201911176261 A CN 201911176261A CN 112861571 A CN112861571 A CN 112861571A
- Authority
- CN
- China
- Prior art keywords
- image
- parameters
- operation parameters
- household appliance
- characters
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 42
- 238000001514 detection method Methods 0.000 claims abstract description 14
- 238000012549 training Methods 0.000 claims description 31
- 238000004590 computer program Methods 0.000 claims description 16
- 230000004044 response Effects 0.000 claims description 8
- 230000006870 function Effects 0.000 claims description 6
- 230000007613 environmental effect Effects 0.000 claims description 5
- 238000010606 normalization Methods 0.000 claims description 5
- 238000007781 pre-processing Methods 0.000 claims description 5
- 238000010586 diagram Methods 0.000 description 10
- 239000000284 extract Substances 0.000 description 6
- 238000004891 communication Methods 0.000 description 4
- 238000000605 extraction Methods 0.000 description 4
- 238000004458 analytical method Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 241001417527 Pempheridae Species 0.000 description 2
- 238000012015 optical character recognition Methods 0.000 description 2
- 238000013519 translation Methods 0.000 description 2
- 238000005406 washing Methods 0.000 description 2
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 2
- 238000004378 air conditioning Methods 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000013527 convolutional neural network Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003062 neural network model Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/10—Terrestrial scenes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
- G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/10—Character recognition
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- General Physics & Mathematics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Artificial Intelligence (AREA)
- General Engineering & Computer Science (AREA)
- Evolutionary Computation (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Computational Linguistics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- Biophysics (AREA)
- Evolutionary Biology (AREA)
- General Health & Medical Sciences (AREA)
- Molecular Biology (AREA)
- Computing Systems (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Multimedia (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The application discloses a household appliance control method, a control device and a computer readable storage medium, wherein the embodiment of the application can acquire an image containing the running parameters of the household appliance; extracting feature information in the image, and performing parameter area detection on the image based on the feature information to obtain a target area; identifying characters in the target area to obtain operation parameters; and controlling the household appliance to operate based on the operation parameters. According to the scheme, the operation parameters can be acquired based on image identification, the household electrical appliance is controlled to operate based on the operation parameters, different parameters of the household electrical appliance can be quickly adjusted, and convenience and flexibility in control of the household electrical appliance are improved.
Description
Technical Field
The present application relates to the field of electronic devices, and in particular, to a method for controlling a home appliance, a control device, and a computer-readable storage medium.
Background
With the rapid development of science and technology and the improvement of the living standard of people, household appliances such as refrigerators, fans or air conditioners are more and more popular. In the prior art, when parameters such as air volume, wind direction, or temperature of different household appliances such as a refrigerator, a fan, or an air conditioner are adjusted, a remote controller needs to enter an adjusting mode of one parameter, the parameter is manually adjusted by a user, and after the parameter adjustment is completed, the parameter is adjusted in an adjusting mode of another parameter.
Disclosure of Invention
The embodiment of the application provides a household appliance control method, a control device and a computer readable storage medium, which can improve the convenience and flexibility of household appliance control.
In a first aspect, an embodiment of the present application provides a method for controlling a home appliance, including:
acquiring an image containing running parameters of the household appliance;
extracting feature information in the image, and performing parameter area detection on the image based on the feature information to obtain a target area;
identifying characters in the target area to obtain operation parameters;
and controlling the household appliance to operate based on the operation parameters.
In a second aspect, an embodiment of the present application further provides a control device, which includes a memory and a processor, where the memory stores a computer program, and the processor executes any one of the methods for controlling a home appliance provided in the embodiment of the present application when calling the computer program in the memory.
In a third aspect, an embodiment of the present application further provides a computer-readable storage medium, where the computer-readable storage medium is used for storing a computer program, and the computer program is loaded by a processor to execute any one of the home appliance control methods provided in the embodiments of the present application.
The method and the device for detecting the home appliance operation parameter can acquire the image containing the home appliance operation parameter, extract the characteristic information in the image, and perform parameter area detection on the image based on the characteristic information to obtain the target area; and then, identifying the characters in the target area to obtain an operation parameter, and controlling the household appliance to operate based on the operation parameter. According to the scheme, the operation parameters can be acquired based on image identification, the household electrical appliance is controlled to operate based on the operation parameters, different parameters of the household electrical appliance can be quickly adjusted, and convenience and flexibility in control of the household electrical appliance are improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic flowchart of a home appliance control method according to an embodiment of the present application;
FIG. 2 is a diagram illustrating handwritten operating parameters provided in an embodiment of the present application;
FIG. 3 is another schematic diagram of handwriting operation parameters provided by an embodiment of the present application;
FIG. 4 is a schematic diagram of inputting operating parameters in a display screen provided by an embodiment of the present application;
FIG. 5 is another schematic diagram of an embodiment of the present application providing for entering operating parameters within a display screen;
FIG. 6 is a schematic diagram illustrating an embodiment of the present disclosure for identifying an operating parameter in an image;
FIG. 7 is another schematic diagram of identifying an operating parameter in an image according to an embodiment of the present disclosure;
fig. 8 is a schematic structural diagram of a control device according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The flow diagrams depicted in the figures are merely illustrative and do not necessarily include all of the elements and operations/steps, nor do they necessarily have to be performed in the order depicted. For example, some operations/steps may be decomposed, combined or partially combined, so that the actual execution sequence may be changed according to the actual situation.
The embodiment of the application provides a household appliance control method, a control device and a computer readable storage medium. The household appliance control method can be applied to control equipment, and the control equipment can comprise terminals such as a smart phone, a tablet personal computer, a palm computer or a notebook computer and is used for controlling the household appliance. The control equipment can also comprise a fan, an air conditioner, a water dispenser, a washing machine, a sweeper, a refrigerator or a television and the like with an image acquisition function, can acquire an image containing running parameters of the household appliance, extracts characteristic information in the image, performs parameter area detection on the image based on the characteristic information to obtain a target area, then identifies characters in the target area to obtain running parameters, and controls the household appliance to run based on the running parameters.
Referring to fig. 1, fig. 1 is a schematic flow chart illustrating a method for controlling a home appliance according to an embodiment of the present application. The household appliance control method may include steps S101 to S104, and the like, and specifically may be as follows:
and S101, acquiring an image containing the running parameters of the household appliance.
The household appliance equipment can comprise a fan, an air conditioner, a humidifier, a refrigerator, a washing machine, a sweeper, a water heater and the like, the control equipment can acquire images in a visible area through a camera arranged by the control equipment, or the control equipment sends a control instruction to a preset camera arranged externally, the control instruction is used for controlling the preset camera to acquire the images, and the images returned by the preset camera based on the control instruction are received. The image may include one or more images, the image may include the operation parameters of the home appliance, other backgrounds, and the like, and the same image may include one or more operation parameters, which may include timing duration, operation mode, swing wind, humidity, wind speed, temperature, on and off, and the like.
In some embodiments, obtaining an image containing operating parameters of the home device may include: collecting an image of the operating parameter drawn on paper or in a display screen; alternatively, an image of the operating parameters input on the display screen is acquired.
In order to improve the convenience and flexibility of parameter setting, the control device can acquire images of the operating parameters so as to determine the operating parameters of the household appliance based on the images of the operating parameters. Specifically, the control device may capture an image of the operating parameters manually drawn on the paper by the user, for example, as shown in fig. 2 and 3, the control device may capture an image of "pan left and right" or "air conditioner temperature 26 ℃" or the like manually written on the paper by the user. Alternatively, the control device may acquire an image of an operation parameter manually drawn by the user in a display screen of the mobile terminal, the home appliance device, or the control device itself, for example, acquire an image related to "air conditioner timing 1 hour", "television off", or "temperature 25" handwritten by the user through a finger or a touch pen in the display screen.
The control device may also collect an image of an operating parameter input by the user through a keyboard in an input box of a display screen of the mobile terminal, the household appliance device or the control device, for example, collect an image of "air conditioner temperature 26" or "fan timing 3 hours" input by the user in the input box of the display screen.
For another example, as shown in fig. 4, the collection user inputs "help me set the air conditioner temperature to 26 degrees, thank you for cheer" in the input box in the display screen, and the subsequent control device may recognize the keyword: "air conditioner temperature", and "26 degrees", etc., in order to set the operating parameters of the air conditioner.
For another example, as shown in FIG. 5, a capture user input "turn off the fan" in an input box within the display screen, and the subsequent control device may perform semantic analysis to turn off the fan.
In some embodiments, capturing an image of the operational parameter drawn on paper or within a display screen may include: and acquiring the timing time, the wind speed, the angle and the temperature of handwriting of a user on paper or in a display screen and the image of the air supply track drawn by the user on the paper or in the display screen to obtain the image of the operation parameters.
For example, the control device may collect images of the operation parameters such as the time length, the wind speed, the angle, the temperature and the like handwritten by the user on paper, or collect images of the operation parameters such as the time length, the wind speed, the angle, the temperature and the like handwritten by the user in a display screen of the mobile terminal, the household appliance device or the control device; and the control device can acquire the image of the air supply track hand-drawn on the paper by the user, or acquire the image of the air supply track hand-drawn in the display screen of the mobile terminal, the household appliance device or the control device, so that the image of the operation parameter can be obtained. The remote controller realizes convenient control on a plurality of different household appliances as long as a writing or input method is available, and quick setting on a plurality of different operating parameters of the household appliances is realized, without finding the remote controller corresponding to the household appliances, and complicated operations such as entering a parameter setting mode through the remote controller are realized.
S102, extracting characteristic information in the image, and performing parameter area detection on the image based on the characteristic information to obtain a target area.
In order to improve the accuracy of determining the target area, the control device can improve the extraction characteristic information of a target detection model SSD or a neural network model FasterR-CNN and the like, and perform parameter area detection on the image based on the characteristic information to obtain the target area. For example, as shown in fig. 6, a target region where "air-conditioning temperature 26 ℃" is located may be detected from the image. For example, as shown in fig. 7, a target region where "the fan shakes left and right" can be detected from the image.
The characteristic information may be flexibly set according to actual needs, for example, the characteristic information may include relevant characteristic information such as numbers, letters, symbols, and/or characters, and the control device may extract the relevant characteristic information such as numbers, letters, symbols, and/or characters in the image, so that parameter area detection may be performed on the image based on the characteristic information to obtain a target area, for example, an area where the characteristic information is located may be set as a target area where the operation parameter is located, and the target area may be flexibly set according to actual needs such as shape or size, and may be a rectangular area where the operation parameter is located, for example.
In some embodiments, extracting feature information in the image may include: converting the image into a gray scale image; performing convolution operation on the gray level image and a preset Laplace kernel to obtain a response image; calculating the variance of the response image; and when the variance is larger than a preset threshold value, extracting the characteristic information in the image.
In order to improve the accuracy of feature information extraction, the control device may screen the images in advance to screen out the images with higher definition for processing. First, the control device may convert the image from a three primary color (RGB, Red Green Blue) image to a grayscale image. Then, Laplacian Transform (Laplacian Transform) is performed on the grayscale image, for example, the grayscale image may be convolved with a preset Laplacian kernel to obtain a response image, where the preset Laplacian kernel may be flexibly set according to actual needs, for example, the preset Laplacian kernel may be a 3 × 3 Laplacian kernel.
At this time, the control apparatus may calculate a variance of the response image, determine whether the variance is greater than a preset threshold, determine that the sharpness of the image satisfies the condition when the variance is greater than the preset threshold, and determine that the sharpness of the image does not satisfy the condition when the variance is less than or equal to the preset threshold. The preset threshold value can be flexibly set according to actual needs, the variance is greater than the preset threshold value to indicate that the image is clearer, and the variance is less than or equal to the preset threshold value to indicate that the image is blurry, so that the image with the variance greater than the preset threshold value needs to be screened out, and feature information is extracted from the image with the variance greater than the preset threshold value, so that parameter region detection is performed on the image based on the feature information to obtain a target region.
And S103, identifying the characters in the target area to obtain the operation parameters.
After the target area is obtained, the control device may identify characters in the target area to obtain the operating parameters, where the characters are composed of numbers, letters, symbols, and/or characters. It should be noted that, when there are many characters contained in the target region, the control device may perform keyword extraction, semantic analysis, or the like on the recognized characters, and determine the operation parameters based on the keyword extraction, the semantic analysis, or the like.
In some embodiments, identifying the characters in the target region and obtaining the operating parameter may include: extracting a target region from the image; carrying out size normalization on the target area to obtain a normalized area; and identifying the characters in the normalized region through the trained character identification model to obtain the operation parameters.
In order to improve the accuracy and reliability of character recognition in the target region, the characters can be recognized through the trained character recognition model, and in order to improve the efficiency and accuracy of character recognition by the character recognition model, size normalization processing can be firstly carried out on the target region. Specifically, the control device may extract a target region from the image, and then perform size normalization on the target region to obtain a normalized region, for example, if the side length of the target region is greater than a preset length value, reduce the target region to make the side length of the target region be the preset length value, so as to obtain the size-normalized region; or if the side length of the target area is smaller than the preset length value, amplifying the target area to enable the side length of the target area to be the preset length value, and obtaining the area with the normalized size. The preset length value can be flexibly set according to actual needs.
At this time, the control device may recognize the characters in the normalized region through the trained Character Recognition model to obtain the operating parameters, and the Character Recognition model may be flexibly set according to actual needs, for example, the Character Recognition model may be TextCaps or an Optical Character Recognition model (OCR), and the Character Recognition model may not only accurately recognize the input characters of the input method, but also accurately recognize the handwritten characters.
In some embodiments, before the trained character recognition model is used to recognize the characters in the normalized region and obtain the operation parameters, the method for controlling the home appliance may further include: acquiring a training sample image and target characters contained in the training sample image; preprocessing a training sample image to obtain a preprocessed training sample image; performing character recognition on the preprocessed training sample image through a preset character recognition model to obtain a predicted character; and converging the target character and the predicted character through a preset loss function to adjust parameters of the character recognition model to obtain the trained character recognition model.
In order to improve the accuracy of the character recognition model for character recognition, the character recognition model may be trained in advance, for example, the control device may obtain a training sample image, the training sample image includes handwritten, printed, scanned or input operation parameters and the like, the training sample image includes a plurality of training sample images, the training sample image may be acquired by a camera or a camera, or the training sample image may be downloaded from a server, and the like. And the control device may acquire a target character included in the training sample image, which may be a true accurate character pre-labeled in the training sample image.
Then, in order to enrich the training sample and improve the training precision, a series of preprocessing may be performed on the acquired sample image, for example, the control device may perform preprocessing such as adjustment of chromaticity, brightness, and saturation on the training sample image, scaling, clipping, turning, or translation on the training sample image, so as to obtain a preprocessed training sample image, and specific operations such as adjustment of chromaticity, brightness, and saturation, scaling, clipping, turning, or translation, and the like, may be flexibly set according to a time requirement, and specific contents are not limited here.
Secondly, inputting each preprocessed training sample image into a preset character recognition model, performing character recognition on the preprocessed training sample images through the preset character recognition model to obtain predicted characters, presetting a structural loss function at the moment, converging target characters and the predicted characters through the preset loss function to adjust parameters of the character recognition model to a proper value, so that the loss is low, the gradient is not reduced, the error between the real target characters and the predicted characters is reduced, and the trained character recognition model is obtained. And subsequently, the character can be accurately recognized through the trained character recognition model to obtain the operation parameters. For example, as shown in fig. 6, the characters in the target area may be recognized, and the operation parameters of the air conditioner are obtained as follows: the temperature is 26 ℃; for another example, as shown in fig. 7, the characters in the target area may be recognized, and the obtained operating parameters of the fan are: shaking the head left and right.
And S104, controlling the household appliance to operate based on the operation parameters.
After the operation parameters of the household appliances are determined, the control device can send the control instruction carrying the operation parameters to the corresponding household appliances, and the household appliances are controlled to operate according to the operation parameters based on the control instruction, so that after the control device is in communication connection with the household appliances, the household appliances can be conveniently controlled through the control device, and the adjustment mode of each parameter of each household appliance does not need to be adjusted for multiple times.
For example, taking home devices including fans and air conditioners as an example, controlling the home devices to operate based on the operating parameters may include: controlling the fan to operate according to operation parameters including timing duration, a swing angle and air volume; or controlling the air conditioner to operate according to the operation parameters including the timing duration, the wind speed, the air supply angle and the temperature.
In some embodiments, controlling the operation of the home device based on the operating parameters may include: acquiring current environmental parameters; correcting the operation parameters according to the environment parameters to obtain corrected operation parameters; and controlling the household appliance to operate based on the corrected operation parameters.
Because some users may not accurately set the operation parameters suitable for the comfortable feeling of the human body, or cannot accurately set the suitable operation parameters of the household electrical appliance, in order to improve the reliability, the safety and the stability of the operation parameter setting, avoid repeatedly adjusting the operation parameters of the household electrical appliance, and avoid the influence of the improper operation parameters on the operation performance of the household electrical appliance, the control device may correct the operation parameters of the household electrical appliance, for example, the control device may obtain the current environment parameters, which may include indoor environment parameters, outdoor environment parameters, and the like, and the environment parameters may include temperature, humidity, and the like. The operating parameters may then be corrected based on the environmental parameters to obtain corrected operating parameters, for example, if the current indoor ambient temperature is 29 ℃ and the identified operating parameter is 31 ℃, it is obviously not reasonable to correct the operating parameters to be 27 ℃ or 26 ℃. The home appliance may then be controlled to operate based on the modified operating parameters.
In some embodiments, the operating parameters include a plurality of types, and controlling the home device to operate based on the operating parameters may include: when a plurality of operating parameters of the same type exist, determining a user for setting the operating parameters of the type; acquiring the priority of a user, and setting the operation parameter set by the user with the highest priority as the type operation parameter; and controlling the household appliance to operate based on the operation parameters.
Since different users may have different setting requirements for the operating parameters, different operating parameters may be set by multiple users, and the operating parameters may be determined based on the priorities of the users for the same type of operating parameters. For example, when there are a plurality of operating parameters of the same type (for example, the temperature is 25 ℃, 26 ℃ and 27 ℃, etc.), the control device may first determine the users (for example, user a, user B, user C, etc.) who set the operating parameters of the type, and then obtain the priorities of the users (for example, the priority of user a is the highest, and the priority of user B is the lowest), at which time the operating parameter set by the user with the highest priority may be set as the operating parameter of the type (for example, the temperature is set to the temperature 25 ℃ set by user a), and the home appliance may be controlled to operate based on the operating parameter.
The method and the device for detecting the home appliance operation parameter can acquire the image containing the home appliance operation parameter, extract the characteristic information in the image, and perform parameter area detection on the image based on the characteristic information to obtain the target area; and then, identifying the characters in the target area to obtain an operation parameter, and controlling the household appliance to operate based on the operation parameter. According to the scheme, the operation parameters can be acquired based on image identification, the household electrical appliance is controlled to operate based on the operation parameters, different parameters of the household electrical appliance can be quickly adjusted, and convenience and flexibility in control of the household electrical appliance are improved.
Referring to fig. 8, fig. 8 is a schematic block diagram of a structure of a control device according to an embodiment of the present application.
As shown in fig. 8, the control device 300 may include a processor 302, a memory 303, and a communication interface 304 connected by a system bus 301, wherein the memory 303 may include a non-volatile computer-readable storage medium and an internal memory.
The non-transitory computer readable storage medium may store a computer program. The computer program includes program instructions that, when executed, cause a processor to perform any of the methods for controlling a home device.
The processor 302 is used to provide computing and control capabilities, supporting the operation of the overall control device.
The memory 303 provides an environment for running a computer program in a non-transitory computer-readable storage medium, which when executed by the processor 302, causes the processor 302 to perform any of the home device control methods.
The communication interface 304 is used for communication. It will be understood by those skilled in the art that the structure shown in fig. 8 is a block diagram of only a portion of the structure associated with the present application, and does not constitute a limitation on the control device 300 to which the present application is applied, and that a particular control device 300 may include more or less components than those shown, or combine certain components, or have a different arrangement of components.
It should be understood that the bus 301 is, for example, an I2C (Inter-Integrated Circuit) bus, the Memory 303 may be a Flash chip, a Read-Only Memory (ROM), a magnetic disk, an optical disk, a usb disk, or a removable hard disk, the Processor 302 may be a Central Processing Unit (CPU), the Processor 302 may also be other general-purpose processors, Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field-Programmable gate arrays (FPGAs), or other Programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or the like. Wherein a general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
Wherein, in some embodiments, the processor 302 is configured to run a computer program stored in the memory 303 to perform the steps of:
acquiring an image containing running parameters of the household appliance; extracting feature information in the image, and performing parameter area detection on the image based on the feature information to obtain a target area; identifying characters in the target area to obtain operation parameters; and controlling the household appliance to operate based on the operation parameters.
In some embodiments, when obtaining the image including the operating parameters of the home device, the processor 302 is further configured to: collecting an image of the operating parameter drawn on paper or in a display screen; alternatively, an image of the operating parameters input on the display screen is acquired.
In some embodiments, processor 302 is further configured to perform, in capturing an image of the operational parameter drawn on paper or within a display screen: and acquiring the timing time, the wind speed, the angle and the temperature of handwriting of a user on paper or in a display screen and the image of the air supply track drawn by the user on the paper or in the display screen to obtain the image of the operation parameters.
In some embodiments, in extracting feature information in an image, processor 302 is further configured to: converting the image into a gray scale image; performing convolution operation on the gray level image and a preset Laplace kernel to obtain a response image; calculating the variance of the response image; and when the variance is larger than a preset threshold value, extracting the characteristic information in the image.
In some embodiments, when the recognition is performed on the characters in the target area to obtain the operation parameters, the processor 302 is further configured to perform: extracting a target region from the image; carrying out size normalization on the target area to obtain a normalized area; and identifying the characters in the normalized region through the trained character identification model to obtain the operation parameters.
In some embodiments, before the training of the character recognition model to recognize the characters in the normalized region to obtain the operation parameters, the processor 302 is further configured to: acquiring a training sample image and target characters contained in the training sample image; preprocessing a training sample image to obtain a preprocessed training sample image; performing character recognition on the preprocessed training sample image through a preset character recognition model to obtain a predicted character; and converging the target character and the predicted character through a preset loss function to adjust parameters of the character recognition model to obtain the trained character recognition model.
In some embodiments, when controlling the home device to run based on the operating parameters, the processor 302 is further configured to: acquiring current environmental parameters; correcting the operation parameters according to the environment parameters to obtain corrected operation parameters; and controlling the household appliance to operate based on the corrected operation parameters.
In some embodiments, the operating parameters include a plurality of types, and the processor 302 is further configured to perform, when controlling the home device to operate based on the operating parameters: when a plurality of operating parameters of the same type exist, determining a user for setting the operating parameters of the type; acquiring the priority of a user, and setting the operation parameter set by the user with the highest priority as the type operation parameter; and controlling the household appliance to operate based on the operation parameters.
In the above embodiments, the descriptions of the embodiments have respective emphasis, and parts that are not described in detail in a certain embodiment may refer to the above detailed description of the home appliance control method, and are not described herein again.
The method and the device for detecting the home appliance operation parameter can acquire the image containing the home appliance operation parameter, extract the characteristic information in the image, and perform parameter area detection on the image based on the characteristic information to obtain the target area; and then, identifying the characters in the target area to obtain an operation parameter, and controlling the household appliance to operate based on the operation parameter. According to the scheme, the operation parameters can be acquired based on image identification, the household electrical appliance is controlled to operate based on the operation parameters, different parameters of the household electrical appliance can be quickly adjusted, and convenience and flexibility in control of the household electrical appliance are improved.
The embodiment of the application further provides a computer-readable storage medium, wherein a computer program is stored in the computer-readable storage medium, the computer program comprises program instructions, and a processor executes the program instructions to realize the control method of any household appliance provided by the embodiment of the application. For example, the computer program is loaded by a processor and may perform the following steps:
acquiring an image containing running parameters of the household appliance; extracting feature information in the image, and performing parameter area detection on the image based on the feature information to obtain a target area; identifying characters in the target area to obtain operation parameters; and controlling the household appliance to operate based on the operation parameters.
The above operations can be implemented in the foregoing embodiments, and are not described in detail herein.
The computer-readable storage medium may be an internal storage unit of the control device of the foregoing embodiment, for example, a hard disk or a memory of the control device. The computer readable storage medium may also be an external storage device of the control device, such as a plug-in hard disk provided on the control device, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like.
As the computer program stored in the computer-readable storage medium can execute any household electrical appliance control method provided in the embodiments of the present application, beneficial effects that can be achieved by any household electrical appliance control method provided in the embodiments of the present application can be achieved, and detailed descriptions are omitted here for the foregoing embodiments.
It is to be understood that the terminology used in the description of the present application herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in the specification of the present application and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
It should also be understood that the term "and/or" as used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items. It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The above-mentioned serial numbers of the embodiments of the present application are merely for description and do not represent the merits of the embodiments. While the invention has been described with reference to specific embodiments, the scope of the invention is not limited thereto, and various equivalent modifications or substitutions can be easily made by those skilled in the art within the technical scope of the invention. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
Claims (10)
1. A home appliance control method, comprising:
acquiring an image containing running parameters of the household appliance;
extracting feature information in the image, and performing parameter area detection on the image based on the feature information to obtain a target area;
identifying characters in the target area to obtain operation parameters;
and controlling the household appliance to operate based on the operation parameters.
2. The method of claim 1, wherein the obtaining the image including the operating parameters of the home device comprises:
collecting an image of the operating parameter drawn on paper or in a display screen; alternatively, an image of the operating parameters input on the display screen is acquired.
3. The home appliance control method according to claim 2, wherein the acquiring of the image of the operating parameter drawn on paper or in a display screen comprises:
and acquiring the timing time, the wind speed, the angle and the temperature of handwriting of a user on paper or in a display screen and the image of the air supply track drawn by the user on the paper or in the display screen to obtain the image of the operation parameters.
4. The home appliance control method according to claim 1, wherein the extracting the feature information in the image comprises:
converting the image into a grayscale image;
performing convolution operation on the gray level image and a preset Laplace kernel to obtain a response image;
calculating a variance of the response image;
and when the variance is larger than a preset threshold value, extracting the characteristic information in the image.
5. The household appliance control method of claim 1, wherein the recognizing the characters in the target area to obtain the operation parameters comprises:
extracting the target region from the image;
carrying out size normalization on the target area to obtain a normalized area;
and identifying the characters in the normalized region through the trained character identification model to obtain the operation parameters.
6. The method of claim 5, wherein before the trained character recognition model is used to recognize the characters in the normalized region to obtain the operation parameters, the method further comprises:
acquiring a training sample image and target characters contained in the training sample image;
preprocessing the training sample image to obtain a preprocessed training sample image;
performing character recognition on the preprocessed training sample image through a preset character recognition model to obtain a predicted character;
and converging the target character and the predicted character through a preset loss function so as to adjust the parameters of the character recognition model and obtain the trained character recognition model.
7. The method of any of claims 1 to 6, wherein the controlling the operation of the home device based on the operating parameters comprises:
acquiring current environmental parameters;
correcting the operating parameters according to the environmental parameters to obtain corrected operating parameters;
and controlling the household appliance to operate based on the corrected operation parameters.
8. The home device control method according to any one of claims 1 to 6, wherein the operation parameters include a plurality of types, and the controlling the home device to operate based on the operation parameters includes:
when a plurality of operating parameters of the same type exist, determining a user for setting the operating parameters of the type;
acquiring the priority of the user, and setting the operation parameter set by the user with the highest priority as the operation parameter of the type;
and controlling the household appliance to operate based on the operation parameters.
9. A control device comprising a processor and a memory, wherein the memory stores a computer program, and the processor executes the home device control method according to any one of claims 1 to 8 when calling the computer program in the memory.
10. A computer-readable storage medium storing a computer program, the computer program being loaded by a processor to execute the method of controlling a home device according to any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911176261.8A CN112861571A (en) | 2019-11-26 | 2019-11-26 | Household appliance control method, control device and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911176261.8A CN112861571A (en) | 2019-11-26 | 2019-11-26 | Household appliance control method, control device and computer readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112861571A true CN112861571A (en) | 2021-05-28 |
Family
ID=75984965
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911176261.8A Pending CN112861571A (en) | 2019-11-26 | 2019-11-26 | Household appliance control method, control device and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112861571A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113759735A (en) * | 2021-08-24 | 2021-12-07 | 珠海格力电器股份有限公司 | Method and device for recommending electric appliance operation parameter values, electronic equipment and storage medium |
| CN115657896A (en) * | 2022-12-26 | 2023-01-31 | 中科航迈数控软件(深圳)有限公司 | Information prompting method based on MR (magnetic resonance) equipment image acquisition and related equipment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030076240A1 (en) * | 2001-10-23 | 2003-04-24 | Yu Seok Bae | Remote control system for home appliances and method thereof |
| CN105603678A (en) * | 2014-11-20 | 2016-05-25 | 无锡飞翎电子有限公司 | Washing machine and control method thereof |
| CN109492143A (en) * | 2018-09-21 | 2019-03-19 | 平安科技（深圳）有限公司 | Image processing method, device, computer equipment and storage medium |
| CN109961068A (en) * | 2017-12-26 | 2019-07-02 | 阿里巴巴集团控股有限公司 | Image recognition, training, searching method and device and equipment, medium |
-
2019
- 2019-11-26 CN CN201911176261.8A patent/CN112861571A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030076240A1 (en) * | 2001-10-23 | 2003-04-24 | Yu Seok Bae | Remote control system for home appliances and method thereof |
| CN105603678A (en) * | 2014-11-20 | 2016-05-25 | 无锡飞翎电子有限公司 | Washing machine and control method thereof |
| CN109961068A (en) * | 2017-12-26 | 2019-07-02 | 阿里巴巴集团控股有限公司 | Image recognition, training, searching method and device and equipment, medium |
| CN109492143A (en) * | 2018-09-21 | 2019-03-19 | 平安科技（深圳）有限公司 | Image processing method, device, computer equipment and storage medium |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113759735A (en) * | 2021-08-24 | 2021-12-07 | 珠海格力电器股份有限公司 | Method and device for recommending electric appliance operation parameter values, electronic equipment and storage medium |
| CN113759735B (en) * | 2021-08-24 | 2023-11-10 | 珠海格力电器股份有限公司 | Electrical appliance operation parameter value recommendation method and device, electronic equipment and storage medium |
| CN115657896A (en) * | 2022-12-26 | 2023-01-31 | 中科航迈数控软件(深圳)有限公司 | Information prompting method based on MR (magnetic resonance) equipment image acquisition and related equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10445562B2 (en) | AU feature recognition method and device, and storage medium | |
| US10534957B2 (en) | Eyeball movement analysis method and device, and storage medium | |
| CN104350509B (en) | Quick attitude detector | |
| CN107862018B (en) | Recommendation method and device for food cooking method | |
| CN108108767B (en) | Grain identification method and device and computer storage medium | |
| WO2019019255A1 (en) | Apparatus and method for establishing prediction model, program for establishing prediction model, and computer-readable storage medium | |
| CN107633205B (en) | lip motion analysis method, device and storage medium | |
| JP5662670B2 (en) | Image processing apparatus, image processing method, and program | |
| US10650234B2 (en) | Eyeball movement capturing method and device, and storage medium | |
| CN107871001B (en) | Audio playing method and device, storage medium and electronic equipment | |
| CN107347138A (en) | Image processing method, device, storage medium and terminal | |
| WO2019033568A1 (en) | Lip movement capturing method, apparatus and storage medium | |
| CN112861571A (en) | Household appliance control method, control device and computer readable storage medium | |
| CN111914775A (en) | Living body detection method, living body detection device, electronic apparatus, and storage medium | |
| CN112926358A (en) | Fan control method, device and computer readable storage medium | |
| CN112581446A (en) | Method, device and equipment for detecting salient object of image and storage medium | |
| CN112149570A (en) | Multi-person living body detection method and device, electronic equipment and storage medium | |
| CN112887615B (en) | Shooting method and device | |
| CN112949689A (en) | Image recognition method and device, electronic equipment and storage medium | |
| CN113126870A (en) | Parameter setting method, intelligent refrigerator and computer readable storage medium | |
| CN111711758B (en) | Multi-pointing test question shooting method and device, electronic equipment and storage medium | |
| CN111381676A (en) | TOF sensor and monocular camera fusion gesture recognition device and gesture recognition method | |
| CN109634410A (en) | Unmanned plane photographic method and system based on gesture identification | |
| CN112925425A (en) | Device control method, mobile terminal, and computer-readable storage medium | |
| CN111753715A (en) | Method and device for shooting test questions in click-to-read scene, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |