CN111503992A - Refrigerator control method and device - Google Patents
Refrigerator control method and device Download PDFInfo
- Publication number
- CN111503992A CN111503992A CN202010357390.3A CN202010357390A CN111503992A CN 111503992 A CN111503992 A CN 111503992A CN 202010357390 A CN202010357390 A CN 202010357390A CN 111503992 A CN111503992 A CN 111503992A
- Authority
- CN
- China
- Prior art keywords
- picture
- compared
- storage room
- current state
- similarity
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
- F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
- F25D29/00—Arrangement or mounting of control or safety devices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/22—Matching criteria, e.g. proximity measures
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Evolutionary Biology (AREA)
- Evolutionary Computation (AREA)
- Bioinformatics & Computational Biology (AREA)
- Artificial Intelligence (AREA)
- General Physics & Mathematics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Mechanical Engineering (AREA)
- Thermal Sciences (AREA)
- Cold Air Circulating Systems And Constructional Details In Refrigerators (AREA)
Abstract
The invention provides a control method and a device of a refrigerator, wherein the method comprises the following steps: pre-storing at least one picture to be compared inside a storage chamber of the refrigerator, wherein the picture to be compared is a picture inside the storage chamber when the storage chamber does not need to be in a refrigeration mode; acquiring at least one state picture in the current state in the storage room; for each state picture, determining a picture to be compared corresponding to the current state picture, and determining a first similarity between the current state picture and the picture to be compared, wherein the picture to be compared comprises: a target picture having the same shooting angle and shooting position as the current state picture; determining whether the storage room needs to be in a refrigeration mode or not according to the first similarity corresponding to each state picture; when the storage room is determined to be in the refrigeration mode, controlling the storage room to be in the refrigeration mode; and when the storage room is determined not to be in the cooling mode, controlling the storage room not to be in the cooling mode. The scheme can save the power consumption of the refrigerator.
Description
Technical Field
The invention relates to the technical field of intelligent household appliances, in particular to a control method and a control device for a refrigerator.
Background
With the development of artificial intelligence technology, intelligent refrigerators have become essential living appliances for every family. The intelligent refrigerator is used as a tool for storing food or other articles at low temperature, and can provide the optimal preservation temperature for the preservation of the food and the storage of the food in the guarantee period.
At present, the temperature of a storage chamber of a refrigerator is generally adjusted to a fixed temperature by an intelligent refrigerator. However, when the storage chambers of the refrigerator are adjusted to a fixed temperature, the refrigeration mode is still turned on when a certain storage chamber is not required to be in the refrigeration mode, thereby causing waste of power consumption of the refrigerator.
Chinese patent application No. 201610983313.2 discloses a refrigerator temperature control method, a refrigerator temperature control system, and a refrigerator, wherein the temperature in the refrigerator is automatically adjusted according to the actual load by obtaining the load weight variation value of each compartment of the refrigerator.
Disclosure of Invention
The embodiment of the invention provides a control method and device of a refrigerator, which can save the power consumption of the refrigerator.
In a first aspect, an embodiment of the present invention provides a method for controlling a refrigerator, including:
at least one picture to be compared inside a storage room of the refrigerator is preserved in advance, wherein the picture to be compared is the picture inside the storage room under the condition that the storage room does not need to be in a cooling mode;
acquiring at least one state picture in the current state in the storage room;
for each state picture, determining a picture to be compared corresponding to the current state picture, and determining a first similarity between the current state picture and the picture to be compared, wherein the picture to be compared comprises: a target picture having the same shooting angle and shooting position as the current state picture;
determining whether the storage room needs to be in a refrigeration mode according to the first similarity corresponding to each state picture;
when the storage room is determined to be in the refrigeration mode, controlling the storage room to be in the refrigeration mode;
and when the storage room is determined not to be in the cooling mode, controlling the storage room not to be in the cooling mode.
Preferably, the first and second electrodes are formed of a metal,
the determining whether the storage room needs to be in a cooling mode according to the first similarity corresponding to each state picture comprises:
and judging whether at least one first similarity is greater than or equal to a first preset threshold, if so, determining that the storage room does not need to be in a cooling mode, otherwise, determining that the storage room needs to be in the cooling mode.
Preferably, the first and second electrodes are formed of a metal,
the determining a first similarity between the current state picture and the picture to be compared includes:
determining a first histogram corresponding to the current state picture;
determining a second histogram corresponding to the picture to be compared;
determining a second similarity between the first histogram corresponding to the current state picture and the second histogram corresponding to the picture to be compared;
and taking the second similarity as the first similarity between the current state picture and the picture to be compared.
Preferably, the first and second electrodes are formed of a metal,
the determining of the first histogram corresponding to the current state picture includes:
converting the current state picture into a first HSV format according to a first formula;
wherein, the H1Representing the chroma of the current status picture, S1Represents the saturation of the current state picture, said V1Brightness representing the current status picture, r1Means the saidRed intensity value of previous status picture, said g1A green intensity value representing the current status picture, b1A blue intensity value representing the current status picture;
generating the first histogram corresponding to the current state picture according to the first HSV format;
the determining of the second histogram corresponding to the picture to be compared includes:
converting the picture to be compared into a second HSV format according to a second formula;
wherein, the H2Representing the chromaticity of the picture to be compared, S2Representing the saturation of the picture to be compared, said V2Representing the lightness of the picture to be compared, the r2A red intensity value representing the picture to be compared, said g2Representing the green intensity value of the picture to be compared, b2Representing the blue intensity value of the picture to be compared;
and generating the second histogram corresponding to the picture to be compared according to the second HSV format.
Preferably, the first and second electrodes are formed of a metal,
the acquiring at least one state picture of the current state inside the storage room comprises:
triggering a timer to start counting time when detecting a door closing action;
and when the timer times to reach preset time, acquiring at least one state picture in the current state in the storage room.
In a second aspect, the present invention provides a control apparatus for a refrigerator, comprising:
the storage module is used for storing at least one picture to be compared inside a storage room of the refrigerator, wherein the picture to be compared is the picture inside the storage room under the condition that the storage room is not required to be in a cooling mode;
the acquisition module is used for acquiring at least one state picture in the current state in the storage room;
a determining module, configured to determine, for each state picture acquired by the acquiring module, a to-be-compared picture corresponding to a current state picture, and determine a first similarity between the current state picture and the to-be-compared picture, where the to-be-compared picture includes: a target picture having the same shooting angle and shooting position as the current state picture;
the judging module is used for determining whether the storage room needs to be in a refrigeration mode or not according to the first similarity corresponding to each state picture determined by the determining module;
the processing module is used for controlling the storage room to be in the refrigeration mode when the judging module determines that the storage room needs to be in the refrigeration mode; and when the judging module determines that the storage room does not need to be in the refrigeration mode, controlling the storage room not to be in the refrigeration mode.
Preferably, the first and second electrodes are formed of a metal,
the judging module is used for judging whether at least one first similarity is larger than or equal to a first preset threshold value, if so, the storeroom is determined not to be in the refrigeration mode, and otherwise, the storeroom is determined to be in the refrigeration mode.
Preferably, the first and second electrodes are formed of a metal,
the determining module includes:
a first determining unit, configured to determine a first histogram corresponding to the current state picture;
the second determining unit is used for determining a second histogram corresponding to the picture to be compared;
a third determining unit, configured to determine a second similarity between the first histogram corresponding to the current state picture determined by the first determining unit and the second histogram corresponding to the picture to be compared determined by the second determining unit;
and the processing unit is used for taking the second similarity determined by the third determining unit as the first similarity between the current state picture and the picture to be compared.
Preferably, the first and second electrodes are formed of a metal,
the first determining unit is configured to perform:
converting the current state picture into a first HSV format according to a first formula;
wherein, the H1Representing the chroma of the current status picture, S1Represents the saturation of the current state picture, said V1Brightness representing the current status picture, r1A red intensity value representing the current status picture, said g1A green intensity value representing the current status picture, b1A blue intensity value representing the current status picture;
generating the first histogram corresponding to the current state picture according to the first HSV format;
the second determining unit is configured to perform:
converting the picture to be compared into a second HSV format according to a second formula;
wherein, the H2Representing the chromaticity of the picture to be compared, S2Representing the saturation of the picture to be compared, said V2Representing the lightness of the picture to be compared, the r2A red intensity value representing the picture to be compared, said g2Representing the green intensity value of the picture to be compared, b2Representing the blue intensity value of the picture to be compared;
and generating the second histogram corresponding to the picture to be compared according to the second HSV format.
Preferably, the first and second electrodes are formed of a metal,
the acquisition module is used for triggering a timer to start time counting when door closing action is detected; and when the timer times to reach preset time, acquiring at least one state picture in the current state in the storage room.
The embodiment of the invention provides a control method and a device of a refrigerator, the refrigerator is used as a tool for storing food or other articles at low temperature, the refrigeration mode of the refrigerator can provide refrigeration for the fresh-keeping of food and the storage of food in the shelf life, however, the storage room of the refrigerator is still in the refrigeration mode under the condition that the storage room is not in the refrigeration mode, which causes the waste of resources, therefore, in order to solve the problems, the picture to be compared under the condition that the storage room is not in the refrigeration mode can be preserved in advance, then at least one state picture under the current state inside the storage room is obtained, the similarity degree between the two pictures can be represented based on the similarity degree, whether the storage room of the refrigerator needs to be in the refrigeration mode can be determined by determining the first similarity degree between the obtained current state picture and the corresponding picture to be compared, and under the condition that the storage room needs to be, controlling the storage chamber to be in a refrigeration mode; and controlling the storage room not to be in the cooling mode when the storage room is determined not to be in the cooling mode. Meanwhile, in the process of determining the first similarity, the current state picture and the picture to be compared need to be controlled to have the same shooting angle and shooting position, so that the analysis result of the first similarity is more accurate. By the mode, when the storage chamber of the refrigerator is not required to be in the refrigeration mode, the storage chamber can be flexibly controlled not to be in the refrigeration mode, so that the power consumption of the refrigerator can be saved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
Fig. 1 is a flowchart of a control method of a refrigerator according to an embodiment of the present invention;
fig. 2 is a flowchart illustrating another control method of a refrigerator according to an embodiment of the present invention;
fig. 3 is a schematic diagram of a control apparatus of a refrigerator according to an embodiment of the present invention;
fig. 4 is a schematic diagram of another control device for a refrigerator according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer and more complete, the technical solutions in the embodiments of the present invention will be described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention, and based on the embodiments of the present invention, all other embodiments obtained by a person of ordinary skill in the art without creative efforts belong to the scope of the present invention.
As shown in fig. 1, an embodiment of the present invention provides a method for controlling a refrigerator, which may include the steps of:
step 101: pre-storing at least one picture to be compared inside a storage room of the refrigerator, wherein the picture to be compared is the picture inside the storage room under the condition that the storage room is not required to be in a refrigeration mode;
step 102: acquiring at least one state picture in the current state in the storage room;
step 103: for each state picture, determining a picture to be compared corresponding to the current state picture, and determining a first similarity between the current state picture and the picture to be compared, wherein the picture to be compared comprises: a target picture having the same shooting angle and shooting position as the current state picture;
step 104: determining whether the storage room needs to be in a refrigeration mode according to the first similarity corresponding to each state picture, if so, executing a step 105, otherwise, executing a step 106;
step 105: controlling the storage chamber to be in a refrigeration mode;
step 106: the storage room is controlled not to be in the cooling mode.
In the embodiment of the invention, the refrigerator is used as a tool for storing food or other articles at low temperature, the refrigeration mode of the refrigerator can provide refrigeration for the fresh-keeping of food and the food storage in the shelf life, however, the storage room of the refrigerator is still in the refrigeration mode under the condition that the refrigerator is not required to be in the refrigeration mode, which causes resource waste, therefore, in order to solve the above problems, the picture to be compared under the condition that the storage room is not required to be in the refrigeration mode can be preserved in advance, then at least one state picture under the current state inside the storage room is obtained, the similarity degree between the two pictures can be represented based on the similarity degree, whether the storage room of the refrigerator is required to be in the refrigeration mode can be determined by determining the first similarity degree between the obtained current state picture and the corresponding picture to be compared, and when the storage room is determined to, controlling the storage chamber to be in a refrigeration mode; and controlling the storage room not to be in the cooling mode when the storage room is determined not to be in the cooling mode. Meanwhile, in the process of determining the first similarity, the current state picture and the picture to be compared need to be controlled to have the same shooting angle and shooting position, so that the analysis result of the first similarity is more accurate. By the mode, when the storage chamber of the refrigerator is not required to be in the refrigeration mode, the storage chamber can be flexibly controlled not to be in the refrigeration mode, so that the power consumption of the refrigerator can be saved.
In order to determine whether the storage room needs to be in the cooling mode through the analysis of the first similarity, in an embodiment of the present invention, the step 104 in the foregoing embodiment determines whether the storage room needs to be in the cooling mode according to the first similarity corresponding to each status picture, which may specifically be implemented as follows:
and judging whether at least one first similarity is greater than or equal to a first preset threshold, if so, determining that the storage room does not need to be in the refrigeration mode, otherwise, determining that the storage room needs to be in the refrigeration mode.
In an embodiment of the present invention, the to-be-compared picture is a picture in which the storage room is in a cooling-unnecessary mode, and for each captured state picture, it may be determined whether the storage room needs to be in the cooling mode based on a first similarity between the current state picture and the corresponding to-be-compared picture, so that a first preset threshold of the first similarity may be preset, and it is determined whether the storage room needs to be in the cooling mode by determining a relationship between at least one first similarity and the first preset threshold. And when the at least one first similarity is larger than or equal to a first preset threshold value, determining that the storage room does not need to be in the refrigeration mode, otherwise, when the at least one first similarity is smaller than the first preset threshold value, determining that the storage room needs to be in the refrigeration mode.
In order to determine the first similarity between the current state picture and the picture to be compared through the histogram, in an embodiment of the present invention, the determining the first similarity between the current state picture and the picture to be compared in step 103 in the foregoing embodiment may specifically be implemented as follows:
determining a first histogram corresponding to the current state picture;
determining a second histogram corresponding to the picture to be compared;
determining a second similarity between a first histogram corresponding to the current state picture and a second histogram corresponding to the picture to be compared;
and taking the second similarity as the first similarity between the current state picture and the picture to be compared.
In an embodiment of the present invention, the image histogram is a histogram representing a luminance distribution in the digital image, and the number of pixels of each luminance value in the image is plotted, so that, in order to more conveniently determine the first similarity between the current state picture and the picture to be compared, the determination may be performed based on the histogram. The method comprises the steps of respectively determining a first histogram corresponding to a current state picture and a second histogram corresponding to a picture to be compared, then determining a second similarity between the first histogram corresponding to the current state picture and the second histogram corresponding to the picture to be compared, and taking the second similarity as a first similarity between the current state picture and the picture to be compared.
In order to determine the first histogram based on the current state picture, in an embodiment of the present invention, the determining of the first histogram corresponding to the current state picture in the above embodiment may specifically be implemented in the following manner:
converting the current state picture into a first HSV format according to a first formula;
wherein H1Indicating the chroma, S, of the current status picture1Indicating the current stateSaturation of picture, V1Brightness, r, representing the current status picture1Red intensity value, g, representing the current status picture1Green intensity value representing the current status picture, b1A blue intensity value representing a current status picture;
and generating a first histogram corresponding to the current state picture according to the first HSV format.
In an embodiment of the present invention, HSV is a method for representing a point in an RGB color space in an inverse cone, where a histogram of an image is used to represent a distribution of pixel values of the image, and in order to determine a first histogram corresponding to a current state picture, the current state picture may be converted into a corresponding first HSV format through the first formula, and the first histogram may be determined by calling a histogram function in an OpenCV open source library.
In order to determine the second histogram based on the picture to be compared, in an embodiment of the present invention, the step in the above embodiment of the present invention determines the second histogram corresponding to the picture to be compared, which may specifically be implemented as follows:
converting the picture to be compared into a second HSV format according to a second formula;
wherein H2Representing the chromaticity, S, of the picture to be compared2Representing the saturation, V, of the picture to be compared2Representing the lightness, r, of the picture to be compared2Red intensity value, g, representing the picture to be compared2Representing the green intensity value of the picture to be compared, b2Representing the blue intensity value of the picture to be compared;
and generating a second histogram corresponding to the picture to be compared according to the second HSV format.
In an embodiment of the present invention, HSV is a method for representing a point in an RGB color space in an inverse cone, where a histogram of an image is used to represent a distribution of pixel values of the image, and in order to determine a second histogram corresponding to a picture to be compared, the picture to be compared may be converted into a corresponding second HSV format through the above second formula, and the second histogram may be determined by calling a histogram function in an OpenCV open source library.
In order to facilitate the determination of the cooling mode of the storage room, in an embodiment of the present invention, the step 102 in the above embodiment obtains at least one state picture of the current state inside the storage room, which may be specifically implemented as follows:
triggering a timer to start counting time when detecting a door closing action;
and when the timer reaches preset time, acquiring at least one state picture in the current state in the storage room.
In an embodiment of the present invention, in order to determine the cooling mode of the storage room, it may be set that when the user's door closing motion is detected, a timer is triggered to start timing, and after the timer times a preset time (for example, 1 minute), at least one state picture in the current state inside the storage room is obtained.
As shown in fig. 2, in order to more clearly illustrate the technical solution and advantages of the present invention, the following detailed description of the control method for a refrigerator provided by the embodiment of the present invention may specifically include the following steps:
step 201: at least one picture to be compared inside a storage room of the refrigerator is preserved in advance, wherein the picture to be compared is the picture inside the storage room under the condition that the storage room does not need to be in a cooling mode.
Specifically, in order to solve the problem of resource waste caused by the fact that the refrigerator does not need to be in the cooling mode and the cooling mode is still started, at least one graph to be compared under the condition that the storage chamber does not need to be in the cooling mode can be stored in advance as a reference for comparison and analysis with the acquired at least one state picture.
For example, a picture to be compared in a case where the interior of the storage room needs to be in the cooling mode may be stored in advance in the storage unit, for example, a picture with an empty interior of the storage room may be stored as the picture to be compared.
Step 202: triggering a timer to start counting time when detecting a door closing action;
step 203: and when the timer reaches preset time, acquiring at least one state picture in the current state in the storage room.
Step 204: for each state picture, determining a picture to be compared corresponding to the current state picture, wherein the picture to be compared comprises: and the target picture has the same shooting angle and shooting position as the current state picture.
Specifically, in order to make the analysis result more accurate, it is necessary to ensure that the picture to be compared and the current state picture have the same shooting angle and shooting position.
For example, at least one state picture in the current state inside the storage room can be obtained through the cameras, the storage room can correspond to 1 or more cameras, each camera has a different and unique id, the picture to be compared corresponding to the current state picture can be determined through the id, the angles and the installation positions of the multiple different cameras are different, and the angles and the installation positions of the cameras when the current state picture with the same id is shot as the picture to be compared are kept the same. The door closing action of a user can be captured through the door closing triggering sensor, and after the user closes the refrigerator door, the refrigerator can automatically trigger the camera to take a picture of the current state of the storage chamber.
Step 205: and converting the current state picture into a first HSV format.
For example, the current status picture can be converted into a first HSV format by the following first formula;
wherein H1Indicating the chroma, S, of the current status picture1Indicating the saturation, V, of the current state picture1Brightness, r, representing the current status picture1Red intensity value, g, representing the current status picture1Green intensity value representing the current status picture, b1Representing the blue intensity value of the current status picture.
Step 206: and generating a first histogram corresponding to the current state picture according to the first HSV format.
Step 207: and converting the picture to be compared into a second HSV format.
For example, the image to be compared may be converted into a second HSV format by the following second formula;
wherein H2Representing the chromaticity, S, of the picture to be compared2Representing the saturation, V, of the picture to be compared2Representing the lightness, r, of the picture to be compared2Red intensity value, g, representing the picture to be compared2Representing the green intensity value of the picture to be compared, b2Representing the blue intensity value of the picture to be compared.
Step 208: and generating a second histogram corresponding to the picture to be compared according to the second HSV format.
Step 209: and determining a second similarity between the first histogram corresponding to the current state picture and the second histogram corresponding to the picture to be compared.
Step 210: and taking the second similarity as the first similarity between the current state picture and the picture to be compared.
Specifically, HSV is a representation of a point in the RGB color space in an inverted cone. The hue H refers to the basic attribute of the color, and the value range is 0-180; the saturation S refers to the purity of the color, and the value range is 0-255; the lightness V refers to the brightness of the color, and the value range is 0-255.
For example, a second similarity between a first histogram corresponding to the current state picture and a second histogram corresponding to the picture to be compared may be determined by the image recognition processing unit. The similarity comparison of the two pictures can be realized by applying an OpenCV open source library framework, performing HSV format conversion on the current state picture to be compared and the picture to be compared, constructing a histogram of the image and performing histogram normalization. And judging the first similarity between the current state picture and the picture to be compared by calculating the second similarity of the histograms, and assuming that the second similarity of the first histogram corresponding to the current state picture and the second histogram corresponding to the picture to be compared is 80%, taking 80% of the second similarity as the first similarity between the current state picture and the picture to be compared.
The formula of extracting and normalizing the OpenCV histogram is as follows:
int channels [ ] ═ 0,1 }; // two-dimensional histogram
MatND hist1, hist 2; wherein, hist1 represents a histogram variable defining a picture to be compared of the refrigerator, and hist2 represents a histogram variable defining a picture of a current state acquired by the refrigerator.
The OpenCV image histogram calculation formula is as follows:
inputting state pictures shot by a camera and the corresponding quantity, calculating each pixel value in the images through a mask matrix, calling a histogram function in an OpenCV database, and defining the size of a first histogram to generate the first histogram;
inputting the pictures to be compared and the corresponding quantity, calculating each pixel value in the images through a mask matrix, calling a histogram function in an OpenCV database, and defining the size of a second histogram to generate the second histogram;
the OpenCV image histogram normalization calculation formula is as follows:
in the above manner, the distribution of the histogram is displayed with the total integral of 1, and histogram normalization is realized to facilitate analysis of the second similarity between the first histogram and the second histogram.
the/OpenCV image histogram similarity contrast calculation formula is as follows:
double similarityValue＝compareHist(hist1,hist2,CV_COMP_CORREL)；
the similarity value is a histogram contrast similarity value.
And determining the first similarity between the current state picture and the picture to be compared through the formula.
Step 211: it is determined whether at least one first similarity is greater than or equal to a first preset threshold, if so, step 212 is executed, otherwise, step 213 is executed.
Step 212: the storage room is controlled not to be in the cooling mode.
Step 213: the storage room is controlled to be in a cooling mode.
In particular, whether the storage compartments of the refrigerator are in a cooling mode or not may be controlled by the control unit, and each storage compartment of the refrigerator may be individually in or not in the cooling mode.
For example, if one storage room corresponds to 3 cameras, the first similarity determined by the state pictures shot by the camera with id 1 is 10%, the first similarity determined by the state pictures shot by the camera with id 2 is 70%, the first similarity determined by the state pictures shot by the camera with id 3 is 80%, and if the first preset threshold is 60%, two first similarities greater than the first preset threshold 60% exist, and the storage room is controlled not to be in the cooling mode;
assuming that the first similarity determined by the state picture shot by the camera with the id of 4 is 10%, the first similarity determined by the state picture shot by the camera with the id of 5 is 40%, the first similarity determined by the state picture shot by the camera with the id of 6 is 50%, and assuming that the first preset threshold value is 60%, the first similarity is not greater than or equal to 60%, and the storage room is controlled to be in the cooling mode.
As shown in fig. 3, an embodiment of the present invention provides a control apparatus for a refrigerator, including:
the storage module 301 is configured to store at least one picture to be compared inside a storage room of the refrigerator, where the picture to be compared is a picture inside the storage room when the storage room is not required to be in a cooling mode;
an obtaining module 302, configured to obtain at least one status picture in a current status inside the storage room;
a determining module 303, configured to determine, for each state picture captured by the obtaining module 302, a to-be-compared picture corresponding to the current state picture, and determine a first similarity between the current state picture and the to-be-compared picture, where the to-be-compared picture includes: a target picture having the same shooting angle and shooting position as the current state picture;
a determining module 304, configured to determine whether the storage room needs to be in the cooling mode according to the first similarity corresponding to each state picture determined by the determining module 303;
a processing module 305, configured to control the storage room to be in the cooling mode when the determining module 304 determines that the storage room needs to be in the cooling mode; when the determination module 304 determines that the storage room does not need to be in the cooling mode, the storage room is not controlled to be in the cooling mode.
In the embodiment of the invention, the refrigerator is used as a tool for storing food or other articles at low temperature, the refrigeration mode of the refrigerator can provide refrigeration for the fresh-keeping of food and the food storage in the shelf life, however, the storage room of the refrigerator is still in the refrigeration mode under the condition that the refrigerator is not required to be in the refrigeration mode, which causes resource waste, so that in order to solve the above problems, the picture to be compared under the condition that the storage room is not required to be in the refrigeration mode can be pre-stored by the storage module, then at least one state picture under the current state inside the storage room is shot by the shooting module, the similarity between the two pictures can be represented based on the similarity, whether the storage room of the refrigerator is required to be in the refrigeration mode can be determined by the determining module according to the first similarity between the obtained current state picture and the corresponding picture, when the judging module determines that the storage room needs to be in the refrigeration mode, the processing module controls the storage room to be in the refrigeration mode; and when the judging module determines that the storage room does not need to be in the refrigeration mode, the processing module controls the storage room not to be in the refrigeration mode. Meanwhile, in the process of determining the first similarity, the current state picture and the picture to be compared need to be controlled to have the same shooting angle and shooting position, so that the analysis result of the first similarity is more accurate. By the mode, when the storage chamber of the refrigerator is not required to be in the refrigeration mode, the storage chamber can be flexibly controlled not to be in the refrigeration mode, so that the power consumption of the refrigerator can be saved.
In an embodiment of the present invention, the determining module 304 is configured to determine whether at least one first similarity is greater than or equal to a first preset threshold, if so, determine that the storage room does not need to be in the cooling mode, otherwise, determine that the storage room needs to be in the cooling mode.
As shown in fig. 4, based on the control device of the refrigerator shown in fig. 3, in an embodiment of the present invention, the determining module 303 includes:
a first determining unit 3031, configured to determine a first histogram corresponding to a current state picture;
a second determining unit 3032, configured to determine a second histogram corresponding to the picture to be compared;
a third determining unit 3033, configured to determine a second similarity between the first histogram corresponding to the current state picture determined by the first determining unit 3031 and the second histogram corresponding to the picture to be compared determined by the second determining unit 3032;
the processing unit 3034 is configured to use the second similarity determined by the third determining unit 3033 as a first similarity between the current state picture and the picture to be compared.
In an embodiment of the present invention, the first determining unit 3031 is configured to perform:
converting the current state picture into a first HSV format according to a first formula;
wherein H1Indicating the chroma, S, of the current status picture1Indicating the saturation, V, of the current state picture1Brightness, r, representing the current status picture1Red intensity value, g, representing the current status picture1Green intensity value representing the current status picture, b1A blue intensity value representing a current status picture;
generating a first histogram corresponding to the current state picture according to the first HSV format;
a second determining unit 3032, configured to perform:
converting the picture to be compared into a second HSV format according to a second formula;
wherein H2Representing the chromaticity, S, of the picture to be compared2Representing the saturation, V, of the picture to be compared2Representing the lightness, r, of the picture to be compared2Red intensity value, g, representing the picture to be compared2Representing the green intensity value of the picture to be compared, b2Representing the blue intensity value of the picture to be compared;
and generating a second histogram corresponding to the picture to be compared according to the second HSV format.
In an embodiment of the present invention, the obtaining module 302 is configured to trigger a timer to start counting time when a door closing motion is detected; and when the timer reaches preset time, acquiring at least one state picture in the current state in the storage room.
It is to be understood that the illustrated structure of the embodiment of the present invention does not constitute a specific limitation to the control device of the refrigerator. In other embodiments of the invention, the control device of the refrigerator may comprise more or fewer components than shown, or some components may be combined, some components may be separated, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
Because the information interaction, execution process, and other contents between the units in the device are based on the same concept as the method embodiment of the present invention, specific contents may refer to the description in the method embodiment of the present invention, and are not described herein again.
The embodiment of the invention also provides a control device of the refrigerator, which comprises: at least one memory and at least one processor;
at least one memory for storing a machine readable program;
at least one processor for calling the machine readable program to execute the control method of the refrigerator in any embodiment of the present invention.
An embodiment of the present invention further provides a computer-readable medium, where computer instructions are stored on the computer-readable medium, and when the computer instructions are executed by a processor, the processor is enabled to execute the method for controlling a refrigerator according to any embodiment of the present invention. Specifically, a system or an apparatus equipped with a storage medium on which software program codes that realize the functions of any of the above-described embodiments are stored may be provided, and a computer (or a CPU or MPU) of the system or the apparatus is caused to read out and execute the program codes stored in the storage medium.
In this case, the program code itself read from the storage medium can realize the functions of any of the above-described embodiments, and thus the program code and the storage medium storing the program code constitute a part of the present invention.
Examples of the storage medium for supplying the program code include a floppy disk, a hard disk, a magneto-optical disk, an optical disk (e.g., CD-ROM, CD-R, CD-RW, DVD-ROM, DVD-RAM, DVD-RW, DVD + RW), a magnetic tape, a nonvolatile memory card, and a ROM. Alternatively, the program code may be downloaded from a server computer via a communications network.
Further, it should be clear that the functions of any one of the above-described embodiments may be implemented not only by executing the program code read out by the computer, but also by causing an operating system or the like operating on the computer to perform a part or all of the actual operations based on instructions of the program code.
Further, it is to be understood that the program code read out from the storage medium is written to a memory provided in an expansion board inserted into the computer or to a memory provided in an expansion unit connected to the computer, and then causes a CPU or the like mounted on the expansion board or the expansion unit to perform part or all of the actual operations based on instructions of the program code, thereby realizing the functions of any of the above-described embodiments.
The embodiments of the invention have at least the following beneficial effects:
1. in the embodiment of the invention, the refrigerator is used as a tool for storing food or other articles at low temperature, the refrigeration mode of the refrigerator can provide refrigeration for the fresh-keeping of food and the food storage in the shelf life, however, the storage room of the refrigerator is still in the refrigeration mode under the condition that the refrigerator is not required to be in the refrigeration mode, which causes resource waste, therefore, in order to solve the above problems, the picture to be compared under the condition that the storage room is not required to be in the refrigeration mode can be preserved in advance, then at least one state picture under the current state inside the storage room is obtained, the similarity degree between the two pictures can be represented based on the similarity degree, whether the storage room of the refrigerator is required to be in the refrigeration mode can be determined by determining the first similarity degree between the obtained current state picture and the corresponding picture to be compared, and when the storage room is determined to, controlling the storage chamber to be in a refrigeration mode; and controlling the storage room not to be in the cooling mode when the storage room is determined not to be in the cooling mode. Meanwhile, in the process of determining the first similarity, the current state picture and the picture to be compared need to be controlled to have the same shooting angle and shooting position, so that the analysis result of the first similarity is more accurate. By the mode, when the storage chamber of the refrigerator is not required to be in the refrigeration mode, the storage chamber can be flexibly controlled not to be in the refrigeration mode, so that the power consumption of the refrigerator can be saved;
2. in an embodiment of the present invention, the to-be-compared picture is a picture in which the storage room is in a cooling-unnecessary mode, and for each acquired state picture, it may be determined whether the storage room needs to be in the cooling mode based on a first similarity between the current state picture and the corresponding to-be-compared picture, so that a first preset threshold of the first similarity may be preset, and it is determined whether the storage room needs to be in the cooling mode by determining a relationship between at least one first similarity and the first preset threshold. When the at least one first similarity is larger than or equal to a first preset threshold value, determining that the storage room does not need to be in the refrigeration mode, otherwise, when the at least one first similarity is smaller than the first preset threshold value, determining that the storage room needs to be in the refrigeration mode;
3. in an embodiment of the present invention, the image histogram is a histogram representing a luminance distribution in the digital image, and the number of pixels of each luminance value in the image is plotted, so that, in order to more conveniently determine the first similarity between the current state picture and the picture to be compared, the determination may be performed based on the histogram. The method comprises the steps of respectively determining a first histogram corresponding to a current state picture and a second histogram corresponding to a picture to be compared, then determining a second similarity between the first histogram corresponding to the current state picture and the second histogram corresponding to the picture to be compared, and taking the second similarity as a first similarity between the current state picture and the picture to be compared.
It should be noted that not all steps and modules in the above flows and system structure diagrams are necessary, and some steps or modules may be omitted according to actual needs. The execution order of the steps is not fixed and can be adjusted as required. The system structure described in the above embodiments may be a physical structure or a logical structure, that is, some modules may be implemented by the same physical entity, or some modules may be implemented by a plurality of physical entities, or some components in a plurality of independent devices may be implemented together.
In the above embodiments, the hardware unit may be implemented mechanically or electrically. For example, a hardware element may comprise permanently dedicated circuitry or logic (such as a dedicated processor, FPGA or ASIC) to perform the corresponding operations. The hardware elements may also comprise programmable logic or circuitry, such as a general purpose processor or other programmable processor, that may be temporarily configured by software to perform the corresponding operations. The specific implementation (mechanical, or dedicated permanent, or temporarily set) may be determined based on cost and time considerations.
While the invention has been shown and described in detail in the drawings and in the preferred embodiments, it is not intended to limit the invention to the embodiments disclosed, and it will be apparent to those skilled in the art that various combinations of the code auditing means in the various embodiments described above may be used to obtain further embodiments of the invention, which are also within the scope of the invention.
Claims (10)
1. The control method of the refrigerator is characterized in that at least one picture to be compared inside a storage room of the refrigerator is stored in advance, wherein the picture to be compared is the picture inside the storage room under the condition that the storage room does not need to be in a cooling mode; further comprising:
acquiring at least one state picture in the current state in the storage room;
for each of the status pictures, performing: determining a to-be-compared picture corresponding to a current state picture, and determining a first similarity between the current state picture and the to-be-compared picture, wherein the to-be-compared picture comprises: a target picture having the same shooting angle and shooting position as the current state picture;
determining whether the storage room needs to be in a refrigeration mode according to the first similarity corresponding to each state picture;
when the storage room is determined to be in the refrigeration mode, controlling the storage room to be in the refrigeration mode;
and when the storage room is determined not to be in the cooling mode, controlling the storage room not to be in the cooling mode.
2. The method of claim 1,
the determining whether the storage room needs to be in a cooling mode according to the first similarity corresponding to each state picture comprises:
and judging whether at least one first similarity is greater than or equal to a first preset threshold, if so, determining that the storage room does not need to be in a cooling mode, otherwise, determining that the storage room needs to be in the cooling mode.
3. The method of claim 1,
the determining a first similarity between the current state picture and the picture to be compared includes:
determining a first histogram corresponding to the current state picture;
determining a second histogram corresponding to the picture to be compared;
determining a second similarity between the first histogram corresponding to the current state picture and the second histogram corresponding to the picture to be compared;
and taking the second similarity as the first similarity between the current state picture and the picture to be compared.
4. The method of claim 3,
the determining of the first histogram corresponding to the current state picture includes:
converting the current state picture into a first HSV format according to a first formula;
wherein, the H1Representing the chroma of the current status picture, S1Represents the saturation of the current state picture, said V1Brightness representing the current status picture, r1A red intensity value representing the current status picture, said g1A green intensity value representing the current status picture, b1A blue intensity value representing the current status picture;
generating the first histogram corresponding to the current state picture according to the first HSV format;
the determining of the second histogram corresponding to the picture to be compared includes:
converting the picture to be compared into a second HSV format according to a second formula;
wherein, the H2Representing the chromaticity of the picture to be compared, S2Representing the saturation of the picture to be compared, said V2Representing the lightness of the picture to be compared, the r2A red intensity value representing the picture to be compared, said g2Representing the green intensity value of the picture to be compared, b2Representing the blue intensity value of the picture to be compared;
and generating the second histogram corresponding to the picture to be compared according to the second HSV format.
5. The method according to any one of claims 1 to 4,
the acquiring at least one state picture of the current state inside the storage room comprises:
triggering a timer to start counting time when detecting a door closing action;
and when the timer times to reach preset time, acquiring at least one state picture in the current state in the storage room.
6. A control device for a refrigerator, comprising:
the storage module is used for storing at least one picture to be compared inside a storage room of the refrigerator, wherein the picture to be compared is the picture inside the storage room under the condition that the storage room is not required to be in a cooling mode;
the acquisition module is used for acquiring at least one state picture in the current state in the storage room;
a determining module, configured to determine, for each state picture acquired by the acquiring module, a to-be-compared picture corresponding to a current state picture, and determine a first similarity between the current state picture and the to-be-compared picture, where the to-be-compared picture includes: a target picture having the same shooting angle and shooting position as the current state picture;
the judging module is used for determining whether the storage room needs to be in a refrigeration mode or not according to the first similarity corresponding to each state picture determined by the determining module;
the processing module is used for controlling the storage room to be in the refrigeration mode when the judging module determines that the storage room needs to be in the refrigeration mode; and when the judging module determines that the storage room does not need to be in the refrigeration mode, controlling the storage room not to be in the refrigeration mode.
7. The apparatus of claim 6,
the judging module is used for judging whether at least one first similarity is larger than or equal to a first preset threshold value, if so, the storeroom is determined not to be in the refrigeration mode, and otherwise, the storeroom is determined to be in the refrigeration mode.
8. The apparatus of claim 6,
the determining module includes:
a first determining unit, configured to determine a first histogram corresponding to the current state picture;
the second determining unit is used for determining a second histogram corresponding to the picture to be compared;
a third determining unit, configured to determine a second similarity between the first histogram corresponding to the current state picture determined by the first determining unit and the second histogram corresponding to the picture to be compared determined by the second determining unit;
and the processing unit is used for taking the second similarity determined by the third determining unit as the first similarity between the current state picture and the picture to be compared.
9. The apparatus of claim 8,
the first determining unit is configured to perform:
converting the current state picture into a first HSV format according to a first formula;
wherein, the H1Representing the chroma of the current status picture, S1Represents the saturation of the current state picture, said V1Brightness representing the current status picture, r1A red intensity value representing the current status picture, said g1A green intensity value representing the current status picture, b1A blue intensity value representing the current status picture;
generating the first histogram corresponding to the current state picture according to the first HSV format;
the second determining unit is configured to perform:
converting the picture to be compared into a second HSV format according to a second formula;
wherein, the H2Representing the chromaticity of the picture to be compared, S2Representing the saturation of the picture to be compared, said V2Representing the lightness of the picture to be compared, the r2A red intensity value representing the picture to be compared, said g2Representing the green intensity value of the picture to be compared, b2Representing the blue intensity value of the picture to be compared;
and generating the second histogram corresponding to the picture to be compared according to the second HSV format.
10. The apparatus according to any one of claims 6 to 8,
the acquisition module is used for triggering a timer to start time counting when door closing action is detected; and when the timer times to reach preset time, acquiring at least one state picture in the current state in the storage room.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010357390.3A CN111503992A (en) | 2020-04-29 | 2020-04-29 | Refrigerator control method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010357390.3A CN111503992A (en) | 2020-04-29 | 2020-04-29 | Refrigerator control method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111503992A true CN111503992A (en) | 2020-08-07 |
Family
ID=71876555
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010357390.3A Pending CN111503992A (en) | 2020-04-29 | 2020-04-29 | Refrigerator control method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111503992A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106296634A (en) * | 2015-05-28 | 2017-01-04 | 腾讯科技（深圳）有限公司 | A kind of method and apparatus detecting similar image |
| JP2018013273A (en) * | 2016-07-20 | 2018-01-25 | 三菱電機株式会社 | refrigerator |
| CN108491857A (en) * | 2018-02-11 | 2018-09-04 | 中国矿业大学 | A kind of multiple-camera target matching method of ken overlapping |
| CN109297252A (en) * | 2018-11-16 | 2019-02-01 | 安徽省岳西县四达有限责任公司 | A kind of refrigeration method for managing security based on deposit object |
| CN110542276A (en) * | 2018-05-29 | 2019-12-06 | 博西华电器（江苏）有限公司 | refrigerator and control method thereof |
-
2020
- 2020-04-29 CN CN202010357390.3A patent/CN111503992A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106296634A (en) * | 2015-05-28 | 2017-01-04 | 腾讯科技（深圳）有限公司 | A kind of method and apparatus detecting similar image |
| JP2018013273A (en) * | 2016-07-20 | 2018-01-25 | 三菱電機株式会社 | refrigerator |
| CN108491857A (en) * | 2018-02-11 | 2018-09-04 | 中国矿业大学 | A kind of multiple-camera target matching method of ken overlapping |
| CN110542276A (en) * | 2018-05-29 | 2019-12-06 | 博西华电器（江苏）有限公司 | refrigerator and control method thereof |
| CN109297252A (en) * | 2018-11-16 | 2019-02-01 | 安徽省岳西县四达有限责任公司 | A kind of refrigeration method for managing security based on deposit object |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Soriano et al. | Skin detection in video under changing illumination conditions | |
| CN103024354B (en) | Method for color matching and device | |
| EP3657785B1 (en) | Image white balance processing method and apparatus, and terminal device | |
| CN109584191B (en) | Self-adaptive image enhancement method and terminal based on histogram | |
| KR20150114437A (en) | Image processing apparatus and image processing method | |
| CN114266838B (en) | Image data processing method, device, electronic equipment and storage medium | |
| CN111368785B (en) | Camera shielding judgment method, device, equipment and storage medium | |
| US20190019049A1 (en) | Character/graphics recognition device, character/graphics recognition method, and character/graphics recognition program | |
| JP2004531823A (en) | Object tracking based on color distribution | |
| US7885458B1 (en) | Illuminant estimation using gamut mapping and scene classification | |
| US20100215256A1 (en) | Method and device for maintaining image background by multiple gaussian models | |
| CN109883907B (en) | Cooking smoke detection method based on image and intelligent range hood | |
| US10630954B2 (en) | Estimation of illumination chromaticity in automatic white balancing | |
| CN101563913A (en) | Removal of artifacts in flash images | |
| US7796827B2 (en) | Face enhancement in a digital video | |
| CN111503992A (en) | Refrigerator control method and device | |
| CN106231278B (en) | Method for processing video frequency and television system | |
| CN116485679A (en) | Low-illumination enhancement processing method, device, equipment and storage medium | |
| CN116051400A (en) | Image processing method and device, electronic equipment and storage medium | |
| CN116309224A (en) | Image fusion method, device, terminal and computer readable storage medium | |
| WO2016113407A1 (en) | Methods and apparatus for groupwise contrast enhancement | |
| CN116980720A (en) | Video generation method, apparatus and computer readable storage medium | |
| US8538142B2 (en) | Face-detection processing methods, image processing devices, and articles of manufacture | |
| CN113132617B (en) | Image jitter judgment method and device and image identification triggering method and device | |
| CN113723498A (en) | Food maturity identification method, device, system, electric appliance, server and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200807 |
|
| RJ01 | Rejection of invention patent application after publication |