CN114383377A - Image partitioning method for storage space of refrigerator, refrigerator and computer-readable storage medium - Google Patents

Image partitioning method for storage space of refrigerator, refrigerator and computer-readable storage medium Download PDF

Info

Publication number
CN114383377A
CN114383377A CN202011127067.3A CN202011127067A CN114383377A CN 114383377 A CN114383377 A CN 114383377A CN 202011127067 A CN202011127067 A CN 202011127067A CN 114383377 A CN114383377 A CN 114383377A
Authority
CN
China
Prior art keywords
information
refrigerator
picture information
door body
area
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202011127067.3A
Other languages
Chinese (zh)
Other versions
CN114383377B (en
Inventor
高洪波
孔令磊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
HEFEI HAIER REFRIGERATOR CO Ltd
Haier Smart Home Co Ltd
Original Assignee
HEFEI HAIER REFRIGERATOR CO Ltd
Haier Smart Home Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by HEFEI HAIER REFRIGERATOR CO Ltd, Haier Smart Home Co Ltd filed Critical HEFEI HAIER REFRIGERATOR CO Ltd
Priority to CN202011127067.3A priority Critical patent/CN114383377B/en
Publication of CN114383377A publication Critical patent/CN114383377A/en
Application granted granted Critical
Publication of CN114383377B publication Critical patent/CN114383377B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D29/00—Arrangement or mounting of control or safety devices
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D23/00—General constructional features
    • F25D23/02—Doors; Covers

Landscapes

  • Engineering & Computer Science (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Physics & Mathematics (AREA)
  • Mechanical Engineering (AREA)
  • Thermal Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Cold Air Circulating Systems And Constructional Details In Refrigerators (AREA)

Abstract

The invention discloses an image partitioning method of a refrigerator storage space, a refrigerator and a computer readable storage medium. According to the method, the pictures shot in the storage space of the refrigerator are accurately divided into blocks, so that the areas of the newly-placed food materials and the areas of the moved food materials can be intelligently judged, the local positions are identified, detection of other irrelevant areas is avoided, the identification accuracy and efficiency are greatly improved, the intelligent degree is higher, and the user experience is better.

Description

Image partitioning method for storage space of refrigerator, refrigerator and computer-readable storage medium
Technical Field
The present invention relates to a method for partitioning an image of a storage space of a refrigerator, and more particularly, to a refrigerator and a computer-readable storage medium related to the method.
Background
With the further improvement of the living standard and the further development of science and technology of people, the requirements of users on household appliances are further improved, and the intellectualization of the household appliances is further required. For the change situation of food materials in a refrigerator, there are many schemes at present, for example, the weight change situation of objects at different positions in the refrigerator is obtained through a plurality of weight sensors, a video stream is shot, a high-speed camera or a depth camera is used for obtaining videos to be taken in and out, and the like, and the methods have advantages and disadvantages, but the problems of high implementation cost exist, so that the competitiveness of products is small; in addition, if the type of food materials in the refrigerator needs to be judged, the identification accuracy is not high enough when the type of food materials is judged in an image identification mode, and the problems affect the user experience.
Disclosure of Invention
In order to solve the problems in the prior art, an object of the present invention is to provide an image partitioning method for a storage space of a refrigerator, a refrigerator and a computer-readable storage medium.
In order to achieve the above object, an embodiment of the present invention provides an image partitioning method for an object storage space of a refrigerator, including the steps of:
acquiring state information of a refrigerator door body;
when the state information is that the door body is closed again after being opened, the current picture information A of the object placing space is obtainedn；
Comparing the current picture information AnThe last picture information A before the door body is openedn-1Obtaining difference information Bn1；
Comparing the current picture information AnAnd background picture information A when food materials are not placed in the refrigerator0Obtaining foreground information Bm1；
Traverse current picture information AnEach pixel point i (x, y) is respectively associated with the difference information Bn1And the foreground information Bm1Carrying out comparison;
if the pixel point i belongs to Bn1And i ∈ Bm1Setting the area where the pixel point i is located as the area where food materials are put after the door body is openedA domain;
if the pixel point is
Figure BDA0002733951110000021
And i ∈ Bn1And setting the area where the pixel point i is as the area where the food material is moved out after the door body is opened.
As a further improvement of the invention, the method also comprises the following steps: if the pixel point i belongs to Bm1And is
Figure BDA0002733951110000022
And setting the area where the pixel point i is located as the area where food materials are placed before the door body is opened and the area is not moved out.
As a further improvement of the invention, the method also comprises the following steps: if the pixel point is
Figure BDA0002733951110000023
And is
Figure BDA0002733951110000024
Setting the area where the pixel point i is as a background area where food materials are not put before and after the door body is opened.
As a further improvement of the invention, said step "compares said current picture information AnThe last picture information A before the door body is openedn-1Obtaining difference information Bn1"comprises:
comparing the current picture information A by a frame difference methodnThe last picture information A before the door body is openedn-1Generating difference picture information BnIn the difference picture information BnIn each pixel point in (1), the current picture information anAnd the last picture information An-1Compared with the changed pixel value of 1, the unchanged pixel value is 0;
according to the difference picture information BnGenerating difference information Bn1The difference picture information Bn1For the difference picture information BnAnd (4) a set of all pixel points with pixel values of 1.
AsIn a further development of the invention, the step of "comparing the current picture information anAnd background picture information A when food materials are not placed in the refrigerator0Obtaining foreground information Bm1"comprises:
comparing the current picture information A by background subtractionnAnd background picture information A when food materials are not placed in the refrigerator0Generating foreground picture information BmThe foreground picture information BmThe pixel value of the foreground is 1, and the pixel value of the background is 0;
according to the foreground picture information BmGenerating foreground information Bm1The foreground information Bm1For the foreground picture information BmAnd (4) a set of all pixel points with pixel values of 1.
As a further improvement of the invention, the method also comprises the following steps: and when the area of the pixel point i is the area of the food material put in or moved out after the door body is opened, carrying out image recognition on the area of the food material put in or moved out, and acquiring food material information.
As a further improvement of the invention, the method also comprises the following steps:
determining the calorie value information of the food materials to be placed and moved according to the food material information, the regions where the food materials are placed and the regions where the food materials are moved out;
and generating the diet intake information and food material purchase suggestion information of the user according to the calorie value information.
In order to achieve one of the above objects, an embodiment of the present invention provides a refrigerator, which includes a refrigerator body, a door body, a storage space enclosed by the refrigerator body and the door body, a storage module and a processing module, wherein the storage module stores a computer program capable of running on the processing module, the refrigerator further includes a monitoring module and a camera module, the monitoring module obtains information on the opening and closing state of the door body, the camera module obtains picture information of the storage space, and the processing module can implement the steps in the image partitioning method for the storage space of the refrigerator when executing the computer program.
As a further improvement of the present invention, the food processing system further comprises a communication module, wherein the communication module uploads the area where the food materials are put in and/or the area where the food materials are removed to a server for analysis and identification.
In order to achieve one of the above objects, an embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored, wherein the computer program, when being executed by a processing module, implements the steps of the method for partitioning images of a storage space of a refrigerator.
Compared with the prior art, the invention has the following beneficial effects: carry out accurate block division through the picture of putting the thing space and shooting to the refrigerator, make it can intelligent judgement the region of the edible material of newly putting into, and the region of the edible material that shifts out, discern these local positions, make its recognition efficiency promote greatly, and because its detection that can avoid other irrelevant regions, make the rate of accuracy of discernment also promote greatly, also can be clear when discerning know the regional edible material of discernment move into or take out, its intelligent degree is high, the demand of wisdom household electrical appliances has been accorded with, user's use experience is better.
Drawings
FIG. 1 is a schematic flow chart illustrating a method for partitioning an image of a storage space of a refrigerator according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of a control module according to an embodiment of the present invention;
wherein, 1, a refrigerator; 11. a camera module; 12. a monitoring module; 13. a processing module; 14. a storage module; 15. a communication module; 16. a communication bus.
Detailed Description
The present invention will be described in detail below with reference to specific embodiments shown in the drawings. These embodiments are not intended to limit the present invention, and structural, methodological, or functional changes made by those skilled in the art according to these embodiments are included in the scope of the present invention.
An embodiment of the invention provides an image partitioning method for an object storage space of a refrigerator, the refrigerator and a computer-readable storage medium.
The image partitioning method provided by this embodiment is applied to a refrigerator 1, where the refrigerator 1 includes a box body, a door body, an object space enclosed by the box body and the door body, a storage module 14 and a processing module 13, food materials to be refrigerated are placed in the object space, the storage module 14 stores a computer program that can run on the processing module 13, the refrigerator 1 further includes a monitoring module 12 and a camera module 11, the monitoring module 12 obtains state information of opening and closing of the door body, the camera module 11 obtains picture information of the object space, and the processing module 13 can implement steps in the image partitioning method of the object space of the refrigerator 1 according to this embodiment when executing the computer program, and steps of the control method according to this embodiment are shown in fig. 1.
It should be noted that although the present application provides the operation steps of the image partition method for the storage space of the refrigerator 1 as described in the following embodiments or flowcharts, the method does not limit the execution sequence of some steps in the steps logically without necessary cause and effect relationship based on the conventional or non-creative labor.
Specifically, the method comprises the following steps:
step 101: acquiring state information of a door body of the refrigerator 1; the state information mainly comprises the opening or closing state of the door body of the refrigerator 1, and the state information can be monitored through the monitoring module 12 and transmitted to the processor. The opening or closing state information of the door body can be acquired through a magnetic sensitive switch, a Hall sensor, an angle sensor, a mechanical device for detecting the opening and closing of the door body and the like arranged on the door body or the refrigerator body, after the door body is opened and closed again, the door body can be seen as a user who possibly operates articles in the refrigerator 1 in the period, the step is enabled not to be detected at any time through the arrangement, the door body only needs to be opened and closed and then operates, and the operation efficiency is higher.
Step 102: when the state information is that the door body is openedWhen the storage space is closed again, the current picture information A of the storage space is obtainedn；
Current picture information anCan acquire by camera module 11, this camera module 11 includes the camera, and the camera can set up on the door body of refrigerator 1, and the orientation from the door body towards the box is facing to putting the thing space and is taken, or sets up at the top of putting the thing space, and the thing space of putting to the below is taken, acquires the picture of putting in the thing space, and this shooting only operates after the door body is closed again by opening, and the current picture information A who shootsnCan be regarded as a picture of the state after the user has taken or placed the picture.
Step 103: comparing the current picture information AnThe last picture information A before the door body is openedn-1Obtaining difference information Bn1. The difference information Bn1Embodying the current picture information AnThe last picture information A before the door body is openedn-1The difference may be that the article originally existing in the refrigerator 1 is moved out, the article originally not existing in the refrigerator 1 is moved in, or the article originally existing in the refrigerator 1 is moved to a new position, in which case, the original position and the new position of the article are represented by the difference information Bn1In (1).
Step 104: comparing the current picture information AnAnd background picture information A when food materials are not placed in the refrigerator 10Obtaining foreground information Bm1. The foreground information Bm1Embodying the current picture information AnBackground picture information A related to the situation when no food is placed in the refrigerator 10The different content, background picture information A0I.e. a picture which is purely background in the object space and has foreground information Bm1Information of the existing food materials in the refrigerator 1 is embodied differently from the background information.
Step 105: traverse current picture information AnEach pixel point i (x, y) in (1) is respectively corresponding to the difference information Bn1And the foreground information Bm1Carrying out comparison; the set of all the pixel points i is all the areas of the complete picture。
If the pixel point i belongs to Bn1And i ∈ Bm1Setting the area where the pixel point i is located as an area where food materials are placed after the door body is opened; since i is belonged to Bm1So that there is a food material in the region of i, and i ∈ Bn1Therefore, the food materials in the region i are newly appeared after the door body is opened and closed again, the position of the pixel point i is the region for placing the food materials after the door body is opened, and the set of the pixel points i is the whole region for placing the food materials after the door body is opened.
If the pixel point is
Figure BDA0002733951110000061
And i ∈ Bn1Setting the area where the pixel point i is as the area where the door body is moved out of the food material after being opened, because
Figure BDA0002733951110000062
So that no food material exists in the region of i, and i belongs to Bn1Therefore, the information in the i area is different after the door body is opened and closed again, that is, food exists at the position before the door body is opened, and further shows that the position of the pixel point i is the area where the food is moved out after the door body is opened, and the set of a plurality of the pixel points i is all the areas where the food is moved out after the door body is opened.
Considering the situation that the food material in the refrigerator 1 is not moved out, but only moved, the pixel point at the original position is considered
Figure BDA0002733951110000063
And i ∈ Bn1And the pixel point i ∈ B at the new positionn1And i ∈ Bm1Here, it is considered that the material at the original position is taken out, and the material at the new position is put in, for example, an apple is put at the original position, and now an apple appears at the new position.
The execution sequence without causal relationship in the above steps may be adjusted, for example, the execution sequence of step 103 and step 104 may be changed from top to bottom, and finally the comparison of the pixel point i is implemented.
Further, the method of this embodiment further includes the steps of: if the pixel point i belongs to Bm1And is
Figure BDA0002733951110000064
And setting the area where the pixel point i is located as the area where food materials are placed before the door body is opened and the area is not moved out. Due to the fact that
Figure BDA0002733951110000065
Therefore, the information in the i area is not changed before and after the door body is opened and closed, and i ∈ Bm1Therefore, the food material exists in the information in the region i after the door body is closed and displayed, that is, the food material also exists in the position before the door body is opened, and further, the region where the pixel point i is located is the region where the food material is placed before the door body is opened and is not moved out, and the set of the pixel points i is the whole region where the food material is not moved out after the door body is opened.
And, further comprising the steps of: if the pixel point is
Figure BDA0002733951110000071
And is
Figure BDA0002733951110000072
Setting the area where the pixel point i is as a background area where food materials are not put before and after the door body is opened. Due to the fact that
Figure BDA0002733951110000073
Therefore, the information in the i area is not changed before and after the door body is opened and closed, and the information is obtained
Figure BDA0002733951110000074
Therefore, no food material exists in the information in the i area after the door body is closed and displayed, that is, no food material exists at the position before the door body is opened, and further, the area where the pixel point i is located is shown as theThe food material is not put into the area before and after the door body is opened, and the collection of the pixel points i is the whole area in which the food material is not put into the area before and after the door body is opened.
By comparing each pixel point with difference information Bn1And foreground information Bm1Whether any set is input or not is judged, and the current picture information A acquired by the camera module 11 in the refrigerator 1 is comparednThe food material storage area is divided into four areas, namely an area for placing food materials after the door body is opened, an area for moving the food materials out after the door body is opened, an area for placing the food materials before the door body is opened and not moving the food materials out, and a background area for not placing the food materials before and after the door body is opened. When the food materials taken in and/or moved out need to be further analyzed, only the area where the food materials are moved out after the door body is opened and the area where the food materials are put in after the door body is opened are analyzed, so that the workload is greatly reduced, the identification speed is higher, other irrelevant contents are prevented from being identified, and the identification accuracy is higher.
Further, the step of "comparing the current picture information anThe last picture information A before the door body is openedn-1Obtaining difference information Bn1"comprises:
comparing the current picture information A by a frame difference methodnThe last picture information A before the door body is openedn-1Generating difference picture information BnIn the difference picture information BnIn each pixel point in (1), the current picture information anAnd the last picture information An-1Compared with the changed pixel value of 1, the unchanged pixel value is 0;
according to the difference picture information BnGenerating difference information Bn1The difference picture information Bn1For the difference picture information BnAnd (4) a set of all pixel points with pixel values of 1. Difference picture information BnIncluding all pixels, some pixels are represented by 0 and some pixels are represented by 1, and the difference information Bn1Only difference picture information BnThe set of all pixels indicated with 1.
And, the step of comparing theCurrent picture information anAnd background picture information A when food materials are not placed in the refrigerator 10Obtaining foreground information Bm1"comprises:
comparing the current picture information A by background subtractionnAnd background picture information A when food materials are not placed in the refrigerator 10Generating foreground picture information BmThe foreground picture information BmThe pixel value of the foreground is 1, and the pixel value of the background is 0;
according to the foreground picture information BmGenerating foreground information Bm1The foreground information Bm1For the foreground picture information BmAnd (4) a set of all pixel points with pixel values of 1. Foreground picture information BmIncluding all pixels, some pixels are represented by 0 and some pixels are represented by 1, and the foreground information Bm1Only foreground picture information BmThe set of all pixels indicated with 1.
In addition, the method of the embodiment further comprises the steps of: and when the area of the pixel point i is the area of the food material put in or moved out after the door body is opened, carrying out image recognition on the area of the food material put in or moved out, and acquiring food material information.
And further comprising the steps of:
determining the calorie value information of the food materials to be placed and moved according to the food material information, the regions where the food materials are placed and the regions where the food materials are moved out;
and generating the diet intake information and food material purchase suggestion information of the user according to the calorie value information.
After specific information of the food materials to be moved out or placed in is judged, the type of the food materials can be judged by identifying the area image, further, the size of the image area to be moved out or placed in is clear, and the distance from the camera module 11 to a rack for placing the food materials is clear, so that the volume of the food materials can be judged according to the distance between the food materials and the camera module 11 and the size of the food material image, the heat value information of the food materials is calculated by combining the reference unit volume weight value of the food materials, and more intelligent applications related to the space partitioning method are further developed on the basis.
In addition, the refrigerator 1 further comprises a communication module 15, and the communication module 15 uploads the area where the food materials are put in and/or the area where the food materials are removed to a server for analysis and identification.
And the refrigerator 1 may further comprise a communication bus 16, the communication bus 16 being used for establishing connection between the processing module 13, the camera module 11, the monitoring module 12, the storage module 14 and the communication module 15, and the communication bus 16 may comprise a path for transmitting information between the above electrical components.
The present invention provides a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements any of the steps of the method for image segmentation of a storage space of a refrigerator 1 as described above, that is, implements the steps of any of the above-described methods for image segmentation of a storage space of a refrigerator 1.
The processing modules 13 in the present application may be integrated into one processing module, or each of the modules may exist alone physically, or 2 or more than 2 modules may be integrated into one module. The integrated module can be realized in a hardware form, and can also be realized in a form of hardware and a software functional module.
The integrated module implemented in the form of a software functional module may be stored in a computer-readable storage medium. The software functional module is stored in a storage medium and includes several instructions for causing a computer system (which may be a personal computer, a server, or a network system) or a processing module (processor) to perform some steps of the methods according to the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
Compared with the prior art, the embodiment has the following beneficial effects:
carry out accurate block division through the picture of putting the thing space and shooting to the refrigerator, make it can intelligent judgement the region of the edible material of newly putting into, and the region of the edible material that shifts out, discern these local positions, make its recognition efficiency promote greatly, and because its detection that can avoid other irrelevant regions, make the rate of accuracy of discernment also promote greatly, also can be clear when discerning know the regional edible material of discernment move into or take out, its intelligent degree is high, the demand of wisdom household electrical appliances has been accorded with, user's use experience is better.
It should be understood that although the present description refers to embodiments, not every embodiment contains only a single technical solution, and such description is for clarity only, and those skilled in the art should make the description as a whole, and the technical solutions in the embodiments can also be combined appropriately to form other embodiments understood by those skilled in the art.
The above-listed detailed description is only a specific description of a possible embodiment of the present invention, and they are not intended to limit the scope of the present invention, and equivalent embodiments or modifications made without departing from the technical spirit of the present invention should be included in the scope of the present invention.

Claims (10)

1. An image partition method for a storage space of a refrigerator is characterized by comprising the following steps:
acquiring state information of a door body;
when the state information is that the door body is closed again after being opened, the current picture information A of the object placing space is obtainedn；
Comparing the current picture information AnThe last picture information A before the door body is openedn-1Obtaining difference information Bn1；
Comparing the current picture information AnAnd background picture information A when food materials are not placed in the refrigerator0Obtaining foreground information Bm1；
Traverse current picture information AnEach image ofA pixel point i (x, y) respectively corresponding to the difference information Bn1And the foreground information Bm1Carrying out comparison;
if the pixel point i belongs to Bn1And i ∈ Bm1Setting the area where the pixel point i is located as an area where food materials are placed after the door body is opened;
if the pixel point is
Figure FDA0002733951100000011
And i ∈ Bn1And setting the area where the pixel point i is as the area where the food material is moved out after the door body is opened.
2. The image partitioning method for the storage space of the refrigerator as claimed in claim 1, further comprising the steps of: if the pixel point i belongs to Bm1And is
Figure FDA0002733951100000012
And setting the area where the pixel point i is located as the area where food materials are placed before the door body is opened and the area is not moved out.
3. The image partitioning method for the storage space of the refrigerator as claimed in claim 1, further comprising the steps of: if the pixel point is
Figure FDA0002733951100000013
And is
Figure FDA0002733951100000014
Setting the area where the pixel point i is as a background area where food materials are not put before and after the door body is opened.
4. The method as claimed in claim 1, wherein the step of comparing the current picture information AnThe last picture information A before the door body is openedn-1Obtaining difference information Bn1"comprises:
by frame difference methodThe current picture information AnThe last picture information A before the door body is openedn-1Generating difference picture information BnIn the difference picture information BnIn each pixel point in (1), the current picture information anAnd the last picture information An-1Compared with the changed pixel value of 1, the unchanged pixel value is 0;
according to the difference picture information BnGenerating difference information Bn1The difference picture information Bn1For the difference picture information BnAnd (4) a set of all pixel points with pixel values of 1.
5. The method as claimed in claim 1, wherein the step of comparing the current picture information AnAnd background picture information A when food materials are not placed in the refrigerator0Obtaining foreground information Bm1"comprises:
comparing the current picture information A by background subtractionnAnd background picture information A when food materials are not placed in the refrigerator0Generating foreground picture information BmThe foreground picture information BmThe pixel value of the foreground is 1, and the pixel value of the background is 0;
according to the foreground picture information BmGenerating foreground information Bm1The foreground information Bm1For the foreground picture information BmAnd (4) a set of all pixel points with pixel values of 1.
6. The image partitioning method for the storage space of the refrigerator as claimed in claim 1, further comprising the steps of: and when the area of the pixel point i is the area of the food material put in or moved out after the door body is opened, carrying out image recognition on the area of the food material put in or moved out, and acquiring food material information.
7. The image partitioning method for the storage space of the refrigerator as claimed in claim 6, further comprising the steps of:
determining the calorie value information of the food materials to be placed and moved according to the food material information, the regions where the food materials are placed and the regions where the food materials are moved out;
and generating the diet intake information and food material purchase suggestion information of the user according to the calorie value information.
8. A refrigerator comprises a refrigerator body, a door body, an object placing space enclosed by the refrigerator body and the door body, a storage module and a processing module, wherein the storage module stores a computer program capable of running on the processing module, the refrigerator is characterized by further comprising a monitoring module and a camera module, the monitoring module acquires state information of opening and closing of the door body, the camera module acquires picture information of the object placing space, and the processing module can realize the steps in the image partitioning method of the object placing space of the refrigerator according to any one of claims 1 to 7 when executing the computer program.
9. The refrigerator of claim 8, further comprising a communication module that uploads the area where food material is put in and/or the area where food material is removed to a server for analysis and identification.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processing module, implements the steps of the method for image segmentation of storage space of a refrigerator according to any one of claims 1 to 7.
CN202011127067.3A 2020-10-20 2020-10-20 Image partitioning method for refrigerator storage space, refrigerator and computer readable storage medium Active CN114383377B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011127067.3A CN114383377B (en) 2020-10-20 2020-10-20 Image partitioning method for refrigerator storage space, refrigerator and computer readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011127067.3A CN114383377B (en) 2020-10-20 2020-10-20 Image partitioning method for refrigerator storage space, refrigerator and computer readable storage medium

Publications (2)

Publication Number Publication Date
CN114383377A true CN114383377A (en) 2022-04-22
CN114383377B CN114383377B (en) 2023-09-19

Family

ID=81192690

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011127067.3A Active CN114383377B (en) 2020-10-20 2020-10-20 Image partitioning method for refrigerator storage space, refrigerator and computer readable storage medium

Country Status (1)

Country Link
CN (1) CN114383377B (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20180090724A (en) * 2017-12-26 2018-08-13 구영모 Method for controlling refrigerator and refrigerator controller
US20190066034A1 (en) * 2017-08-31 2019-02-28 Whirlpool Corporation Refrigerator with contents monitoring system
US20190354926A1 (en) * 2019-06-10 2019-11-21 Lg Electronics Inc. Artificial intelligent refrigerator and method of storing food thereof
US20200003482A1 (en) * 2019-06-28 2020-01-02 Lg Electronics Inc. Refrigerator and method for operating the refrigerator
CN111292828A (en) * 2018-12-07 2020-06-16 海信（山东）冰箱有限公司 Intelligent refrigerator and food material management method, device and storage medium thereof

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190066034A1 (en) * 2017-08-31 2019-02-28 Whirlpool Corporation Refrigerator with contents monitoring system
KR20180090724A (en) * 2017-12-26 2018-08-13 구영모 Method for controlling refrigerator and refrigerator controller
CN111292828A (en) * 2018-12-07 2020-06-16 海信（山东）冰箱有限公司 Intelligent refrigerator and food material management method, device and storage medium thereof
US20190354926A1 (en) * 2019-06-10 2019-11-21 Lg Electronics Inc. Artificial intelligent refrigerator and method of storing food thereof
US20200003482A1 (en) * 2019-06-28 2020-01-02 Lg Electronics Inc. Refrigerator and method for operating the refrigerator

Also Published As

Publication number Publication date
CN114383377B (en) 2023-09-19

Similar Documents

Publication Publication Date Title
JP7181437B2 (en) A technique for identifying skin tones in images under uncontrolled lighting conditions
Camplani et al. Background foreground segmentation with RGB-D Kinect data: An efficient combination of classifiers
CN106164980B (en) Information processing apparatus and information processing method
US11048976B2 (en) Method and system for controlling machines based on object recognition
JP2015536094A (en) Video scene detection
US11120311B2 (en) Adjusting machine settings through multi-pass training of object detection models
CN109727275B (en) Object detection method, device, system and computer readable storage medium
CN105164481A (en) Method for managing storage product in refrigerator using image recognition, and refrigerator for same
WO2018063608A1 (en) Place recognition algorithm
CN113766330A (en) Method and device for generating recommendation information based on video
KR20170082025A (en) Apparatus and Method for Identifying Video with Copyright using Recognizing Face based on Machine Learning
US9866894B2 (en) Method for annotating an object in a multimedia asset
CN114419520A (en) Training method, device, equipment and storage medium of video-level target detection model
Zhang et al. A novel optimization framework for salient object detection
JP2014110020A (en) Image processor, image processing method and image processing program
CN114383377A (en) Image partitioning method for storage space of refrigerator, refrigerator and computer-readable storage medium
KR20180090724A (en) Method for controlling refrigerator and refrigerator controller
CN107526991B (en) Refrigerating device storage management system and refrigerating device
CN114913154A (en) Method and device for determining article taking quantity, electronic equipment and storage medium
Kim Background subtraction with variable illumination in outdoor scenes
CN111967403A (en) Video moving area determining method and device and electronic equipment
Wang et al. Background subtraction using spatiotemporal condition information
CN112789652A (en) Refrigerator, server and object identification method of refrigerator
WO2023185835A1 (en) Multi-camera vision system in refrigeration appliance
Sehairi et al. A Benchmark of Motion Detection Algorithms for Static Camera: Application on CDnet 2012 Dataset

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant