CN111023690A - Food identification system based on intelligent refrigerator - Google Patents
Food identification system based on intelligent refrigerator Download PDFInfo
- Publication number
- CN111023690A CN111023690A CN201911142323.3A CN201911142323A CN111023690A CN 111023690 A CN111023690 A CN 111023690A CN 201911142323 A CN201911142323 A CN 201911142323A CN 111023690 A CN111023690 A CN 111023690A
- Authority
- CN
- China
- Prior art keywords
- food
- refrigerator
- unit
- recognition unit
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Images
Classifications
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
- F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
- F25D29/00—Arrangement or mounting of control or safety devices
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
- F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
- F25D2700/00—Means for sensing or measuring; Sensors therefor
- F25D2700/04—Sensors detecting the presence of a person
Abstract
The invention discloses a food identification system based on an intelligent refrigerator, and relates to the field of intelligent refrigerators. The invention comprises a controller, a gesture recognition unit, an image recognition unit, a collection unit and a storage unit, wherein the gesture recognition unit, the image recognition unit, the collection unit and the storage unit are connected with the controller; the gesture recognition unit is used for judging the gesture of the user for storing and taking food; the image identification unit is used for identifying the type and the number of the food accessed by the user; the acquisition unit comprises an infrared sensor 1 and an infrared sensor 2 which are respectively arranged on the front frame and the rear frame of the inner wall of the refrigerator door body, a liquid crystal touch screen embedded on the outer wall of the refrigerator door body and a CDD camera arranged on the top of the refrigerator body; and the controller is used for acquiring the real-time posture of the current user from the posture recognition unit, acquiring the types and the number of the food accessed by the user from the image recognition unit, processing the types and the number to obtain the information of the refrigerator food, and displaying the information on the liquid crystal touch screen. The invention reduces the production cost of the intelligent refrigerator and improves the accuracy of food identification.
Description
Technical Field
The invention belongs to the field of intelligent refrigerators, and particularly relates to a food identification system based on an intelligent refrigerator.
Background
With the progress of the times, people have more and more requirements on various articles used, the quality of life of household appliances is greatly dependent on the intelligent degree of the household appliances along with the daily life of the people, and the intellectualization of the household appliances is a necessary trend. The household appliance intellectualization is household appliance + artificial intelligence, and the refrigerator is taken as the household appliance closely related to our health, and the intellectualization improvement is certainly the most necessary. Moreover, the existing refrigerator needs to use it actively.
However, the refrigerator with an image recognition function in the market at present is affected by factors such as a camera shooting visual angle and shelf shielding in the refrigerator, so that the problem of shooting dead angles is easily caused, and image recognition is affected. Although the scheme of the multiple groups of cameras for complementary photographing layer by layer can reduce the risk of photographing dead angles, the corresponding cost can be increased greatly. The dynamic photographing is to dynamically photograph the food storing and taking action when a person opens the refrigerator to store the food, so that the problem of dead angles of photographing in the refrigerator can be avoided.
Disclosure of Invention
The invention aims to provide a food identification system based on an intelligent refrigerator, which judges whether a user stores or takes food by installing infrared sensors at the front side and the rear side of a refrigerator door body, dynamically identifies the stored food by a camera arranged on the outer wall of the refrigerator, and finally displays the food information in the refrigerator in real time by a liquid crystal display, thereby solving the problems that the existing refrigerator is easy to have shooting dead angles, the cost is increased due to too many cameras, and the food identification is not accurate enough.
In order to solve the technical problems, the invention is realized by the following technical scheme:
the invention relates to a food identification system based on an intelligent refrigerator, which comprises a controller, and a gesture identification unit, an image identification unit, an acquisition unit and a storage unit which are connected with the controller;
the gesture recognition unit is used for judging the gesture of the user for storing and taking food; the image identification unit is used for identifying the type and the number of the food accessed by the user;
the acquisition unit comprises an infrared sensor 1 and an infrared sensor 2 which are respectively arranged on the front frame and the rear frame of the inner wall of the refrigerator door body, a liquid crystal touch screen embedded on the outer wall of the refrigerator door body and a CDD camera arranged on the top of the refrigerator body;
the controller is used for acquiring the real-time posture of the current user from the posture recognition unit, acquiring the type and the number of the food accessed by the user from the image recognition unit, processing the type and the number to obtain the information of the refrigerator food, and displaying the information on the liquid crystal touch screen;
the storage unit is used for storing the state information and the food information of the refrigerator;
the gesture recognition unit and the image recognition unit are in a cooperative mode.
Preferably, when the infrared sensor 1 and the infrared sensor 2 sense that the hands pass by or leave, the electric signals are sent to the controller, the controller sends a photographing instruction to the CDD camera, and sends a photographed picture to the image recognition unit for recognition, so as to judge the state of the user for storing and taking food.
Preferably, the storage unit comprises a food storage and a sample storage; the sample memory is used for storing food image information set by a user in advance, the controller receives the food image information collected by the image collecting unit in real time, and the collected food information and the pre-stored food sample information are transmitted to the image identifying unit for identification.
Preferably, the shutter shooting speed of the CCD camera is less than 0.01 second.
Preferably, the liquid crystal touch screen further comprises a function input key for setting the working parameters of the refrigerator.
The invention has the following beneficial effects:
(1) according to the invention, the infrared sensors are arranged on the front frame and the rear frame of the inner wall of the refrigerator door body, the CDD cameras are controlled to shoot pictures when hands pass and leave, and whether a user stores food or takes food is judged, so that the system can conveniently count the food in the refrigerator, the user can know the condition of the food in the refrigerator without opening the refrigerator, and the power loss is reduced;
(2) according to the invention, the CDD camera is arranged at the top of the refrigerator body, food images are dynamically acquired for identification according to the monitoring condition of the infrared sensor, the condition that the camera is arranged on each layer is avoided by utilizing dynamic acquisition, the production cost is reduced, and the accuracy of food identification is improved.
Of course, it is not necessary for any product in which the invention is practiced to achieve all of the above-described advantages at the same time.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic structural diagram of a food identification system based on an intelligent refrigerator according to the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, the present invention is a food recognition system based on an intelligent refrigerator, including a controller, and a gesture recognition unit, an image recognition unit, a collection unit and a storage unit connected to the controller;
the gesture recognition unit is used for judging the gesture of the user for storing and taking food; the image identification unit is used for identifying the type and the number of the food accessed by the user;
the acquisition unit comprises an infrared sensor 1 and an infrared sensor 2 which are respectively arranged on the front frame and the rear frame of the inner wall of the refrigerator door body, a liquid crystal touch screen embedded on the outer wall of the refrigerator door body and a CDD camera arranged on the top of the refrigerator body;
the controller is used for acquiring the real-time posture of the current user from the posture recognition unit, acquiring the type and the number of the food accessed by the user from the image recognition unit, processing the type and the number to obtain the information of the refrigerator food and displaying the information on the liquid crystal touch screen;
a storage unit for storing state information of the refrigerator and food information; the gesture recognition unit and the image recognition unit are in a cooperative mode.
Wherein, infrared sensor 1 and infrared sensor 2 sense the staff when passing by and leaving, send electrical signal to the controller, and the controller issues the instruction of shooing to the CDD camera to the image information who will take a photograph is sent at image acquisition module, and image acquisition's module is through comparing the sample storehouse, judges the state that the user accessed food, thereby according to how much of user access food, changes the food quantity of system statistics, guarantees the accuracy of food statistics in the refrigerator.
Wherein the storage unit comprises a food storage and a sample storage; the sample memory is used for storing food image information set by a user in advance, the controller receives the food image information collected by the image collecting unit in real time, and the collected food information and the pre-stored food sample information are transmitted to the image identifying unit for identification.
And the shutter shooting speed of the CCD camera is less than 0.01 second.
The liquid crystal touch screen further comprises a function input key for setting working parameters of the refrigerator, and the set parameters comprise the refrigeration temperature and the refrigeration mode of the refrigerator.
It should be noted that, in the above system embodiment, each included unit is only divided according to functional logic, but is not limited to the above division as long as the corresponding function can be implemented; in addition, specific names of the functional units are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present invention.
In addition, it is understood by those skilled in the art that all or part of the steps in the method for implementing the embodiments described above may be implemented by a program instructing associated hardware, and the corresponding program may be stored in a computer-readable storage medium.
The preferred embodiments of the invention disclosed above are intended to be illustrative only. The preferred embodiments are not intended to be exhaustive or to limit the invention to the precise embodiments disclosed. Obviously, many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles of the invention and the practical application, to thereby enable others skilled in the art to best utilize the invention. The invention is limited only by the claims and their full scope and equivalents.
Claims (5)
1. The utility model provides a food identification system based on intelligence refrigerator, includes controller and the gesture recognition unit, image recognition unit, the collection unit and the memory cell be connected with the controller, its characterized in that:
the gesture recognition unit is used for judging the gesture of the user for storing and taking food; the image identification unit is used for identifying the type and the number of the food accessed by the user;
the acquisition unit comprises an infrared sensor 1 and an infrared sensor 2 which are respectively arranged on the front frame and the rear frame of the inner wall of the refrigerator door body, a liquid crystal touch screen embedded on the outer wall of the refrigerator door body and a CDD camera arranged on the top of the refrigerator body;
the controller is used for acquiring the real-time posture of the current user from the posture recognition unit, acquiring the type and the number of the food accessed by the user from the image recognition unit, processing the type and the number to obtain the information of the refrigerator food, and displaying the information on the liquid crystal touch screen;
the storage unit is used for storing the state information and the food information of the refrigerator;
the gesture recognition unit and the image recognition unit are in a cooperative mode.
2. The food recognition system based on the intelligent refrigerator as claimed in claim 1, wherein the infrared sensor 1 and the infrared sensor 2 send an electrical signal to the controller when sensing the passing and leaving of the human hand, the controller issues a photographing instruction to the CDD camera, and sends a photographed picture to the image recognition unit for recognition, so as to determine the state of the user for accessing food.
3. The intelligent refrigerator-based food identification system of claim 1, wherein the storage unit comprises a food storage and a sample storage; the sample memory is used for storing food image information set by a user in advance, the controller receives the food image information collected by the image collecting unit in real time, and the collected food information and the pre-stored food sample information are transmitted to the image identifying unit for identification.
4. The intelligent refrigerator-based food identification system of claim 1, wherein the shutter shooting speed of the CCD camera is less than 0.01 second.
5. The intelligent refrigerator-based food identification system of claim 1, wherein the liquid crystal touch screen further comprises a function input key for setting the operating parameters of the refrigerator.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911142323.3A CN111023690A (en) | 2019-11-20 | 2019-11-20 | Food identification system based on intelligent refrigerator |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911142323.3A CN111023690A (en) | 2019-11-20 | 2019-11-20 | Food identification system based on intelligent refrigerator |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111023690A true CN111023690A (en) | 2020-04-17 |
Family
ID=70206238
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911142323.3A Withdrawn CN111023690A (en) | 2019-11-20 | 2019-11-20 | Food identification system based on intelligent refrigerator |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111023690A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111756797A (en) * | 2020-05-11 | 2020-10-09 | 中外运冷链物流有限公司 | Intelligent setting method for refrigeration system of refrigeration house |
| WO2022262234A1 (en) * | 2021-06-18 | 2022-12-22 | 海信集团控股股份有限公司 | Refrigerator and food management method and device thereof |
-
2019
- 2019-11-20 CN CN201911142323.3A patent/CN111023690A/en not_active Withdrawn
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111756797A (en) * | 2020-05-11 | 2020-10-09 | 中外运冷链物流有限公司 | Intelligent setting method for refrigeration system of refrigeration house |
| WO2022262234A1 (en) * | 2021-06-18 | 2022-12-22 | 海信集团控股股份有限公司 | Refrigerator and food management method and device thereof |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103729981B (en) | A kind of child sitting gesture monitoring intelligent terminal | |
| CN106878780A (en) | It is capable of the intelligent TV set and its control system and control method of Intelligent adjustment brightness | |
| CN111023690A (en) | Food identification system based on intelligent refrigerator | |
| CN105094298B (en) | Terminal and the gesture identification method based on the terminal | |
| CN209029110U (en) | Chinese medicine facial diagnosis is health management system arranged | |
| CN104656530A (en) | System and method for monitoring indoor environment of apartment for aged people | |
| CN113465287B (en) | Intelligent refrigerator and illumination intensity adjusting method | |
| CN208704296U (en) | A kind of refrigerator Dynamic Recognition device | |
| CN109114877A (en) | A kind of food management system based on refrigerator Dynamic Recognition | |
| EP3272277A1 (en) | A method and a system for eye tracking | |
| CN107635099A (en) | A kind of double optical-fiber network video cameras of human body sensing and safety defense monitoring system | |
| CN107277344B (en) | Image acquisition system and method and refrigerator | |
| CN107682236A (en) | Smart home interactive system and method based on computer picture recognition | |
| WO2015131556A1 (en) | Power control method for display device and display device | |
| CN113139402B (en) | A kind of refrigerator | |
| CN106547354B (en) | It is a kind of for controlling the gesture method of calibration and device of air-conditioning | |
| CN108895756B (en) | Method and apparatus for displaying caloric value of food for refrigerator | |
| CN114509953A (en) | Device control method, computer program product, control device, and storage medium | |
| CN106778901A (en) | Indoor article loses reminding method and device | |
| CN113091390B (en) | A kind of refrigerator | |
| CN104063041B (en) | A kind of information processing method and electronic equipment | |
| CN111583480A (en) | Access control face recognition device and access control system | |
| CN110659594A (en) | Thermal comfort attitude estimation method based on AlphaPose | |
| CN106205027A (en) | A kind of domestic safety prevention system based on GSM | |
| CN212481823U (en) | Intelligent cooling and heating cabinet |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20200417 |
|
| WW01 | Invention patent application withdrawn after publication |