CN103604273A - Method of intelligent refrigerator food management - Google Patents

Method of intelligent refrigerator food management Download PDF

Info

Publication number
CN103604273A
CN103604273A CN201310568186.6A CN201310568186A CN103604273A CN 103604273 A CN103604273 A CN 103604273A CN 201310568186 A CN201310568186 A CN 201310568186A CN 103604273 A CN103604273 A CN 103604273A
Authority
CN
China
Prior art keywords
intelligent refrigerator
food
data
background server
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201310568186.6A
Other languages
Chinese (zh)
Other versions
CN103604273B (en
Inventor
刘柏良
熊传鹏
唐尧
刘桥
郑伟
吕钊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sichuan Changhong Electric Co Ltd
Original Assignee
Sichuan Changhong Electric Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sichuan Changhong Electric Co Ltd filed Critical Sichuan Changhong Electric Co Ltd
Priority to CN201310568186.6A priority Critical patent/CN103604273B/en
Publication of CN103604273A publication Critical patent/CN103604273A/en
Application granted granted Critical
Publication of CN103604273B publication Critical patent/CN103604273B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Cold Air Circulating Systems And Constructional Details In Refrigerators (AREA)

Abstract

The invention relates to a method of intelligent refrigerator food management. The method includes: a, acquiring food image inside the refrigerator after the intelligent refrigerator is closed; b, judging whether to update the food image to back stage servers, if not, go to Step c, and if yes, go to Step e; c, performing image identification on the food image of the intelligent refrigerator and displaying food names; d, storing data acquired in Step c and performing data synchronism with the data in the back stage intelligent refrigerator; e, updating food image to the back stage server to identify images to enable the back stage server to respond the identified food names to the intelligent refrigerator to display; f, storing data in Step e by the back stage server to enable the data in the intelligent refrigerator and the back stage server synchronized. With the method, users can check food in the intelligent refrigerator without manual operation, management of food in the intelligent refrigerator is facilitated for users and interaction, experience and practicability of users are effectively increased.

Description

The method of intelligent refrigerator food control
Technical field
The present invention relates to the method for intelligent refrigerator food control.
Background technology
Along with the development of computer technology and information technology, image recognition technology has obtained application more and more widely.Such as the satellite cloud picture identification in the analysis of various medical pictures in medical diagnosis and identification, weather forecast, fingerprint recognition, face recognition etc., image recognition technology is penetrated in our daily life more and more.The connotation of image recognition technology is very wide, mainly refers to, by computer or other software platform, adopt mathematical technique method, and the image that a system front end is obtained is processed accordingly according to specific purpose.Image recognition comprises such as the dynamic object identification in living things feature recognition (recognition of face, fingerprint recognition etc.) technology, intelligent transportation, handwriting recognition etc.Along with the development of computer technology and artificial intelligence technology, image recognition technology more and more becomes the basic technology of artificial intelligence, and the technical field that it relates to is also more and more extensive, applies more and more deep.
Meanwhile, the intelligentized tide of household electrical appliances, has expedited the emergence of the generation of intelligent refrigerator.Intelligent refrigerator is all upgraded and reforms hardware technology and software engineering.How effectively carrying out food control in refrigerator is the Core Feature of intelligent refrigerator, is also the problem that user pays special attention to.In the food control research process of intelligent refrigerator, intelligent refrigerator has had that multi-cam is taken pictures, the long-range functions such as carrying out food control of checking, has been equipped with in addition RFID(radio electronic label), the mode such as touch operation carries out the functions such as food interpolation, food deletion.Although these equipment and function have solved the subproblem of intelligent refrigerator food control, but still fundamentally do not solve the problem of food control complex operation in refrigerator, still need user, by manual operation, food warehouse-in, outbound in refrigerator are completed to food control.
Summary of the invention
The invention provides a kind of method of intelligent refrigerator food control, user does not need manual operation to check the food in refrigerator, the convenient management to food in refrigerator.
The method of intelligent refrigerator food control of the present invention, comprising:
A. intelligent refrigerator closes behind the door, by being located at the food image in the camera collection casing in intelligent refrigerator;
B. the treatment facility of intelligent refrigerator is according to the unimpeded situation of network between the loading condition of intelligent refrigerator system and intelligent refrigerator and background server, judge whether the food image uploading collecting to background server, if do not upload execution step c, if upload execution step e;
C. the embedded software by intelligent refrigerator carries out image recognition and contrast to described food image, then exports and show the title of various food in food image;
D. the data that step c obtained are stored in the memory of intelligent refrigerator, and these data are upgraded to the data in background server by network, make the data in intelligent refrigerator and background server synchronous;
E. described food image is uploaded in background server and carried out image recognition and contrast by network, by background server, identify the various food in food image, and described food name is shown in intelligent refrigerator by network-feedback;
F. the data that background server obtains step e are stored, and upgrade the data in intelligent refrigerator by network, make the data in intelligent refrigerator and background server synchronous.
Intelligent refrigerator this locality and background server can carry out the identification of food image, and the function of image recognition can realize by current existing image recognition software.When the processor load of intelligent refrigerator is excessive or memory consumption is too much, the food image uploading of collection is identified and processed in background server, to alleviate the load of intelligent refrigerator, otherwise in this locality, process.To in the intelligent refrigerator finally obtaining, carry out synchronously with the food name of background server, can be used as on the one hand backup and use, also can carry out some function treatment such as vegetable recommendation, dietary recommendation for the long-term food feature of different user and hobby on the other hand.Certainly, these are processed because need a large amount of system resource and network data, therefore normally in background server, complete.
Preferably, in intelligent refrigerator, be provided with at least two cameras, more camera can gather the food image in intelligent refrigerator from different angles, thereby reduces dead angle, and can the clearer video image that photographs of multi-angle, reduce the error of image recognition.
Further, described camera is connected with intelligent refrigerator by USB interface, facilitates installation and maintenance.
Concrete, described background server consists of the data server being connected and processing server group.The server of difference in functionality is separated physically, rather than be integrated on a station server, can reduce the load of individual server, be also convenient to for different problems, server be safeguarded simultaneously.
Preferably, described processing server group is distributed structure/architecture.Distributed system is on the server node that is stored in many platform independent that data are disperseed, all server nodes connect into as a whole by network, for client, with just the same in the face of single server, but in fact the difference in functionality of a process flow operation is to complete on different server nodes.Distributed framework has not only solved the bottleneck problem of single storage server in traditional centralised storage system, has also improved reliability, availability and the autgmentability of system.
Preferably, when intelligent refrigerator is closed the door, and after the duration of delay adjustments (as 5 minutes), then carry out described food IMAQ.Because turning a refrigerator off as user may be once-through operation, may be also Temporarily Closed once.Therefore when closing refrigerator door and wait for after certain hour, just think in stable state, can carry out food IMAQ.
On this basis, in order to allow each user's the intelligent refrigerator can be associated smoothly with background server, and prevent the mistake that may occur in transfer of data, preferred, after intelligent refrigerator is first registered in background server, then carry out the food IMAQ described in step a.By registration, by intelligent refrigerator with background server is man-to-man is associated together, carry out transfer of data and synchronous.
The method of intelligent refrigerator food control of the present invention, can allow user can check the food in refrigerator when not needing manual operation, obviously facilitated the management of user to food in refrigerator, and can carry out more function application and processing according to synchronous food data, effectively promoted interactivity, experience sense and practicality that user uses.
Below in conjunction with the specific embodiment of embodiment, foregoing of the present invention is described in further detail again.But this should be interpreted as to the scope of the above-mentioned theme of the present invention only limits to following example.Without departing from the idea case in the present invention described above, various replacements or the change according to ordinary skill knowledge and customary means, made, all should comprise within the scope of the invention.
Accompanying drawing explanation
Fig. 1 is the block diagram of the method for intelligent refrigerator food control of the present invention.
The specific embodiment
The method of intelligent refrigerator food control of the present invention as shown in Figure 1, comprising:
A. first by intelligent refrigerator type registration in background server, intelligent refrigerator and background server are carried out man-to-man associated.In the casing of intelligent refrigerator, be provided with a plurality of cameras that connect by USB interface.When intelligent refrigerator closes time delay behind the door 5 minutes, by the food image in described a plurality of camera collection casings.Background server consists of the data server being connected and processing server group, and wherein processing server group is distributed structure/architecture.Data server is responsible for the storage to various data, and processing server group is responsible for the processing of data, analysis and judgement;
B. the treatment facility of intelligent refrigerator is according to the unimpeded situation of network between the loading condition of intelligent refrigerator system and intelligent refrigerator and background server, judge whether the food image uploading collecting to background server, if do not upload execution step c, if upload execution step e;
C. the embedded software by intelligent refrigerator carries out image recognition and contrast to described food image, then exports and show the title of various food in food image;
D. the data that step c obtained are stored in the memory of intelligent refrigerator, and these data are upgraded to the data in the data server of background server by network, make the data in intelligent refrigerator and background server synchronous;
E. described food image is uploaded in the data server of background server by network, and carry out image recognition and contrast by processing server group, identify the various food in food image, and described food name is shown in intelligent refrigerator by network-feedback;
F. the data that background server obtains step e store in data server, and upgrade the data in intelligent refrigerator by network, make the data in intelligent refrigerator and background server synchronous.

Claims (7)

1. the method for intelligent refrigerator food control, its feature comprises:
A. intelligent refrigerator closes behind the door, by being located at the food image in the camera collection casing in intelligent refrigerator;
B. the treatment facility of intelligent refrigerator is according to the unimpeded situation of network between the loading condition of intelligent refrigerator system and intelligent refrigerator and background server, judge whether the food image uploading collecting to background server, if do not upload execution step c, if upload execution step e;
C. the embedded software by intelligent refrigerator carries out image recognition and contrast to described food image, then exports and show the title of various food in food image;
D. the data that step c obtained are stored in the memory of intelligent refrigerator, and these data are upgraded to the data in background server by network, make the data in intelligent refrigerator and background server synchronous;
E. described food image is uploaded in background server and carried out image recognition and contrast by network, by background server, identify the various food in food image, and described food name is shown in intelligent refrigerator by network-feedback;
F. the data that background server obtains step e are stored, and upgrade the data in intelligent refrigerator by network, make the data in intelligent refrigerator and background server synchronous.
2. the method for intelligent refrigerator food control as claimed in claim 1, is characterized by: in intelligent refrigerator, be provided with at least two cameras.
3. the method for intelligent refrigerator food control as claimed in claim 2, is characterized by: described camera is connected with intelligent refrigerator by USB interface.
4. the method for intelligent refrigerator food control as claimed in claim 1, is characterized by: described background server consists of the data server being connected and processing server group.
5. the method for intelligent refrigerator food control as claimed in claim 4, is characterized by: described processing server group is distributed structure/architecture.
6. the method for intelligent refrigerator food control as claimed in claim 1, is characterized by: when intelligent refrigerator is closed the door, and after the duration of delay adjustments, then carry out described food IMAQ.
7. the method for the intelligent refrigerator food control as described in one of claim 1 to 6, is characterized by: after intelligent refrigerator is first registered in background server, then carry out the food IMAQ described in step a.
CN201310568186.6A 2013-11-13 2013-11-13 The method of intelligent refrigerator food control Active CN103604273B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310568186.6A CN103604273B (en) 2013-11-13 2013-11-13 The method of intelligent refrigerator food control

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310568186.6A CN103604273B (en) 2013-11-13 2013-11-13 The method of intelligent refrigerator food control

Publications (2)

Publication Number Publication Date
CN103604273A true CN103604273A (en) 2014-02-26
CN103604273B CN103604273B (en) 2016-01-20

Family

ID=50122519

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310568186.6A Active CN103604273B (en) 2013-11-13 2013-11-13 The method of intelligent refrigerator food control

Country Status (1)

Country Link
CN (1) CN103604273B (en)

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104197632A (en) * 2014-09-19 2014-12-10 合肥美的电冰箱有限公司 Intelligent temperature regulating refrigerator
CN104457133A (en) * 2014-11-28 2015-03-25 合肥华凌股份有限公司 Food managing method and food managing system
CN104896868A (en) * 2015-06-18 2015-09-09 合肥美菱股份有限公司 Method for identifying and managing refrigerator food list according to remote images
CN105117450A (en) * 2015-08-17 2015-12-02 四川长虹电器股份有限公司 Intelligent food recommending refrigerator and method
CN105184231A (en) * 2015-08-14 2015-12-23 北京京东尚科信息技术有限公司 Image acquisition system and method of storage space
CN105338243A (en) * 2015-10-27 2016-02-17 合肥华凌股份有限公司 Refrigerator interior environment image acquisition control method and device
CN105953520A (en) * 2016-05-06 2016-09-21 青岛海尔股份有限公司 Intelligent refrigerator control method and system
CN106091568A (en) * 2016-06-29 2016-11-09 合肥华凌股份有限公司 A kind of intelligent refrigerator food control method based on parallel multithread, system and intelligent refrigerator
WO2017190517A1 (en) * 2016-05-06 2017-11-09 青岛海尔股份有限公司 Refrigerator and partition control method and partition control device for compartments of same
CN107786398A (en) * 2016-08-31 2018-03-09 阿里巴巴集团控股有限公司 Data interactive method and device, and intelligent terminal, operating system, intelligent refrigerator
CN107798277A (en) * 2016-09-05 2018-03-13 合肥美的智能科技有限公司 Food materials identifying system and method, food materials model training method, refrigerator and server
CN107886028A (en) * 2016-09-29 2018-04-06 九阳股份有限公司 The food materials input method and food materials input device of a kind of refrigerator
CN107968817A (en) * 2017-11-13 2018-04-27 福州瑞芯微电子股份有限公司 A kind of conventional equipment and artificial intelligence equipment exchange method and system
CN109425191A (en) * 2017-08-24 2019-03-05 合肥美的智能科技有限公司 Intelligent refrigerator and intelligent refrigerator system
CN112912940A (en) * 2019-10-04 2021-06-04 Ism机电工业及贸易股份公司 Intelligent small refrigerator system and method thereof
US11506448B2 (en) 2018-11-14 2022-11-22 Samsung Electronics Co.. Ltd. Method and device for managing food in refrigerator

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040243347A1 (en) * 1995-04-17 2004-12-02 Lehman Michael G. Time and work tracker for servers
US20060283944A1 (en) * 2005-06-18 2006-12-21 Charles Holley Spec-trac
CN101403559A (en) * 2008-10-30 2009-04-08 中山大学 Humanized digital household refrigerator control system
JP2011203932A (en) * 2010-03-25 2011-10-13 Hitachi Information Systems Ltd Food material management and order system
CN102833340A (en) * 2012-08-31 2012-12-19 澳柯玛股份有限公司 Intelligent internet of things platform based on cloud server
US20130018843A1 (en) * 2011-07-14 2013-01-17 Robert Marten Bultman Storing data following a power outage and without a proper time source
CN102889750A (en) * 2012-10-31 2013-01-23 昆山黄昆纺织机械有限公司 Intelligent refrigerator
CN102981477A (en) * 2012-11-26 2013-03-20 四川长虹电器股份有限公司 Refrigerator interior checking method based on multi-camera switching technology
CN103234323A (en) * 2012-07-27 2013-08-07 博西华电器(江苏)有限公司 Intelligent refrigerator, refrigerator system comprising same and control method thereof

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040243347A1 (en) * 1995-04-17 2004-12-02 Lehman Michael G. Time and work tracker for servers
US20060283944A1 (en) * 2005-06-18 2006-12-21 Charles Holley Spec-trac
CN101403559A (en) * 2008-10-30 2009-04-08 中山大学 Humanized digital household refrigerator control system
JP2011203932A (en) * 2010-03-25 2011-10-13 Hitachi Information Systems Ltd Food material management and order system
US20130018843A1 (en) * 2011-07-14 2013-01-17 Robert Marten Bultman Storing data following a power outage and without a proper time source
CN103234323A (en) * 2012-07-27 2013-08-07 博西华电器(江苏)有限公司 Intelligent refrigerator, refrigerator system comprising same and control method thereof
CN102833340A (en) * 2012-08-31 2012-12-19 澳柯玛股份有限公司 Intelligent internet of things platform based on cloud server
CN102889750A (en) * 2012-10-31 2013-01-23 昆山黄昆纺织机械有限公司 Intelligent refrigerator
CN102981477A (en) * 2012-11-26 2013-03-20 四川长虹电器股份有限公司 Refrigerator interior checking method based on multi-camera switching technology

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104197632A (en) * 2014-09-19 2014-12-10 合肥美的电冰箱有限公司 Intelligent temperature regulating refrigerator
CN104457133A (en) * 2014-11-28 2015-03-25 合肥华凌股份有限公司 Food managing method and food managing system
CN104896868A (en) * 2015-06-18 2015-09-09 合肥美菱股份有限公司 Method for identifying and managing refrigerator food list according to remote images
CN105184231A (en) * 2015-08-14 2015-12-23 北京京东尚科信息技术有限公司 Image acquisition system and method of storage space
CN105117450A (en) * 2015-08-17 2015-12-02 四川长虹电器股份有限公司 Intelligent food recommending refrigerator and method
CN105338243A (en) * 2015-10-27 2016-02-17 合肥华凌股份有限公司 Refrigerator interior environment image acquisition control method and device
CN105953520A (en) * 2016-05-06 2016-09-21 青岛海尔股份有限公司 Intelligent refrigerator control method and system
EP3438577A4 (en) * 2016-05-06 2019-05-08 Qingdao Haier Joint Stock Co., Ltd Intelligent refrigerator and control method and control system thereof
WO2017190518A1 (en) * 2016-05-06 2017-11-09 青岛海尔股份有限公司 Intelligent refrigerator and control method and control system thereof
WO2017190517A1 (en) * 2016-05-06 2017-11-09 青岛海尔股份有限公司 Refrigerator and partition control method and partition control device for compartments of same
WO2018000980A1 (en) * 2016-06-29 2018-01-04 合肥华凌股份有限公司 Parallel multi-thread based food management method and system for intelligent refrigerator, and intelligent refrigerator
CN106091568A (en) * 2016-06-29 2016-11-09 合肥华凌股份有限公司 A kind of intelligent refrigerator food control method based on parallel multithread, system and intelligent refrigerator
CN107786398A (en) * 2016-08-31 2018-03-09 阿里巴巴集团控股有限公司 Data interactive method and device, and intelligent terminal, operating system, intelligent refrigerator
CN107786398B (en) * 2016-08-31 2021-02-23 斑马智行网络(香港)有限公司 Data interaction method and device, intelligent terminal, operating system and intelligent refrigerator
CN107798277A (en) * 2016-09-05 2018-03-13 合肥美的智能科技有限公司 Food materials identifying system and method, food materials model training method, refrigerator and server
CN107886028A (en) * 2016-09-29 2018-04-06 九阳股份有限公司 The food materials input method and food materials input device of a kind of refrigerator
CN109425191A (en) * 2017-08-24 2019-03-05 合肥美的智能科技有限公司 Intelligent refrigerator and intelligent refrigerator system
CN107968817A (en) * 2017-11-13 2018-04-27 福州瑞芯微电子股份有限公司 A kind of conventional equipment and artificial intelligence equipment exchange method and system
US11506448B2 (en) 2018-11-14 2022-11-22 Samsung Electronics Co.. Ltd. Method and device for managing food in refrigerator
CN112912940A (en) * 2019-10-04 2021-06-04 Ism机电工业及贸易股份公司 Intelligent small refrigerator system and method thereof

Also Published As

Publication number Publication date
CN103604273B (en) 2016-01-20

Similar Documents

Publication Publication Date Title
CN103604273B (en) The method of intelligent refrigerator food control
KR102545768B1 (en) Method and apparatus for processing metadata
CN107278369A (en) Method, device and the communication system of people finder
US20160044136A1 (en) Virtual gateway
CN111080968B (en) Linkage control early warning method and system for accidental occurrence of solitary old people
CN106201552A (en) A kind of method for upgrading software, client, server and system
CN104896868A (en) Method for identifying and managing refrigerator food list according to remote images
CN105574910A (en) Electronic Device and Method for Providing Filter in Electronic Device
CN103604271A (en) Intelligent-refrigerator based food recognition method
KR102272108B1 (en) Image processing apparatus and method
CN108073402A (en) Kafka clusters automatic deployment method and device based on linux system
KR101782590B1 (en) Method for Providing and Recommending Related Tag Using Image Analysis
CN107527186B (en) Electronic reading management method and device and terminal equipment
KR20170097980A (en) Method for sharing content group of electronic device and electronic device thereof
CN111435304B (en) Method and device for generating space unit, storage medium and processor
CN102880634A (en) Intelligent face recognition and retrieval method based on cloud
CN105323107A (en) Network interface card information management method and network interface card information management system
CN105471945A (en) Application method of cloud storage in seismic integrated interpretation
CN105323484A (en) Rapidly photographing method and electronic device
CN102752294A (en) Method and system for synchronizing data of multiple terminals on basis of equipment capacity
CN111259839A (en) Target object behavior monitoring method, device, equipment, system and storage medium
CN111007735A (en) Intelligent household equipment linkage method and system based on community license plate recognition
CN110351521A (en) Monitoring method, monitoring device, electronic equipment and medium
CN110659540A (en) Traffic light detection method and device
CN107038090A (en) Selection includes the method and electronic equipment, system, computer program product and computer-readable recording medium of the content of audio-visual data

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant