CN111692830A - Control method of refrigerator and refrigerator adopting control method - Google Patents

Control method of refrigerator and refrigerator adopting control method Download PDF

Info

Publication number
CN111692830A
CN111692830A CN201910187924.XA CN201910187924A CN111692830A CN 111692830 A CN111692830 A CN 111692830A CN 201910187924 A CN201910187924 A CN 201910187924A CN 111692830 A CN111692830 A CN 111692830A
Authority
CN
China
Prior art keywords
refrigerator
control method
food material
storage compartment
camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910187924.XA
Other languages
Chinese (zh)
Inventor
杨帆
王兵
孔令磊
党广明
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qingdao Haier Co Ltd
Qingdao Haier Refrigerator Co Ltd
Original Assignee
Qingdao Haier Co Ltd
Qingdao Haier Refrigerator Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qingdao Haier Co Ltd, Qingdao Haier Refrigerator Co Ltd filed Critical Qingdao Haier Co Ltd
Priority to CN201910187924.XA priority Critical patent/CN111692830A/en
Publication of CN111692830A publication Critical patent/CN111692830A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25DREFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D29/00Arrangement or mounting of control or safety devices
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25DREFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D2500/00Problems to be solved
    • F25D2500/06Stock management

Abstract

The invention provides a control method of a refrigerator and the refrigerator adopting the control method, wherein the refrigerator comprises a refrigerator body, a door body and a control device, wherein a storage chamber is formed in the refrigerator body; the control device is used for controlling the lighting device and the camera to work and is connected to an external server and the mobile terminal. The control method comprises the steps of detecting the door closing action of a door body, controlling a lighting device to be kept open within a set first time period, and shooting the inside of the storage compartment; recognizing after confirming that the picture is successfully collected, and inputting food material information; and generating a food material list, transmitting the food material list to an external server for storage, and acquiring the food material list by a mobile terminal associated to the refrigerator through a network. By adopting the control method and the refrigerator, the shooting and the collection of the pictures are more timely and reliable; the food material list is transmitted to an external server, so that the storage requirement of equipment is reduced, the data safety is ensured, and the information acquisition is facilitated.

Description

Control method of refrigerator and refrigerator adopting control method
Technical Field
The invention relates to the technical field of refrigerators, in particular to a control method of a refrigerator and a refrigerator adopting the control method.
Background
With the continuous development of the internet of things technology and the improvement of the living standard of residents, the traditional refrigerator and the use mode are difficult to meet the requirements of users. In recent years, various manufacturers actively build intelligent home platforms, refrigerators are often the backbone of intelligent kitchens as important components of intelligent home systems, and the structural optimization and the development of intelligent management methods are both paid great attention.
Food management belongs to an important function of a refrigerator, however, food management of an existing refrigerator mostly focuses on storage management of food and simple food expiration reminding, and usually requires manual/voice mode for information input or updating, which is tedious in operation. The market also provides a refrigerator, a built-in camera is used for shooting images, the image recognition technology is combined, the types and the quantity of food materials are conveniently recorded, a user knows the articles stored in the refrigerator, and the intelligent management of the food materials is realized through automatic recognition. However, many problems such as failure of camera shooting, blurred image, wrong information identification and the like still exist, and user experience is affected.
In view of the above, it is necessary to provide a new control method for a refrigerator and a refrigerator adopting the same.
Disclosure of Invention
The invention aims to provide a refrigerator and a control method of the refrigerator, which can accurately acquire pictures in a storage room in time and improve the identification accuracy; and the storage requirement of the equipment can be reduced, the data safety is ensured, the information acquisition is facilitated, and the user experience is improved.
In order to achieve the above object, the present invention provides a method for controlling a refrigerator, the refrigerator including a cabinet having a storage compartment, and a door for opening or closing the storage compartment, the storage compartment having a lighting device and a camera therein, the method mainly including:
detecting the door closing action of a door body, controlling the lighting device to be kept open within a set first time period, and controlling the camera to shoot the interior of the storage compartment within the set first time period;
confirming that the pictures shot by the camera are successfully collected, and then identifying the collected pictures;
inputting food material information;
and generating a food material list corresponding to the refrigerator, transmitting the food material list to an external server for storage, and remotely acquiring the food material list through a mobile terminal associated to the refrigerator.
As a further improvement of the present invention, the number of the cameras is at least two, and at least two cameras transmit signals through the same port; the control method comprises the steps of controlling at least two cameras to shoot in sequence and collecting pictures shot by the cameras.
As a further improvement of the present invention, the control method further comprises judging whether the picture collection is successful;
if so, identifying the acquired picture;
if not, the lighting device is controlled to be kept on within the set second time period, and the camera is controlled to shoot the interior of the storage compartment within the set second time period.
As a further improvement of the invention, the set first time length is set to be 4-8 s.
As a further improvement of the present invention, the food material list includes at least one of a network address of the refrigerator and an apparatus number of the refrigerator.
As a further improvement of the invention, a control panel is arranged on a refrigerator body and/or a door body of the refrigerator, and the control method further comprises the step of automatically lightening the control panel when detecting that the door body is closed;
and controlling the control panel to display a first preset pattern in the picture acquisition process, and displaying the picture and the recognition result after the picture recognition is finished.
As a further improvement of the present invention, it is determined whether the user operates the control panel within a predetermined third time period;
if yes, executing user operation;
if not, the food material information is automatically input.
As a further improvement of the present invention, the control method further includes confirming whether to generate a food material list.
As a further improvement of the present invention, the control method further includes transmitting the acquired picture and the recognition result to the mobile terminal.
The invention also provides a refrigerator adopting the control method, which comprises a box body formed with a storage compartment and a door body used for opening or closing the storage compartment, wherein a lighting device and a camera are arranged in the storage compartment; the refrigerator also comprises a control device, wherein the control device is used for controlling the work of the lighting device and the camera, and the control device is used for connecting an external server and the mobile terminal.
The invention has the beneficial effects that: according to the control method and the refrigerator, the pictures in the storage room are shot in time after the door is closed, and the pictures are identified after the pictures are successfully collected, so that the process is more convenient and reliable, and the identification result is more accurate; the food material list is stored through the external server, the storage requirement of the refrigerator is reduced, data are safer, convenience is brought to a user, the food material list of the corresponding refrigerator is obtained from the external server through the mobile terminal, follow-up purchase is conducted, and user experience is improved.
Drawings
FIG. 1 is a schematic view of a main flow of a control method according to the present invention.
Detailed Description
The present invention will be described in detail below with reference to embodiments shown in the drawings. The present invention is not limited to the embodiment, and structural, methodological, or functional changes made by one of ordinary skill in the art according to the embodiment are included in the scope of the present invention.
The invention provides a refrigerator which comprises a refrigerator body and a door body, wherein the refrigerator body is provided with a storage compartment, the door body is used for opening or closing the storage compartment, and a lighting device and a camera are arranged in the storage compartment. The refrigerator also comprises a control device, wherein the control device is used for controlling the work of the lighting device and the camera and is connected to a set external server and a mobile terminal; the control device is provided with a control panel and a control panel arranged on the box body and/or the door body.
Referring to fig. 1, the control method provided by the present invention mainly includes:
detecting the door closing action of a door body, controlling the lighting device to be kept open within a set first time period, and controlling the camera to shoot the interior of the storage compartment within the set first time period;
confirming that the pictures shot by the camera are successfully collected, and then identifying the collected pictures;
inputting food material information;
and generating a food material list corresponding to the refrigerator, transmitting the food material list to an external server for storage, and remotely acquiring the food material list through a mobile terminal associated to the refrigerator.
The number of the cameras is at least two, and the at least two cameras can be used for shooting pictures in different areas respectively and can also be used for shooting pictures in the same area at different angles. At least two cameras carry out signal transmission through the same port, and the port design requirement of the control panel is reduced. In the process of shooting pictures in the storage compartment, the control method comprises the steps of controlling at least two cameras to shoot in sequence and collecting the pictures shot by the cameras.
In this embodiment, the number of the cameras is two, and through testing, the time required for completing the sequential shooting by the two cameras is about 4s, so that the predetermined first time period is set to 4-8 s. Obviously, the given first duration can be extended or shortened according to the shooting time of the camera. Compared with the traditional refrigerator in which the door body is closed and the lighting device is closed, the invention delays the closing time point of the lighting device after detecting the door closing action of the door body, so as to shoot the interior of the storage compartment in time after the door is closed. Certainly, under the condition of good indoor environment lighting conditions, namely when the refrigerator is opened to carry out taking and placing operations, the lighting device can also be kept closed; and after detecting that the door body is closed, the lighting device is controlled to be opened, so that normal shooting can be carried out after the door body is closed.
The step of confirming that the picture taken by the camera is successfully acquired comprises the following steps: judging whether the picture acquisition is successful;
if yes, automatically identifying the acquired picture;
if not, the lighting device is controlled to be kept on within a set second time length, and the camera is controlled to shoot the interior of the storage compartment within the set second time length, wherein the set second time length is consistent with the set first time length. Of course, if only the pictures of the respective cameras are not successfully collected, the predetermined second time period can be reduced according to actual requirements.
The control method also comprises the step of automatically lightening the control panel when detecting that the door body is closed; and controlling the control panel to display a first preset pattern in the picture acquisition process, and displaying the picture and the recognition result after the picture recognition is finished. In other embodiments of the present invention, the collected images and the recognition results may also be directly transmitted to the mobile terminal, and the subsequent operations are performed on the mobile terminal.
Here, the first preset pattern may be a text, a geometric figure, or a dynamic picture; in the process of identifying the picture, the user can also perform operations such as 'cancelling identification', 'refreshing', and the like, wherein 'refreshing' only refers to re-identifying the picture which is shot and collected.
The control method also comprises the step of judging whether the user operates the control panel within a set third time length after the identification is finished;
if yes, executing user operation;
if not, the food material information is automatically input, and if the set third duration is set to 5s, that is, when no operation of the user is sensed within 5s after the control panel displays the picture and the recognition result, the recognized food material is automatically input and the corresponding food material information is set. At this stage, the interface of the control panel is often provided with option keys such as "one-key entry", "return", and the like, so as to facilitate the user operation.
The control method further comprises confirming whether the food material list is generated. The food material list includes at least one of the food material information, a network address of the refrigerator, and a device number of the refrigerator, and is preferably stored in an external server according to a mac (media Access Control address) address of the refrigerator. The food material information comprises food material names, food material quantities, unit heat, storage time, reminding time and the like, and is arranged and edited according to a set rule when a food material list is generated, if relevant food material information of each food material is separated by a negative value and each food material passes through the negative value; or, separate editing. In practical application, when a user opens an APP installed on a mobile terminal, a corresponding food material list can be obtained through a network.
In conclusion, according to the control method and the refrigerator, the pictures in the storage room are shot in time after the door is closed, and the pictures are identified after the pictures are successfully collected, so that the process is more convenient and reliable, and the identification result is more accurate; the food material list is stored through the external server, the storage requirement of the refrigerator equipment is reduced, data are safer, a user can conveniently obtain the food material list of the corresponding refrigerator from the external server through the mobile terminal, follow-up purchase is conducted, and user experience is improved.
It should be understood that although the present description refers to embodiments, not every embodiment contains only a single technical solution, and such description is for clarity only, and those skilled in the art should make the description as a whole, and the technical solutions in the embodiments can also be combined appropriately to form other embodiments understood by those skilled in the art.
The above-listed detailed description is only a specific description of a possible embodiment of the present invention, and they are not intended to limit the scope of the present invention, and equivalent embodiments or modifications made without departing from the technical spirit of the present invention should be included in the scope of the present invention.

Claims (10)

1. A control method of a refrigerator, the refrigerator comprises a box body formed with a storage compartment and a door body used for opening or closing the storage compartment, a lighting device and a camera are arranged in the storage compartment, and the control method is characterized in that:
detecting the door closing action of a door body, controlling the lighting device to be kept open within a set first time period, and controlling the camera to shoot the interior of the storage compartment within the set first time period;
confirming that the pictures shot by the camera are successfully collected, and then identifying the collected pictures;
inputting food material information;
and generating a food material list corresponding to the refrigerator, transmitting the food material list to an external server for storage, and remotely acquiring the food material list through a mobile terminal associated to the refrigerator.
2. The control method according to claim 1, characterized in that: the cameras are arranged into at least two cameras, and the at least two cameras carry out signal transmission through the same port; the control method comprises the steps of controlling at least two cameras to shoot in sequence and collecting pictures shot by the cameras.
3. The control method according to claim 1, characterized in that: the control method also comprises the steps of judging whether the picture acquisition is successful;
if so, identifying the acquired picture;
if not, the lighting device is controlled to be kept on within the set second time period, and the camera is controlled to shoot the interior of the storage compartment within the set second time period.
4. The control method according to claim 1, characterized in that: the predetermined first time period is set to 4-8 s.
5. The control method according to claim 1, characterized in that: the food material list includes at least one of a network address of the refrigerator and a device number of the refrigerator.
6. The control method according to claim 1, characterized in that: the control method comprises the following steps that a control panel is arranged on a refrigerator body and/or a door body of the refrigerator, and the control panel is automatically lightened when the door body is detected to be closed;
and controlling the control panel to display a first preset pattern in the picture acquisition process, and displaying the picture and the recognition result after the picture recognition is finished.
7. The control method according to claim 6, characterized in that: judging whether the user operates the control panel within a set third time length;
if yes, executing user operation;
if not, the food material information is automatically input.
8. The control method according to claim 1, characterized in that: the control method further comprises confirming whether the food material list is generated.
9. The control method according to claim 1, characterized in that: the control method further comprises the step of transmitting the collected pictures and the recognition results to the mobile terminal.
10. A refrigerator using the control method according to any one of claims 1 to 9, comprising a cabinet formed with a storage compartment, and a door for opening or closing the storage compartment, wherein a lighting device and a camera are provided in the storage compartment, the refrigerator further comprising a control device, characterized in that: the control device is used for controlling the work of the illuminating device and the camera, and the control device is used for connecting an external server and the mobile terminal.
CN201910187924.XA 2019-03-13 2019-03-13 Control method of refrigerator and refrigerator adopting control method Pending CN111692830A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910187924.XA CN111692830A (en) 2019-03-13 2019-03-13 Control method of refrigerator and refrigerator adopting control method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910187924.XA CN111692830A (en) 2019-03-13 2019-03-13 Control method of refrigerator and refrigerator adopting control method

Publications (1)

Publication Number Publication Date
CN111692830A true CN111692830A (en) 2020-09-22

Family

ID=72474882

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910187924.XA Pending CN111692830A (en) 2019-03-13 2019-03-13 Control method of refrigerator and refrigerator adopting control method

Country Status (1)

Country Link
CN (1) CN111692830A (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113606858A (en) * 2021-08-10 2021-11-05 长虹美菱股份有限公司 Refrigerator temperature setting and correction reminding device and control method
CN113915822A (en) * 2021-01-22 2022-01-11 海信(山东)冰箱有限公司 Refrigerator, refrigerator control method, automatic refrigerator replenishment method and system
CN114294886A (en) * 2021-06-23 2022-04-08 海信视像科技股份有限公司 Refrigerator and food material input method
CN114294885A (en) * 2021-06-23 2022-04-08 海信视像科技股份有限公司 Refrigerator and image acquisition method
WO2022267518A1 (en) * 2021-06-23 2022-12-29 海信视像科技股份有限公司 Food storage device

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105258450A (en) * 2015-11-17 2016-01-20 西宁家家慧电子科技有限公司 Intelligent controller of traditional refrigerator
CN105338243A (en) * 2015-10-27 2016-02-17 合肥华凌股份有限公司 Refrigerator interior environment image acquisition control method and device
CN105474618A (en) * 2013-08-28 2016-04-06 株式会社东芝 Imaging system and imaging device
CN205245656U (en) * 2013-03-29 2016-05-18 松下知识产权经营株式会社 Freezer and freezer system
CN106322911A (en) * 2015-06-17 2017-01-11 四川长虹电器股份有限公司 Intelligent refrigerator control method and intelligent refrigerator
CN107197231A (en) * 2017-06-16 2017-09-22 合肥美的智能科技有限公司 Detection method, detecting system and the refrigerator of camera commodity performance
CN107798277A (en) * 2016-09-05 2018-03-13 合肥美的智能科技有限公司 Food materials identifying system and method, food materials model training method, refrigerator and server
CN108224892A (en) * 2017-12-29 2018-06-29 宁波梦居智能科技有限公司 A kind of intelligent refrigerator
JP2019007728A (en) * 2018-08-24 2019-01-17 パナソニックIpマネジメント株式会社 refrigerator

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN205245656U (en) * 2013-03-29 2016-05-18 松下知识产权经营株式会社 Freezer and freezer system
CN105474618A (en) * 2013-08-28 2016-04-06 株式会社东芝 Imaging system and imaging device
CN106322911A (en) * 2015-06-17 2017-01-11 四川长虹电器股份有限公司 Intelligent refrigerator control method and intelligent refrigerator
CN105338243A (en) * 2015-10-27 2016-02-17 合肥华凌股份有限公司 Refrigerator interior environment image acquisition control method and device
CN105258450A (en) * 2015-11-17 2016-01-20 西宁家家慧电子科技有限公司 Intelligent controller of traditional refrigerator
CN107798277A (en) * 2016-09-05 2018-03-13 合肥美的智能科技有限公司 Food materials identifying system and method, food materials model training method, refrigerator and server
CN107197231A (en) * 2017-06-16 2017-09-22 合肥美的智能科技有限公司 Detection method, detecting system and the refrigerator of camera commodity performance
CN108224892A (en) * 2017-12-29 2018-06-29 宁波梦居智能科技有限公司 A kind of intelligent refrigerator
JP2019007728A (en) * 2018-08-24 2019-01-17 パナソニックIpマネジメント株式会社 refrigerator

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113915822A (en) * 2021-01-22 2022-01-11 海信(山东)冰箱有限公司 Refrigerator, refrigerator control method, automatic refrigerator replenishment method and system
CN114294886A (en) * 2021-06-23 2022-04-08 海信视像科技股份有限公司 Refrigerator and food material input method
CN114294885A (en) * 2021-06-23 2022-04-08 海信视像科技股份有限公司 Refrigerator and image acquisition method
WO2022267518A1 (en) * 2021-06-23 2022-12-29 海信视像科技股份有限公司 Food storage device
CN114294886B (en) * 2021-06-23 2023-02-28 海信视像科技股份有限公司 Refrigerator and food material input method
CN114294885B (en) * 2021-06-23 2023-04-07 海信视像科技股份有限公司 Refrigerator and image acquisition method
CN113606858A (en) * 2021-08-10 2021-11-05 长虹美菱股份有限公司 Refrigerator temperature setting and correction reminding device and control method

Similar Documents

Publication Publication Date Title
CN111692830A (en) Control method of refrigerator and refrigerator adopting control method
CN105204357B (en) The contextual model method of adjustment and device of intelligent home device
CN111104341B (en) Automatic testing method, device, equipment and storage medium for intelligent household equipment
CN104089370B (en) Multi-line pairing method and device and multi-line system
US20190079651A1 (en) Control method and apparatus for smart home
CN101409826B (en) Information processing apparatus and remote indication system
CN105282610B (en) The automatic switching method and system of television set
CN110262274A (en) Smart home device control display methods and system based on Internet of Things operating system
CN109256115A (en) A kind of speech detection system and method for intelligent appliance
CN107360157A (en) A kind of user registering method, device and intelligent air conditioner
CN106647305A (en) Control method and terminal
CN110531634B (en) Accommodation management system, method and device and electronic equipment
CN104091201A (en) Article management method based on voice input
CN107292223A (en) A kind of online verification method and system of real-time gesture detection
CN105867151A (en) Intelligent face recognition household door system and working method
CN106775332A (en) Image processing method and picture processing system
CN104754827A (en) Equipment state indicator lamp control method and equipment state indicator lamp control device
CN109901955A (en) A kind of method and system for testing power-on screen state
CN107369446A (en) Handle state prompt method, device and computer-readable recording medium
CN111865735B (en) Intelligent household system and control method
CN109151994A (en) A kind of indoor orientation method and equipment
CN108090424A (en) A kind of online teaching method of investigation and study and equipment
US20210389011A1 (en) Method for Controlling Air Conditioner, Air Conditioner
CN106803890A (en) A kind of Autoconducting method and device
CN112053486A (en) Access control method, device and system and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20200922