WO2018045838A1 - 智能冰箱的食品信息管理方法、设备和计算机可读存储介质 - Google Patents

智能冰箱的食品信息管理方法、设备和计算机可读存储介质 Download PDF

Info

Publication number
WO2018045838A1
WO2018045838A1 PCT/CN2017/094269 CN2017094269W WO2018045838A1 WO 2018045838 A1 WO2018045838 A1 WO 2018045838A1 CN 2017094269 W CN2017094269 W CN 2017094269W WO 2018045838 A1 WO2018045838 A1 WO 2018045838A1
Authority
WO
WIPO (PCT)
Prior art keywords
food
icon
refrigerator
image
information management
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2017/094269
Other languages
English (en)
French (fr)
Inventor
关煜
陈逸风
郑磊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Jingdong Century Trading Co Ltd
Beijing Jingdong Shangke Information Technology Co Ltd
Original Assignee
Beijing Jingdong Century Trading Co Ltd
Beijing Jingdong Shangke Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Jingdong Century Trading Co Ltd, Beijing Jingdong Shangke Information Technology Co Ltd filed Critical Beijing Jingdong Century Trading Co Ltd
Publication of WO2018045838A1 publication Critical patent/WO2018045838A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D29/00—Arrangement or mounting of control or safety devices
    • F25D29/003—Arrangement or mounting of control or safety devices for movable devices
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D29/00—Arrangement or mounting of control or safety devices
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D29/00—Arrangement or mounting of control or safety devices
    • F25D29/005—Mounting of control devices

Definitions

  • the present disclosure relates to the field of smart home appliances, and in particular to a food information management method, device and computer readable storage medium of a smart refrigerator.
  • connection function is only the basic condition for intelligent development, the intelligent functions that can be accepted and recognized by users, and the scene experience that effectively improves the user. A lot of room for improvement.
  • the main function of the traditional refrigerator is food storage, but lacks intelligent management functions for food information.
  • the intelligent refrigerators proposed by the industry are mainly reflected in the network where the home router can be connected, and the refrigerator stores or senses information and interacts with external networks or other devices. Compared with traditional refrigerators. It only adds information interaction function, but it has not changed importantly in other aspects. It is difficult to meet the needs of users to intelligently manage the food information stored in the refrigerator, resulting in low acceptance of the smart refrigerator by users.
  • the food information management method can make the smart refrigerator closer to the user.
  • An aspect of the present disclosure is to address at least the above problems and/or disadvantages and to provide at least the advantages described below.
  • a food information management method of a smart refrigerator which may include: displaying a door box pair indicating a refrigerating compartment area and a refrigerating compartment door area of the smart refrigerator in response to the first user input An image; displaying a mask on the door box image and displaying a food icon of the food stored in the smart refrigerator on the mask; displaying the food management dashboard after the predetermined time period to replace the previously displayed door box image a mask and a food icon, the food management dashboard listing food information of the food stored in the smart refrigerator; and managing the food information in response to the second user input.
  • the door box pair image may be taken by a camera disposed in the smart refrigerator, and the method may further include: determining, by recognizing the door box image, determining to display on the mask a corresponding position of the food icon and the food icon; and arranging the food icon according to the determined corresponding position of the food icon.
  • the method may further include: in response to determining that the user accesses the food in the smart refrigerator, collecting the door box image; sending the door box image to the cloud server; identifying the door via the cloud server The food information in the box image is taken; and the food information is updated according to the recognition result of the cloud server.
  • the food information may include at least one of the following: a food name, a food quantity, a food storage time, and a food location.
  • the food icon may be a food icon added by a user.
  • the method may further include: displaying, on the mask, the storage in the smart refrigerator At the same time as the food icon of the food, a progress bar for counting the number of foods stored in the smart refrigerator is displayed.
  • the predetermined time period may be a loading time of the progress bar.
  • the method may further include: in response to determining that the food is not stored in the smart refrigerator, the food icon is not displayed on the mask.
  • the food management dashboard may include: a food icon area, an expired reminder area, an out-of-stock reminding area, and a tipping area.
  • the method may further include: displaying food-related food information corresponding to the selected food icon when the user selects one of the food icons displayed in the food icon area.
  • an apparatus for food information management includes a processor and a memory.
  • the memory storage machine executable instructions when executed by the processor, cause the processor to perform any of the methods described above.
  • a computer readable storage medium having stored thereon executable instructions that, when executed by a processor, cause a processor to perform any of the methods described above.
  • the present disclosure provides a food information management method, apparatus, and computer readable storage medium for a smart refrigerator, which can make the smart refrigerator closer to the user, change the single ice-cold connection between the device and the device, and satisfy the user.
  • the application scenarios of the refrigerator food information management are needed.
  • FIG. 1a and 1b show front views of a structure of a smart refrigerator according to an exemplary embodiment of the present invention. And side view;
  • FIG. 2 is a flowchart showing a food information management method of a smart refrigerator according to an exemplary embodiment of the present invention
  • 3 to 6b show schematic views of a food information management application using a food information management method according to an exemplary embodiment of the present invention.
  • the invention provides a food information management method for a smart refrigerator, which can make the smart refrigerator closer to the user, change the single ice-cold connection between the device and the device, and meet the needs of the user for the application information of the food information management of the refrigerator.
  • FIG. 1a and 1b show front and side views of the structure of a smart refrigerator in accordance with an exemplary embodiment of the present invention.
  • a storage space of a refrigerator cabinet body 10 (which may also be referred to as a refrigerator compartment area) of a refrigerator includes a first compartment space 101, a second compartment space 102, and a The three compartment spaces 103 and the fourth compartment spaces 104 may have more or less compartment spaces, and are not limited in the present invention.
  • the structure of the smart refrigerator of the present invention is described below by taking the refrigerator cabinet body of the refrigerator into three compartment spaces as an example.
  • the camera group includes the first camera 1, the second camera 2, and the third camera 3.
  • the first camera 1 is disposed at a position on the left inner side wall of the first compartment space 101 near the top and near the outer opening for acquiring the first compartment space 101.
  • a storage image that is, a storage area whose imaging direction faces the first compartment space 101;
  • the second camera 2 is disposed in the second compartment space 102
  • the left inner side wall is located near the top and close to the outer opening for acquiring a storage image of the second compartment space 102, that is, a storage area thereof facing the storage area of the second compartment space 102;
  • the third camera 3 is disposed In a position where the left inner side wall of the third compartment space 103 is near the top and close to the outer opening, the storage image for acquiring the third compartment space 103, that is, the storage direction thereof toward the third compartment space 103 is stored.
  • the fourth camera 4 is preferably disposed in the refrigerator cabinet body 10 adjacent to the first compartment space 101 or the second compartment space 102 and close to the outer opening for acquiring the refrigerator door (also referred to as refrigerating) a storage image of the inner space of the inside of the door region) 20, that is, when the refrigerator door 20 forms a predetermined opening angle with respect to the refrigerator body 10, the shooting angle of the fourth camera 4 is aligned with the storage area inside the refrigerator door 20;
  • the camera 5 is preferably disposed on the inner side of the refrigerator door body 20 (more preferably, disposed on the inner top pocket of the inner side) for obtaining an overall storage image including three compartment spaces in the refrigerator cabinet body, that is, when Refrigerator door 20 is relatively cold
  • the imaging direction of the fifth camera 5 faces the storage area of the entire compartment space of the refrigerator.
  • a corresponding image may be collected by the first camera 1 and may be passed through the second when the storage state of the second compartment space 102 changes.
  • the camera 2 collects corresponding images.
  • the corresponding image can be collected by the third camera 3, and the storage state of any compartment space can also pass the fifth.
  • the camera 5 obtains an image of the overall compartment space such that a corresponding image of the change in the storage state is obtained both microscopically and macroscopically.
  • the image recognition system at the end recognizes the storage information inside the refrigerator door 20.
  • the fourth camera 4 and the fifth camera 5 may be configured to simultaneously operate when the refrigerator door 20 forms a predetermined angle with respect to the refrigerator cabinet 10, which helps to improve the consistency and accuracy of the overall image collection. And get as much image information as possible with as few cameras as possible.
  • the mounting heights of the fourth camera 4 and the fifth camera 5 may be substantially identical.
  • the refrigerator may further include a sensor group and a main control device, and the sensor group may include a hand detection sensor (such as an infrared sensor). ), angle sensor, refrigerator door switch state detecting device (the device can directly utilize the existing switch door detecting device of the refrigerator), wherein the hand detecting sensor is used for detecting whether the user's hand extends into the compartment space, in an embodiment
  • the hand sensor may be disposed at a position 6 as shown in FIGS. 1a and 1b, and the angle sensor may be disposed on a rotating shaft of the refrigerator door for detecting an opening angle of the refrigerator door box to the refrigerator.
  • the main control device may include the following operations: identifying the current corresponding state of the refrigerator; controlling the action of the camera, performing image acquisition and storage; implementing network transmission, etc., and may also include the following functions: displaying the information according to the feedback information of the cloud image recognition system in a graphical interface
  • the storage state in the refrigerator storage space provides users with voice control and provides users with alarms, prompt reminders and other functions.
  • the entire main control device can be powered by the refrigerator power supply unit, and various corresponding status information of the sensor group is transmitted to the main control device in real time.
  • the refrigerator is opened, and the main control device is obtained. Knowing that the refrigerator door is open and knowing the opening direction (closing direction) and angle of the refrigerator door, the user puts the apple into the first compartment space 101, and the main control device also knows this state, after the user places the apple, the main control The device controls the first camera 1 to operate, and obtains a storage image of the first compartment space 101.
  • the main control device controls the fourth camera 4 and the fifth camera 5 to simultaneously operate.
  • a storage image of the entire space of the refrigerator body 10 and a storage image of the entire space inside the refrigerator door 20 are obtained.
  • the master device also collects images obtained by the respective cameras and stores them in a predetermined format (eg, jpeg format).
  • a predetermined format eg, jpeg format
  • the master device will Three images obtained in one cycle (from the time when the refrigerator door is opened to the time when the refrigerator door is closed) (the microscopic image of the first compartment space 101, the overall image of the refrigerator body 10, and the overall image of the inside of the refrigerator door 20) are transmitted.
  • the cloud image recognition system obtains the storage state of the first compartment space 101 and the storage state inside the refrigerator door 20 based on the images.
  • the working condition of the main control device is similar to the above. If there are multiple compartment spaces involved in the pick and place operation, the number of images obtained is correspondingly increased. In addition, if the user opens the refrigerator, the food is not taken in the refrigerator body 10, but only the inside of the refrigerator door 20 is taken and removed. At this time, the main control device does not control the microscopic image of the corresponding camera to obtain the space of the compartment.
  • the image in the whole cycle is a storage image of two whole spaces; if the user only opens a small angle (presettable), and does not perform the pick and place action in the refrigerator body 10 nor on the inside of the refrigerator door 20
  • the pick and place action in this case, usually the situation where the user manually checks the internal state of the refrigerator, at this time, it is not necessary to acquire any storage image in the entire cycle.
  • the cloud image recognition system can process in time to obtain the storage state information of the corresponding compartment space and the inner position of the refrigerator door 20.
  • the first compartment space 101 can be obtained.
  • the cloud The image recognition system feeds back the identified information to the main control device, and the main control device presents the information to the user in a graphical manner through its display module, and can prompt the user to use up in time according to the shelf life of the corresponding category.
  • the information processed by the cloud image recognition system can also be sent to the user's terminal, so that the user can know the relevant state in the refrigerator in time and get relevant reminders; in addition, the cloud image recognition system can also forward the obtained image directly to the user.
  • the terminal so that the user terminal can also view the storage state in the refrigerator more intuitively, and this can provide effective assistance when the image recognition system is difficult to effectively recognize certain images.
  • FIG. 2 depicts a flow chart of a food information management method of a smart refrigerator according to an exemplary embodiment of the present invention.
  • the method includes, in response to the first user input, displaying a door bin pair image representing the refrigerating compartment area and the refrigerating compartment door area of the smart refrigerator in step S210.
  • the door box-to-beat image may be taken by a camera disposed within the smart refrigerator.
  • the method further comprises: in response to determining that the user accesses the food item in the smart refrigerator, collecting the door box pair image. For example, when the sensor as shown in conjunction with FIGS. 1a and 1b senses that the user accesses the food in the smart refrigerator, the camera disposed in the smart refrigerator is controlled to collect the door box-to-beat image.
  • a mask is displayed on the door box image, and a food icon of the food stored in the smart refrigerator is displayed on the mask.
  • the corresponding position of the food icon and the food icon displayed on the mask is determined by identifying the door box image, and the food is arranged according to the determined corresponding position of the food icon icon.
  • the captured door box image can be sent to the cloud server, and then through the cloud server.
  • the food information in the door box image is identified, wherein the food information includes at least one of the following: a food name, a food quantity, a food storage time, and a food location.
  • the cloud server may further update the food information stored in the memory according to the recognition result.
  • the food icon may also be a food icon manually added by the user.
  • a progress bar for counting the number of food items stored in the smart refrigerator while displaying the food icon of the food stored in the smart refrigerator on the mask.
  • the loading state of the progress bar may indicate the progress of counting the number of food categories. That is to say, when the statistics on the number of food types stored in the smart refrigerator are started, the progress bar is started to be loaded, and when the statistics on the number of food types stored in the smart refrigerator are completed, the loading progress bar is completed.
  • the progress bar can be circular and within the circular progress bar, the number of food items currently counted is displayed. If there is no identifiable food in the smart refrigerator and there is no manually added food, no food icon is displayed on the mask.
  • the food management dashboard is displayed after the predetermined time period to replace the previously displayed door box image, mask and food icon, the food management dashboard listing the food stored in the smart refrigerator Food information.
  • the predetermined time may be a time specified by a user.
  • the predetermined time is the time required to identify the food information in the door box image, that is, in the presence of a progress bar, the predetermined time is the loading time of the progress bar.
  • the food management dashboard includes one or more areas, such as a food icon area, an expired reminder area, an out-of-stock reminder area, and a tip area.
  • the food icon area displays the food icon of the food stored in the smart refrigerator
  • the expired reminder area displays a reminder for the fast expired food
  • the out of stock reminder area displays a reminder for the out of stock food
  • the tip area displays other food related items. information. It should be noted that the above merely exemplarily describes the composition of a food management dashboard that may include more or fewer areas.
  • step S240 the food information is managed in response to the second user input. Specifically, when the user selects one of the food icons displayed in the food icon area, the food-related food information corresponding to the selected food icon is displayed to manage the food information.
  • the management includes operations such as editing, deleting, and adding.
  • 3 to 6b depict schematic views of a food information management application using a food information management method according to an exemplary embodiment of the present invention.
  • FIG. 3 shows a user interface displayed when the food information management application according to an exemplary embodiment of the present invention is used for the first time.
  • the user interface includes four shortcut entries 1, from left to right: message board, system settings, scan code shopping, shopping cart.
  • the user interface comprises a "My Food” message board 2, wherein the information board 2 comprises: an "Enter” button 3, in response to a click on the button, enters "My Food”; current food 4 Displaying the type of food that has been currently counted (including the identified, entered food); identifiable or recordable food information 5, in this embodiment, since no identifiable or recordable food information is found, it is not displayed Any food information; Tips Area 6, which shows food tips or refrigerator tips, because there is no food in the refrigerator in this example, so first show the refrigerator tips; and out of stock reminder area 7, in the In the example, the out of stock reminder area includes an egg out of stock reminder area and a milk out of stock reminder area.
  • the user interface may further include a shopping portal 8 whose content on the homepage is an advertisement map provided by the operation.
  • the user interface may further include a refrigerator setting page inlet 9, wherein the refrigerator setting page inlet 9 may display air cleanliness in the refrigerator and a sterilization deodorizing key 10 for performing a sterilization and deodorizing function.
  • the user page The facet may also include a shortcut shopping bar 11, the first three items in the shortcut shopping bar are operational presets, and the quick shopping bar 11 further includes a quick purchase settings page entry 12.
  • the user can click the "Enter” button in the upper right corner of the "My Food” information panel from the home page, or enter any of the other food areas of the information board, that is, receive the first user input.
  • animation is a preferred embodiment. First, a door box facing image indicating the refrigerating compartment area of the refrigerator and the refrigerating compartment door area is displayed. Next, a layer of translucent black mask is overlaid on the door box image, and the food icon recognized or entered is displayed on the mask.
  • the door box pair image is first displayed to let the user know that the icon displayed later comes from the recognition of the real door box to the photo content. Then, the mask is quickly displayed on the door box image, and the food icons corresponding to all the identified foods or foods manually entered by the user are " ⁇ , ⁇ , ⁇ " within two seconds. Displayed in order. Alternatively, the location of the food icon may or may not correspond to the actual location. In one embodiment, as shown in Figure 4b, as the right food icons appear in sequence, the circular progress bar on the left side will also grow clockwise accordingly. At the same time, the number of species in the ring will increase accordingly, reflecting the true situation of the number of foods that have been counted.
  • Fig. 5a shows the user interface in the case where the identifiable food or the food manually entered by the user is stored in the smart refrigerator
  • Fig. 5b shows that there is no identifiable food or food manually entered by the user in the smart refrigerator.
  • the user interface in the case. That is to say, in the case where there is neither identifiable food nor manually added food in the user's refrigerator, as shown in FIG. 5b, first, when the animation plays "oh call", the refrigerator compartment area of the refrigerator is displayed. And the image of the door box facing the indicated area in the refrigerating compartment door, and then overlaying a layer of translucent black on the image of the door box A mask is provided to let the user know that the icon displayed afterwards comes from the recognition of the photo content of the real door box. Since no food is recognized or manually entered at this time, no food icons will appear. The whole process is one second. The circular progress bar on the left side will also grow clockwise, but the number in the ring will remain at zero.
  • FIG. 6b shows the user interface after the food management dashboard completely replaces the previously displayed door bin image, mask and food icon.
  • the food management dashboard includes a food icon area, an expired reminder area, an out-of-stock reminder area, and a tip area.
  • the present invention provides a food information management method for a smart refrigerator, which can expand the intelligent life application of the smart refrigerator, and make the interaction between the user and the smart refrigerator more convenient, humanized and intelligent, thereby improving the user's The experience on the smart refrigerator.
  • the foregoing method can be implemented in a form of executable program commands by a plurality of computer devices and recorded in a computer readable recording medium.
  • the computer readable recording medium may include a separate program command, a data file, a data structure, or a combination thereof.
  • program commands recorded in the recording medium can be specifically designed or configured for use in the present invention, or are known to those skilled in the art of computer software.
  • the computer readable recording medium includes, for example, a hard disk, a floppy disk or a magnetic tape
  • An optical medium such as an optical medium such as a compact disc read only memory (CD-ROM) or a digital versatile disc (DVD), a magneto-optical medium such as a magneto-optical floppy disk, and a hardware device such as a ROM, a RAM, a flash memory, etc. that store and execute program commands.
  • the program commands include machine language code formed by the compiler and a high-level language that the computer can execute by using the interpreter.
  • the foregoing hardware device may be configured to operate as at least one software module to perform the operations of the present invention, and the reverse operation is also the same.

Landscapes

  • Engineering & Computer Science (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Physics & Mathematics (AREA)
  • Mechanical Engineering (AREA)
  • Thermal Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Cold Air Circulating Systems And Constructional Details In Refrigerators (AREA)

Abstract

一种智能冰箱的食品信息管理方法，包括：响应于第一用户输入，显示对智能冰箱的冷藏室区域和冷藏室门区域加以表示的门箱对拍图像；在门箱对拍图像上显示蒙板，并在蒙板上显示智能冰箱中存放的食品的食品图标；在预定时段之后显示食品管理仪表盘来取代先前显示的门箱对拍图像、蒙板和食品图标，所述食品管理仪表盘列出了智能冰箱中存放的食品的食品信息；以及响应于第二用户输入，对食品信息进行管理。

Description

智能冰箱的食品信息管理方法、设备和计算机可读存储介质 技术领域
本公开涉及智能家电领域，具体地，涉及一种智能冰箱的食品信息管理方法、设备和计算机可读存储介质。
背景技术
随着物联网技术和智能家居的迅猛发展，万物互联是大势所趋。近年来，尽管很多家用设备通过增加通讯模块从而能够接入到互联网中，但是连接功能仅仅是智能发展的基础性条件，距离能够被用户接受和认可的智能功能以及有效提高用户的场景体验还有很多提升空间。
传统冰箱主要功能是食品存储，但是缺乏对食品信息的智能管理功能。在物联网的大环境下，目前业界提出的智能冰箱，智能功能主要体现在能够接入家庭路由器所在的网络，实现冰箱存储或感知信息并与外网或其他设备的交互，与传统冰箱相比仅仅是增加了信息交互功能，但在其他方面并未起到重要变化，难以满足用户对存储在冰箱中的食品信息进行智能管理需要，导致用户对于智能冰箱的接受度不高。
因此，为了使智能冰箱更加贴近用户，改变设备与设备，设备与人之间的单一冰冷联接，满足用户对冰箱食品信息管理的应用场景需要，使得智能冰箱更加贴近用户，需要提出一种智能冰箱的食品信息管理方法，能够使智能冰箱更加贴近用户。
发明内容
本公开的方面在于解决至少上述问题和/或缺点并提供至少下述优点。
根据本公开的示例实施例，提供了一种智能冰箱的食品信息管理方法，可以包括：响应于第一用户输入，显示对智能冰箱的冷藏室区域和冷藏室门区域加以表示的门箱对拍图像；在门箱对拍图像上显示蒙板，并在蒙板上显示所述智能冰箱中存放的食品的食品图标；在预定时段之后显示食品管理仪表盘来取代先前显示的门箱对拍图像、蒙板和食品图标，所述食品管理仪表盘列出了所述智能冰箱中存放的食品的食品信息；以及响应于第二用户输入，对食品信息进行管理。
可选地，所述门箱对拍图像可以是由布置在智能冰箱内的摄像机拍摄的，且所述方法还可以包括：通过对所述门箱对拍图像进行识别，确定在蒙板上显示的食品图标和食品图标的对应位置；并根据所确定的食品图标的对应位置，布置所述食品图标。
可选地，所述方法还可以包括：响应于确定用户在智能冰箱中存取食品，采集门箱对拍图像；将所述门箱对拍图像发送给云端服务器；经由云端服务器识别所述门箱对拍图像中的食品信息；以及根据云端服务器的识别结果，更新食品信息。
可选地，所述食品信息可以包括以下至少一项：食品名称、食品数量、食品存放时间和食品位置。
可选地，所述食品图标可以是通过用户添加的食品图标。
可选地，所述方法还可以包括：在蒙板上显示所述智能冰箱中存放的 食品的食品图标的同时，显示对所述智能冰箱中存放的食品种类数进行统计的进度条。
可选地，所述预定时段可以是进度条的加载时间。
可选地，所述方法还可以包括：响应于确定所述智能冰箱中没有存放食品，在蒙板上不显示食品图标。
可选地，所述食品管理仪表盘可以包括：食品图标区、过期提醒区、缺货提醒区和小贴士区。
可选地，所述方法还可以包括：当用户选择显示在食品图标区的食品图标之一时，显示与和所选食品图标相对应的食物相关的食品信息。
根据本公开的示例实施例，提供了一种用于食品信息管理的设备。该设备包括处理器和存储器。存储器存储有机器可执行指令，所述指令在被处理器执行时，使得处理器执行上述任一方法。
根据本公开的示例实施例，提供了一种计算机可读存储介质，其上存储有可执行指令，所述指令在被处理器执行时使处理器执行上述任一方法。
因此，本公开提供了一种智能冰箱的食品信息管理方法、设备和计算机可读存储介质，能够使智能冰箱更加贴近用户，改变设备与设备，设备与人之间的单一冰冷联接，满足用户对冰箱食品信息管理的应用场景需要。
附图说明
以下结合附图，将更清楚本公开的示例实施例的上述和其它方面、特征以及优点，附图中：
图1a和1b示出了根据本发明示例实施例的智能冰箱的结构的正视图 和侧视图；
图2示出了根据本发明示例实施例的智能冰箱的食品信息管理方法的流程图；以及
图3至图6b示出了使用根据本发明示例实施例的食品信息管理方法的食品信息管理应用的示意图。
具体实施方式
以下参考附图描述了本发明的示例实施。本发明提供了一种智能冰箱的食品信息管理方法，能够使智能冰箱更加贴近用户，改变设备与设备，设备与人之间的单一冰冷联接，满足用户对冰箱食品信息管理的应用场景需要。
图1a和1b示出了根据本发明示例实施例的智能冰箱的结构的正视图和侧视图。
结合图1a至图1b所示，作为一个实施例，冰箱的冷藏柜本体10(也可被称作冷藏室区域)的储物空间包括第一隔层空间101、第二隔层空间102、第三隔层空间103和第四隔层空间104，隔层空间可以是更多或更少，在本发明中不做限制。下面以冰箱的冷藏柜本体被分为3个隔层空间为例来描述本发明的智能冰箱的结构，在一个实施例中，摄像头组包括第一摄像头1、第二摄像头2、第三摄像头3、第四摄像头4和第五摄像头5，其中，第一摄像头1设置于第一隔层空间101的左内侧壁靠近顶部且靠近外敞口的位置上，用于获取第一隔层空间101的储物图像，即其摄像方向朝向第一隔层空间101的储物区域；第二摄像头2设置于第二隔层空间102 的左内侧壁靠近顶部且靠近外敞口的位置上，用于获取第二隔层空间102的储物图像，即其摄像方向朝向第二隔层空间102的储物区域；第三摄像头3设置于第三隔层空间103的左内侧壁靠近其顶部且靠近外敞口的位置上，用于获取第三隔层空间103的储物图像，即其摄像方向朝向第三隔层空间103的储物区域；第四摄像头4优选地设置于冷藏柜本体10内邻近第一隔层空间101或者第二隔层空间102且靠近外敞口的位置，用于获取冰箱门(也可被称作冷藏室门区域)20内侧整体空间的储物图像，即当冰箱门20相对于冷藏柜本体10形成预定开启角度时，第四摄像头4的拍摄角度对准冰箱门20内侧的储物区域；第五摄像头5优选地设置于冰箱门本体20的内侧(更优选地设置于其内侧的顶层兜槽上)，用于获取冷藏柜本体中包括三个隔层空间在内的整体储物图像，即当冰箱门20相对于冷藏柜本体10形成上述预定开启角度时，第五摄像头5的摄像方向朝向冷藏柜整体隔层空间的储物区域。
在使用过程中，当第一隔层空间101的储物状态发生变化时，可以通过第一摄像头1采集相应的图像，当第二隔层空间102的储物状态发生变化时，可以通过第二摄像头2采集相应的图像，当第三隔层空间的储物状态发生变化时，可以通过第三摄像头3采集相应的图像，而任一隔层空间的储物状态变化时，还可以通过第五摄像头5获得整体隔层空间的图像，这样在微观上和宏观上均得到了储物状态变化的相应图像。这两种角度的图像有助于云端的图像识别系统更为准确的识别出相应食品信息。另外，当冰箱门20内侧的储物状态变化时，可以通过第四摄像头4获得相应的图像，由于冰箱门20内侧的储物通常较少，这样获得的图像也有助于云 端的图像识别系统识别出冰箱门20内侧的储物信息。
需要说明的是，第四摄像头4和第五摄像头5可以被配置为在冰箱门20相对于冷藏柜本体10形成预定角度时同时动作，这样有助于提高图像整体采集的一致性和准确性，并且以尽量少的摄像头数目获得尽量多的图像信息。优选地，第四摄像头4和第五摄像头5的安装高度可以大体一致。
为了更为有效说明上述情形的实现过程，下面进一步举例说明一种具体实施方式：具体地，冰箱上还可以包括一传感器组和主控装置，该传感器组可以包括手部检测传感器(如红外传感器)、角度传感器、冰箱门开关状态检测装置(该装置可直接利用冰箱已有的开关门检测装置)，其中，手部检测传感器用于检测用户手部是否伸进隔层空间，在一个实施例中，手部传感器可以设置于如图1a和图1b所示的位置6处，角度传感器可以设置于冰箱门的转轴上，用于检测冰箱门箱对于冷藏柜的打开角度。
主控装置可以包括如下操作：识别冰箱当前的相应状态；控制摄像头的动作、进行图像采集和存储；实现网络传输等，还可以包括如下功能：根据云端图像识别系统的反馈信息以图形化界面显示冰箱储物空间中的储物状态，为用户提供语音控制以及向用户提供警报、温馨提示等功能。
在使用过程中，整个主控装置可以由冰箱供电单元供电，传感器组的各种相应状态信息实时传送给主控装置，当用户购买食品(例如苹果和鸡蛋)后，打开冰箱，主控装置得知冰箱门打开且得知冰箱门的打开方向(关闭方向)和角度，用户将苹果放到第一隔层空间101中，主控装置也得知这一状态，用户放置完苹果后，主控装置控制第一摄像头1动作，得到第一隔层空间101的储物图像，此外，用户还将鸡蛋放置在冰箱门20内侧， 之后用户关闭冰箱门20，在关闭的过程中，当冰箱门20相对于冷藏柜本体10的角度为预定角度(如45°)时，主控装置控制第四摄像头4和第五摄像头5同时动作，得到冷藏柜本体10整体空间的储物图像以及冰箱门20内侧整体空间的储物图像。
在上述相应摄像头动作的预定时间段内，主控装置还采集各相应摄像头获得的图像并将其存储为预定的格式(如jpeg格式)，当用户将冰箱门20关闭后，主控装置将这一周期内(从打开冰箱门到关闭冰箱门的时间段内)获得的三幅图像(第一隔层空间101的微观图像、冷藏柜本体10的整体图像以及冰箱门20内侧的整体图像)传输至云端图像识别系统，由云端图像识别系统根据这些图像获得第一隔层空间101的储物状态以及冰箱门20内侧的储物状态。
用户取出食品时主控装置的工作情形与上述类似，若有多个隔层空间涉及取放动作，所得到的图像数量也相应增加。此外，若是用户打开冰箱后，并未在冷藏柜本体10中取放食品，而仅仅在冰箱门20内侧进行取放动作，此时，主控装置并不控制相应摄像头获取隔层空间的微观图像，整个周期内的图像为两幅整体空间的储物图像；若是用户仅仅打开一个很小的角度(可以预设)，且既不在冷藏柜本体10中进行取放动作也不在冰箱门20内侧进行取放动作(这种情形下，通常是用户人工查看冰箱内部状态的情形)，此时，整个周期中，无需获取任何储物图像。
另外，云端图像识别系统获取每个周期的图像(组)后，可以及时处理，获得相应隔层空间和冰箱门20内侧位置的储物状态信息，例如可以得出第一个隔层空间101有几个苹果，冰箱门20内侧有几个鸡蛋，云端 图像识别系统将识别后的信息反馈给主控装置，主控装置通过其显示模块以图形化的方式将该信息呈现给用户，并且可以根据相应品类的保质期提醒用户及时用完。云端图像识别系统处理得到的信息也可以发送给用户的终端上，这样用户能够及时得知冰箱中的相关状态，以及得到相关提醒；此外，云端图像识别系统也可以将获得的图像直接转发给用户终端，这样用户终端也能够更加直观地查看冰箱中的储物状态，而且这在图像识别系统难以有效识别某些图像时更能提供有效的辅助。
下文中，基于上述智能冰箱的结构，描述根据本发明示例实施例的智能冰箱的食品信息管理方法。
图2描述了述根据本发明示例实施例的智能冰箱的食品信息管理方法的流程图。具体地，所述方法包括：在步骤S210，响应于第一用户输入，显示对智能冰箱的冷藏室区域和冷藏室门区域加以表示的门箱对拍图像。备选地，所述门箱对拍图像可以是由布置在智能冰箱内的摄像机拍摄的。在一个实施例中，所述方法还包括：响应于确定用户在智能冰箱中存取食品，采集门箱对拍图像。例如，当如结合图1a和图1b所示的传感器感测到用户在智能冰箱中存取食品时，控制布置在智能冰箱中的摄像机来采集门箱对拍图像。
接着，在步骤S220，在门箱对拍图像上显示蒙板，并在蒙板上显示所述智能冰箱中存放的食品的食品图标。在一个实施例中，通过对所述门箱对拍图像进行识别，来确定在蒙板上显示的食品图标和食品图标的对应位置；并根据所确定的食品图标的对应位置，布置所述食品图标。具体地，可以将所采集的门箱对拍图像发送给云端服务器，然后通过云端服务器来 识别门箱对拍图像中的食品信息，其中所述食品信息包括以下至少一项：食品名称、食品数量、食品存放时间和食品位置。当然，备选地，所述云端服务器还可以根据识别结果，来更新存储在存储器中的食品信息。除了通过云端服务器来识别门箱对拍图像所包含的食品信息从而添加对应食品图标之外，所述食品图标还可以是由用户手动添加的食品图标。
此外，在备选的实现方案中，还可以在在蒙板上显示所述智能冰箱中存放的食品的食品图标的同时，显示对所述智能冰箱中存放的食品种类数进行统计的进度条。所述进度条的加载状态可以表示对食品种类数进行统计的进度。也就是说，当开始对智能冰箱中存放的食品种类数的统计时，开始加载进度条，且当完成对智能冰箱中存放的食品种类数的统计时，完成加载进度条。在一个备选实施例中，进度条可以是环形，且在环形进度条的内部，显示当前已统计的食品种类数。如果智能冰箱中没有任何可识别的食品且没有任何手动添加的食品时，则在蒙板上不显示任何食品图标。
然后，在步骤S230，在预定时段之后显示食品管理仪表盘来取代先前显示的门箱对拍图像、蒙板和食品图标，所述食品管理仪表盘列出了所述智能冰箱中存放的食品的食品信息。具体地，所述预定时间可以是用户指定的时间。在一个实施例中，所述预定时间是识别门箱对拍图像中的食品信息所需的时间，也就是说，在存在进度条的情况下，所述预定时间是进度条的加载时间。此外，所述食品管理仪表盘包括一个或多个区域，例如食品图标区、过期提醒区、缺货提醒区和小贴士区。食品图标区显示智能冰箱中存放的食品的食品图标，过期提醒区显示针对快过期的食品的提醒，缺货提醒区显示针对缺货食品的提醒，且小贴士区显示与食品相关的其他 信息。应注意，以上仅示例性地描述了食品管理仪表盘的组成，所述食品管理仪表盘可以包括更多或更少的区域。
最终，在步骤S240，响应于第二用户输入，对食品信息进行管理。具体地，当用户选择显示在食品图标区的食品图标之一时，显示与和所选食品图标相对应的食物相关的食品信息，以便对食品信息进行管理。所述管理包括例如编辑、删除和添加等操作。
图3至图6b描述了使用根据本发明示例实施例的食品信息管理方法的食品信息管理应用的示意图。
图3示出了当首次使用根据本发明示例实施例的食品信息管理应用时所显示的用户界面。如图3所示，所述用户界面包括四个快捷入口1，从左到右依次为：留言板、系统设置、扫码购物、购物车。此外，所述用户界面包括“我的食物”信息板2，其中所述信息板2包括：“进入”按键3，响应于对所述按键的点击，进入“我的食物”；当前的食物4，显示当前已被统计食物种类(包括已识别、已录入的食物)；可识别或可录入的食品信息5，在该实施例中，由于没有发现可识别或可录入的食品信息，因此不显示任何食品信息；小贴士区6，在其中显示食物小贴士或冰箱小贴士，由于在该示例中冰箱内没有食物，所以首先显示冰箱小贴士；以及缺货提醒区域7，在该示例中，缺货提醒区域包括蛋类缺货提醒区域和奶类缺货提醒区域。备选地，所述用户界面还可以包括购物入口8，首页上的购物入口区的内容为运营所提供的广告图。另外，所述用户界面还可以包括冰箱设置页入口9，其中所述冰箱设置页入口9可以显示冰箱内的空气清洁度以及用于执行杀菌除味功能的杀菌除味键10。如图3所示，所述用户页 面还可以包括快捷购物栏11，快捷购物栏中的前三个项目是运营预设的，且快捷购物栏11还包括快捷购设置页入口12。
如图4a所示，用户可以从首页点击“我的食物”信息板右上角的“进入”键，或者信息板的其他任意区域进入我的食物页面，即，接收第一用户输入。当用户进入到“我的食物”页面后，会看到如图4b所示的初始动画。此处，动画作为一种优选实施例。首先，显示对冰箱的冷藏室区域以及冷藏室门区域加以指示的门箱对拍图像。接着，在门箱对拍图像之上覆盖一层半透明黑色蒙板，并在蒙板上显示出被识别或被录入的食物图标。具体地，当动画播放声音哦呼时，首先显示门箱对拍图像，以便让用户知道之后显示的图标来自于对真实门箱对拍照片内容的识别。随后，快速地将蒙板显示在门箱对拍图像上，且在两秒钟之内将与所有识别出的食物或由用户手动录入的食物相对应的食物图标“啪、啪、啪”地依次显示出来。备选地，食物图标的位置可以与或可以不与真实所在位置对应。在一个实施例中，如图4b所示，随着右侧食物图标的依次出现，左侧这里的环形进度条也会相应顺时针增长。同时环内的种类数也会相应增加，反映出已被统计食物种类数的真实情况。
图5a示出了在智能冰箱中存放有可识别的食物或用户手动录入的食物的情况下的用户界面，且图5b示出了在智能冰箱中不存在可识别的食物或用户手动录入的食物的情况下的用户界面。也就是说，在用户的冰箱中既没有可识别的食品，也没有手动添加的食品的情况下，如图5b所示，首先，当动画播放“哦呼”时，显示对冰箱的冷藏室区域以及冷藏室门区域加以指示的门箱对拍图像，然后在门箱对拍图像上覆盖一层半透明黑 色蒙板，以便让用户知道之后显示的图标来自于对真实门箱对拍照片内容的识别。由于此时没有可识别或手动录入食品，所以不会有任何食物图标显现出来。整个过程为一秒钟。左侧这里的环形进度条也会相应顺时针增长，但环内数字保持为零。
接着，如图6a所示，当2-3秒钟的初始动画播放完毕之后，冰箱以及环形进度条滑出屏幕，同时食品管理仪表盘从左侧滑入屏幕。图6b示出了当食品管理仪表盘完全取代先前显示的门箱对拍图像、蒙板和食品图标之后的用户界面。在图6b所示的实施例中，所述食品管理仪表盘包括食品图标区、过期提醒区、缺货提醒区和小贴士区。当用户选择显示在食品图标区的食品图标之一时(即，第二用户输入)，显示与和所选食品图标相对应的食物相关的食品信息，以便对食品信息进行管理。
综上，本发明提供了一种智能冰箱的食品信息管理方法，能够扩展智能冰箱的智能化生活应用，使用户与智能冰箱之间的交互更加便捷、人性化和智能化，从而提高了用户在智能冰箱上的使用体验。
以上方案仅是示出本发明构思的一个具体实现方案，本发明不限于上述实现方案。可以省略或跳过上述实现方案中的一部分处理，而不脱离本发明的精神和范围。
前面的方法可以通过多种计算机装置以可执的程序命令形式实现并记录在计算机可读记录介质中。在这种情况下，计算机可读记录介质可以包括单独的程序命令、数据文件、数据结构或其组合。同时，记录在记录介质中的程序命令可以专门设计或配置用于本发明，或是计算机软件领域的技术人员已知应用的。计算机可读记录介质包括例如硬盘、软盘或磁带 等磁性介质、例如压缩盘只读存储器(CD-ROM)或数字通用盘(DVD)等光学介质、例如光磁软盘的磁光介质以及例如存储和执行程序命令的ROM、RAM、闪存等硬件装置。此外，程序命令包括编译器形成的机器语言代码和计算机通过使用解释程序可执行的高级语言。前面的硬件装置可以配置成作为至少一个软件模块操作以执行本发明的操作，并且逆向操作也是一样的。
尽管以特定顺序示出并描述了本文方法的操作，然而可以改变每个方法的操作的顺序，使得可以以相反顺序执行特定操作或使得可以至少部分地与其它操作同时来执行特定操作。此外，本发明不限于上述示例实施例，它可以在不脱离本公开的精神和范围的前提下，包括一个或多个其他部件或操作，或省略一个或多个其他部件或操作。
以上已经结合本发明的优选实施例示出了本发明，但是本领域的技术人员将会理解，在不脱离本发明的精神和范围的情况下，可以对本发明进行各种修改、替换和改变。因此，本发明不应由上述实施例来限定，而应由所附权利要求及其等价物来限定。

Claims (12)

  1. 一种智能冰箱的食品信息管理方法，包括：
    响应于第一用户输入，显示对智能冰箱的冷藏室区域和冷藏室门区域加以表示的门箱对拍图像；
    在门箱对拍图像上显示蒙板，并在蒙板上显示所述智能冰箱中存放的食品的食品图标；
    在预定时段之后显示食品管理仪表盘来取代先前显示的门箱对拍图像、蒙板和食品图标，所述食品管理仪表盘列出了所述智能冰箱中存放的食品的食品信息；以及
    响应于第二用户输入，对食品信息进行管理。
  2. 根据权利要求1所述的食品信息管理方法，其中所述门箱对拍图像是由布置在智能冰箱内的摄像机拍摄的，且
    所述方法还包括：通过对所述门箱对拍图像进行识别，确定在蒙板上显示的食品图标和食品图标的对应位置；并根据所确定的食品图标的对应位置，布置所述食品图标。
  3. 根据权利要求2所述的食品信息管理方法，其中所述方法还包括：
    响应于确定用户在智能冰箱中存取食品，采集门箱对拍图像；
    将所述门箱对拍图像发送给云端服务器；
    经由云端服务器识别所述门箱对拍图像中的食品信息；以及
    根据云端服务器的识别结果，更新食品信息。
  4. 根据权利要求1至3中的任一权利要求所述的食品信息管理方法，其中所述食品信息包括以下至少一项：食品名称、食品数量、食品存放时间和食品位置。
  5. 根据权利要求1所述的食品信息管理方法，其中所述食品图标是通过用户添加的食品图标。
  6. 根据权利要求1所述的食品信息管理方法，其中所述方法还包括：在蒙板上显示所述智能冰箱中存放的食品的食品图标的同时，显示对所述智能冰箱中存放的食品种类数进行统计的进度条。
  7. 根据权利要求6所述的食品信息管理方法，其中所述预定时段是进度条的加载时间。
  8. 根据权利要求1所述的食品信息管理方法，其中所述方法还包括：响应于确定所述智能冰箱中没有存放食品，在蒙板上不显示食品图标。
  9. 根据权利要求1所述的食品信息管理方法，其中所述食品管理仪表盘包括：食品图标区、过期提醒区、缺货提醒区和小贴士区。
  10. 根据权利要求9所述的食品信息管理方法，其中所述方法还包括：当用户选择显示在食品图标区的食品图标之一时，显示与和所选食品图标相对应的食物相关的食品信息。
  11. 一种用于食品信息管理的设备，包括：
    处理器；以及
    存储器，存储有机器可执行指令，所述指令在被处理器执行时，使得处理器执行根据权利要求1至10中任一项所述的方法。
  12. 一种计算机可读存储介质，其上存储有可执行指令，所述指令在被处理器执行时使处理器执行根据权利要求1至10中任一项所述的方法。
PCT/CN2017/094269 2016-09-07 2017-07-25 智能冰箱的食品信息管理方法、设备和计算机可读存储介质 Ceased WO2018045838A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610808751.5A CN107796168A (zh) 2016-09-07 2016-09-07 智能冰箱的食品信息管理方法
CN201610808751.5 2016-09-07

Publications (1)

Publication Number Publication Date
WO2018045838A1 true WO2018045838A1 (zh) 2018-03-15

Family

ID=61530799

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/094269 Ceased WO2018045838A1 (zh) 2016-09-07 2017-07-25 智能冰箱的食品信息管理方法、设备和计算机可读存储介质

Country Status (2)

Country Link
CN (1) CN107796168A (zh)
WO (1) WO2018045838A1 (zh)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111292828A (zh) * 2018-12-07 2020-06-16 海信（山东）冰箱有限公司 智能冰箱及其食材管理方法、装置及存储介质
CN113128314A (zh) * 2020-01-15 2021-07-16 青岛海尔电冰箱有限公司 冰箱食材管理方法、冰箱以及存储介质
CN114322409A (zh) * 2021-06-23 2022-04-12 海信视像科技股份有限公司 冰箱及储藏室内景图片展示方法
CN114719536A (zh) * 2022-04-08 2022-07-08 四川虹美智能科技有限公司 智能收纳冰箱
WO2022267518A1 (zh) * 2021-06-23 2022-12-29 海信视像科技股份有限公司 食材存储设备
CN115962620A (zh) * 2023-01-17 2023-04-14 珠海格力电器股份有限公司 冰箱的控制方法、装置、智能冰箱及存储介质

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107796169A (zh) * 2016-09-07 2018-03-13 北京京东尚科信息技术有限公司 用于分享智能冰箱信息的方法
KR102637119B1 (ko) * 2018-10-25 2024-02-15 삼성전자주식회사 냉장고 안의 객체에 관한 정보를 제공하는 방법 및 시스템
CN113915848B (zh) * 2020-07-09 2023-09-19 海信视像科技股份有限公司 冰箱及食材管理界面的显示方法
CN113915847B (zh) * 2020-07-09 2023-09-15 海信视像科技股份有限公司 冰箱及食材管理界面的显示方法
CN111811185A (zh) * 2020-07-17 2020-10-23 海信视像科技股份有限公司 冰箱及食材管理界面的显示方法
JP7620875B2 (ja) * 2021-02-25 2025-01-24 パナソニックＩｐマネジメント株式会社 プログラム、端末装置、及び端末装置の制御方法
CN115371350B (zh) * 2022-08-18 2023-11-21 青岛海信智慧生活科技股份有限公司 确定储物管理信息的方法及智能冰箱

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102261808A (zh) * 2011-06-16 2011-11-30 达真贸易(深圳)有限公司 冰箱食品管理系统及其使用方法
KR20110130901A (ko) * 2010-05-28 2011-12-06 전자부품연구원 냉장고의 보관 식품 관리 장치 및 방법
CN103604271A (zh) * 2013-11-07 2014-02-26 四川长虹电器股份有限公司 一种基于智能冰箱的食品识别方法
CN104061747A (zh) * 2013-03-18 2014-09-24 海尔集团公司 一种冰箱内食品存储控制方法、智能控制终端及冰箱
CN104896868A (zh) * 2015-06-18 2015-09-09 合肥美菱股份有限公司 一种根据远程图像识别管理冰箱食品列表的方法

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002243335A (ja) * 2001-02-21 2002-08-28 Toshiba Corp 食品保存庫、ホームネットワーク装置、携帯情報端末、食品情報提供サーバ、献立情報提供サーバ及び保存庫内収納情報提供サーバ
CN2489356Y (zh) * 2001-08-09 2002-05-01 梁坚平 带人体感应器的数码照相机
KR101779417B1 (ko) * 2010-02-25 2017-09-18 엘지전자 주식회사 단말기 및 그 제어 방법
KR20120116207A (ko) * 2011-04-12 2012-10-22 엘지전자 주식회사 디스플레이 장치 및 이를 구비하는 냉장고
CN103712410B (zh) * 2012-09-28 2017-05-17 Lg电子株式会社 电器产品
US9224123B2 (en) * 2012-09-28 2015-12-29 Lg Electronics Inc. Electric product and method of controlling the same
KR20150081012A (ko) * 2014-01-03 2015-07-13 삼성전자주식회사 사용자 단말 장치 및 그 제어 방법
JP6296908B2 (ja) * 2014-06-09 2018-03-20 三菱電機株式会社 冷蔵庫及びネットワークシステム
CN105120226B (zh) * 2015-09-09 2018-03-16 合肥美的智能科技有限公司 图像采集装置、方法及冰箱
CN105677001A (zh) * 2016-03-09 2016-06-15 北京京东尚科信息技术有限公司 用于智能冷藏设备的信息处理方法和装置
CN105827954B (zh) * 2016-03-10 2018-12-07 北京京东尚科信息技术有限公司 用于容器的图像获取装置及图像处理系统
CN105823778A (zh) * 2016-03-10 2016-08-03 北京京东尚科信息技术有限公司 物品识别方法、装置及系统
CN105698482A (zh) * 2016-04-01 2016-06-22 青岛海尔股份有限公司 冰箱内储物信息的确定方法与冰箱

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20110130901A (ko) * 2010-05-28 2011-12-06 전자부품연구원 냉장고의 보관 식품 관리 장치 및 방법
CN102261808A (zh) * 2011-06-16 2011-11-30 达真贸易(深圳)有限公司 冰箱食品管理系统及其使用方法
CN104061747A (zh) * 2013-03-18 2014-09-24 海尔集团公司 一种冰箱内食品存储控制方法、智能控制终端及冰箱
CN103604271A (zh) * 2013-11-07 2014-02-26 四川长虹电器股份有限公司 一种基于智能冰箱的食品识别方法
CN104896868A (zh) * 2015-06-18 2015-09-09 合肥美菱股份有限公司 一种根据远程图像识别管理冰箱食品列表的方法

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111292828A (zh) * 2018-12-07 2020-06-16 海信（山东）冰箱有限公司 智能冰箱及其食材管理方法、装置及存储介质
CN113128314A (zh) * 2020-01-15 2021-07-16 青岛海尔电冰箱有限公司 冰箱食材管理方法、冰箱以及存储介质
CN113128314B (zh) * 2020-01-15 2023-10-31 青岛海尔电冰箱有限公司 冰箱食材管理方法、冰箱以及存储介质
CN114322409A (zh) * 2021-06-23 2022-04-12 海信视像科技股份有限公司 冰箱及储藏室内景图片展示方法
WO2022267518A1 (zh) * 2021-06-23 2022-12-29 海信视像科技股份有限公司 食材存储设备
CN114322409B (zh) * 2021-06-23 2023-09-19 海信视像科技股份有限公司 冰箱及储藏室内景图片展示方法
CN114719536A (zh) * 2022-04-08 2022-07-08 四川虹美智能科技有限公司 智能收纳冰箱
CN115962620A (zh) * 2023-01-17 2023-04-14 珠海格力电器股份有限公司 冰箱的控制方法、装置、智能冰箱及存储介质
CN115962620B (zh) * 2023-01-17 2024-10-08 珠海格力电器股份有限公司 冰箱的控制方法、装置、智能冰箱及存储介质

Also Published As

Publication number Publication date
CN107796168A (zh) 2018-03-13

Similar Documents

Publication Publication Date Title
WO2018045838A1 (zh) 智能冰箱的食品信息管理方法、设备和计算机可读存储介质
CN107477971B (zh) 一种对冰箱内食物的管理方法和设备
CN107703872B (zh) 家电设备的终端控制方法、装置及终端
CN108369633B (zh) 相册的视觉表示
CN111292828A (zh) 智能冰箱及其食材管理方法、装置及存储介质
JP6642713B2 (ja) 冷蔵庫システム
CN106969593A (zh) 一种智能冰箱的食材管理方法
CN106679321A (zh) 一种智能冰箱食物管理方法及智能冰箱
JP2010093713A (ja) 表示制御装置、表示制御方法及びプログラム
CN104102429A (zh) 集成取景器和数字媒体
WO2018045839A1 (zh) 用于智能冰箱的购物触发方法、设备和计算机可读存储介质
CN107763955A (zh) 一种冰箱及其控制方法
CN108959320A (zh) 预览视频搜索结果的方法和装置
CN111692830A (zh) 冰箱的控制方法及采用该控制方法的冰箱
EP2838062A1 (en) Search results with common interest information
JP2024088755A (ja) プログラム、端末装置、及び食品管理システム
CN112199406A (zh) 信息推荐方法、食材存储设备及服务器
CN107796169A (zh) 用于分享智能冰箱信息的方法
CN114322409B (zh) 冰箱及储藏室内景图片展示方法
CN114294886B (zh) 冰箱及食材录入方法
CN108151432A (zh) 智能冷藏设备及其方法
CN114294885B (zh) 冰箱及图像采集方法
CN110749137A (zh) 冰箱及用于冰箱的控制方法
CN103926008A (zh) 热像装置、热像任务拍摄方法和热像存储方法
CN101409785B (zh) 拍摄装置及其拍摄方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17848011

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205 DATED 21.06.2019)

122 Ep: pct application non-entry in european phase

Ref document number: 17848011

Country of ref document: EP

Kind code of ref document: A1