WO2014146431A1 - 一种冰箱内食品存储位置记录方法、装置、终端及冰箱 - Google Patents
一种冰箱内食品存储位置记录方法、装置、终端及冰箱 Download PDFInfo
- Publication number
- WO2014146431A1 WO2014146431A1 PCT/CN2013/086188 CN2013086188W WO2014146431A1 WO 2014146431 A1 WO2014146431 A1 WO 2014146431A1 CN 2013086188 W CN2013086188 W CN 2013086188W WO 2014146431 A1 WO2014146431 A1 WO 2014146431A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- food
- image
- refrigerator
- identified
- storage location
- Prior art date
Links
Images
Classifications
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
- F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
- F25D29/00—Arrangement or mounting of control or safety devices
Definitions
- the invention relates to the technical field of smart home appliances, in particular to a method, a device, a terminal and a refrigerator for recording a food storage location in a refrigerator.
- some smart refrigerators are loaded with an intelligent control terminal, such as a tablet computer, on the basis of a conventional refrigerator.
- the user inputs the names of the foods stored in the refrigerator in the intelligent control terminal by manual input.
- the intelligent control terminal records the storage location of each food, and carries out subsequent management.
- the method of manually inputting the name of the food and the storage location in the refrigerator can only operate for one food at a time.
- the refrigerator stores more food, it needs manual operation for a long time, and information is entered. It is less efficient and it is difficult to guarantee the accuracy of manual operations.
- the embodiment of the invention provides a method, a device, a terminal and a refrigerator for recording a food storage location in a refrigerator, which are used to solve the problem of low efficiency of food storage location information entry in the prior art.
- the embodiment of the invention provides a method for recording a food storage location in a refrigerator, comprising:
- the identified food item is stored in a designated storage location in the refrigerator.
- the embodiment of the invention provides a food storage location recording device in a refrigerator, comprising:
- An obtaining unit configured to obtain a food collection image obtained by photographing a designated storage location inside the refrigerator
- An identification unit configured to identify a food present in the food collection image
- a recording unit for recording the identified food item stored in a designated storage location in the refrigerator.
- the embodiment of the invention further provides an intelligent control terminal, comprising the food storage location recording device in the refrigerator.
- the embodiment of the invention further provides a refrigerator, comprising the above intelligent control terminal.
- an image of a specified storage location of the refrigerator is collected, and the collected image is identified, and the food in the image is determined, that is, the food stored in the storage location is determined, and the stored food is determined.
- the storage location of each food in the refrigerator is determined and recorded, so manual input is not required, the entry efficiency of the food storage location information can be improved, and the accuracy of the information is ensured.
- FIG. 1 is a flowchart of a method for recording a food storage location in a refrigerator according to an embodiment of the present invention
- FIG. 2 is a flowchart of a method for recording a food storage location in a refrigerator according to Embodiment 1 of the present invention
- FIG. 3 is a flowchart of a food identification method according to Embodiment 1 of the present invention.
- FIG. 4 is a flowchart of a method for recording a food storage location in a refrigerator according to Embodiment 2 of the present invention.
- FIG. 5 is a schematic structural diagram of a food storage location recording apparatus in a refrigerator according to Embodiment 3 of the present invention.
- the present invention provides a method, a device, and a refrigerator for recording a food storage location in a refrigerator.
- the preferred embodiment of the present invention is described below with reference to the accompanying drawings.
- the preferred embodiments described herein are for illustrative purposes only and are not intended to limit the invention. And in the case of no conflict, the embodiments in the present application and the features in the embodiments can be combined with each other.
- An embodiment of the present invention provides a method for recording a food storage location in a refrigerator, as shown in FIG. 1 , including:
- Step 101 Acquire a food collection image obtained by photographing a designated storage location inside the refrigerator.
- Step 102 Identify foods present in the food collection image.
- Step 103 Recording the identified food item is stored in a designated storage location in the refrigerator.
- step 101 can be specifically implemented as follows:
- Method 1 acquiring a food collection image obtained by taking an image storage device corresponding to a designated storage location inside the refrigerator in a plurality of image collection devices disposed in the refrigerator, and capturing the designated storage location;
- Method 2 Acquire an image acquisition image obtained by the image collection device disposed in the refrigerator according to a preset shooting angle corresponding to a specified storage location inside the refrigerator.
- the obtained food collection image in step 101 may be an image obtained by photographing a specified storage location inside the refrigerator, or may be an image obtained by photographing a plurality of specified storage locations inside the refrigerator.
- the food identification method in step 102 may adopt image recognition, barcode recognition, etc., and preferably combines image recognition and barcode recognition according to the embodiments of the present invention, which can improve the accuracy and recognition rate of food identification.
- photographing is performed only for one designated storage position when photographing the inside of the refrigerator.
- Embodiment 1 of the present invention is a flowchart of a method for recording a food storage location in a refrigerator according to Embodiment 1 of the present invention, which specifically includes:
- Step 201 Obtain a food collection image obtained by photographing a designated storage location inside the refrigerator.
- the number of image capturing devices in the refrigerator may be multiple, and each image capturing device corresponds to a storage location, and the storage location is specified inside the refrigerator.
- the image capturing device corresponding to the specified storage location is photographed; the number of image capturing devices in the refrigerator may also be one, and each shooting angle of the image capturing device corresponds to a storage position, and the storage is specified inside the shooting refrigerator.
- the image capturing device performs shooting at a shooting angle corresponding to the specified storage position.
- Step 202 Identify foods present in the food collection image.
- Step 203 Record the identified food item in the specified storage location in the refrigerator.
- the user may also display the food icon corresponding to the stored food in the refrigerator and its storage location in the refrigerator.
- the enhanced display technology may be employed to improve the user experience.
- FIG. 3 is a flowchart of a food identification method according to Embodiment 1 of the present invention, which specifically includes:
- Step 301 Determine an image of the food to be identified that exists in the food collection image.
- the step includes pre-processing the food collection image, performing contour detection and background segmentation of the food to be identified, etc. This part is prior art and therefore will not be described in detail herein.
- Step 302 Determine whether a food identification barcode exists in the image of the food to be identified.
- step 303 When the food identification barcode is present in the food image to be identified, the process proceeds to step 303; when the food identification barcode is not present in the food image to be identified, the process proceeds to step 304.
- Step 303 Determine that the food in the food image to be identified is a food characterized by a food identification barcode, and end the food identification process.
- the food can be identified by the food identification barcode without performing subsequent steps.
- Step 304 Extract a feature vector of the food image to be identified.
- the method for extracting the food image feature vector to be identified in this step corresponds to the method for establishing the correspondence between the food and the feature vector.
- the correspondence between the preset food and the feature vector may be as follows. set up:
- the sample image of the plurality of samples of the food may be determined first.
- the average of the color feature values, the average of the shape feature values of the sample images of the plurality of samples of the food, and the average of the texture feature values of the sample images of the plurality of samples of the food; the average of the color feature values The average value of the shape feature values and the average value of the texture feature values directly as the components of the feature vector constitute the feature vector corresponding to the food.
- the color feature value interval corresponding to the food image of the plurality of samples of the food product is first determined, and the shape characteristic value of the sample image of the plurality of samples of the food product is used to determine the corresponding food product.
- the method when extracting the feature vector of the food image to be identified, the method includes the following steps:
- the color feature value, the shape feature value, and the texture of the food image to be identified may be specifically The feature value directly serves as a component of the feature vector, and constitutes a feature vector of the food image to be identified.
- the color feature value preset interval of the color feature value of the food image to be identified is determined first, and the shape feature value preset interval of the shape feature value of the food image to be identified and the texture feature value of the food image to be identified are determined.
- the texture feature value preset interval is set; and the feature vector of the food image to be identified is determined based on the color feature value preset interval, the shape feature value preset interval, and the texture feature value preset interval.
- Step 305 Determine, among the plurality of feature vectors corresponding to the different foods, whether there is a feature vector whose correlation degree with the feature vector of the food image to be identified is greater than a preset value.
- step 306 when a plurality of feature vectors respectively corresponding to different foods are preset, if there is a feature vector whose correlation degree with the feature vector of the food image to be identified is greater than a preset value, the process proceeds to step 306; when the preset corresponds to different foods respectively When there is no feature vector between the plurality of feature vectors and the feature vector of the food image to be identified that is greater than the preset value, it is determined that the food cannot be identified, and the food identification process is ended.
- Step 306 Select, from the preset plurality of feature vectors respectively corresponding to different foods, a feature vector having the greatest correlation with the feature vector of the food image to be identified as the matched feature vector.
- Step 307 Determine that the food in the food image to be identified is a food corresponding to the matching feature vector.
- the food identification method described above combines bar code recognition and image recognition, and prioritizes bar code recognition.
- the first embodiment of the present invention may also adopt a scheme of priority image recognition, or adopt a scheme of bar code recognition and image recognition simultaneously, based on respective identifications.
- the results determine the final food identification results.
- a plurality of designated storage positions are photographed when photographing the inside of the refrigerator.
- Embodiment 4 is a flowchart of a method for recording a food storage location in a refrigerator according to Embodiment 2 of the present invention, which specifically includes:
- Step 401 Acquire a food collection image obtained by photographing a plurality of designated storage locations inside the refrigerator.
- This step can also be realized by an image acquisition device disposed in the refrigerator.
- Step 402 Specify a storage location for each of the plurality of designated storage locations, and identify a food present in the designated area corresponding to the specified storage location in the food collection image.
- the food identification method in the step 202 of the above embodiment 1 can also be specifically used, as shown in FIG. 3, and will not be described in detail herein.
- Step 403 Specify a storage location for each of the plurality of designated storage locations, and record the food identified in the designated area corresponding to the specified storage location in the food collection image and store the designated storage in the refrigerator. Object location.
- the user may also display the food icon corresponding to the stored food in the refrigerator and its storage location in the refrigerator.
- the enhanced display technology may be employed to improve the user experience.
- the food storage location recording method in the refrigerator avoids manual manual input of the food storage location, can improve the input efficiency of the food storage location information, and ensures the accuracy of the information.
- the food storage location recording method in the refrigerator according to the above embodiment of the present invention correspondingly, the third embodiment of the present invention further provides a food storage location recording device in the refrigerator, the structure of which is shown in FIG. Specifically include:
- the obtaining unit 501 is configured to acquire a food collection image obtained by photographing a designated storage location inside the refrigerator;
- the identifying unit 502 is configured to identify a food present in the food collection image
- the recording unit 503 is configured to record that the identified food is stored in a designated storage location in the refrigerator.
- the acquiring unit 501 is specifically configured to acquire a food collection image obtained by capturing an image of the specified storage location by an image capturing device corresponding to a specified storage location in the plurality of image capturing devices disposed in the refrigerator; or acquiring The image collecting device disposed in the refrigerator photographs the food collection image obtained by the specified storage position according to a preset shooting angle corresponding to a specified storage position inside the refrigerator.
- the obtaining unit 501 is specifically configured to acquire a food collection image obtained by photographing a plurality of designated storage locations inside the refrigerator;
- the identifying unit 502 is specifically configured to identify a storage location for each of the plurality of designated storage locations, and identify a food present in the designated area corresponding to the specified storage location in the food collection image;
- the recording unit 503 is specifically configured to specify a storage location for each of the plurality of designated storage locations, and record the food identified in the designated area corresponding to the designated storage location in the food collection image and store the food in the refrigerator Specify the storage location in the middle.
- the identification unit 502 is specifically configured to determine an image of the food to be identified that exists in the food collection image; and when the food identification barcode is present in the food image to be identified, determine that the food in the food image to be identified is the food identification barcode Characterizing the food; extracting the feature vector of the image of the food to be identified when the food identification barcode is not present in the image of the food to be identified; and selecting the image of the food to be identified from the plurality of feature vectors respectively corresponding to different foods
- the correlation between the feature vectors is greater than a preset value, and the feature vector having the greatest correlation with the feature vector of the food image to be identified is used as a matching feature vector; determining the food in the food image to be identified is the The food corresponding to the matching feature vector.
- the identifying unit 502 is specifically configured to extract a color feature value, a shape feature value, and a texture feature value of the food image to be identified; and determine the color feature value, the shape feature value, and the texture feature value of the food image to be identified. a feature vector of the food image to be identified;
- the identification unit 502 is specifically configured to extract color feature values, shape feature values, and texture feature values of the sample images of the plurality of samples of the same food product; color feature values and shapes of the sample images of the plurality of samples based on the same food product.
- the feature value and the texture feature value determine a feature vector corresponding to the food.
- Embodiment 4 of the present invention further provides an intelligent control terminal, which comprises the food storage location recording device in the refrigerator as shown in FIG. 5.
- Embodiment 5 of the present invention further provides a refrigerator, including the above intelligent control terminal.
- the solution provided by the embodiment of the present invention includes: acquiring a food collection image obtained by photographing a designated storage location inside the refrigerator; identifying a food present in the food collection image; and recording the identified food in the refrigerator. Specify the storage location.
- the efficiency of inputting food storage location information in the refrigerator can be improved.
- the food storage location recording device in the refrigerator provided by the embodiment of the present application can be realized by a computer program.
- Those skilled in the art should be able to understand that the unit division manner described above is only one of a plurality of unit division manners. If the division into other units or non-divided units, as long as the food storage location recording device in the refrigerator has the above functions, it should be in this Within the scope of protection of the application.
- the computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device.
- the apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.
- These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device.
- the instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.
Landscapes
- Engineering & Computer Science (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Physics & Mathematics (AREA)
- Mechanical Engineering (AREA)
- Thermal Sciences (AREA)
- General Engineering & Computer Science (AREA)
- Cold Air Circulating Systems And Constructional Details In Refrigerators (AREA)
Abstract
提供了一种冰箱内食品存储位置记录方法、装置、终端及冰箱。该记录方法包括：获取拍摄冰箱内部指定储物位置所得到的食品采集图像；识别该食品采集图像内存在的食品；记录识别出的该食品存储在冰箱中指定储物位置。采用该记录方法能够提高冰箱内食品存储位置信息的录入效率。
Description
本申请要求了申请日为2013年03月18日，申请号为201310086812.8，发明名称为“一种冰箱内食品存储位置记录方法、装置、终端及冰箱”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
【技术领域】
本发明涉及智能家电技术领域，尤其涉及一种冰箱内食品存储位置记录方法、装置、终端及冰箱。
【背景技术】
随着科技的发展，人们生活水平的不断提高，能够进行食品管理的智能冰箱正在走进越来越多的家庭。目前的一些智能冰箱，多是在传统冰箱的基础上加载了一个智能控制终端，例如平板电脑等，使用者通过手动输入的方式在该智能控制终端中录入存储于冰箱内的各食品的名称，以及各食品在冰箱中的存储位置，智能控制终端记录各食品存储位置，并进行后续的管理。
然而，现有技术中采用人工操作录入食品名称及其在冰箱内存储位置的方法，每次只能针对一个食品进行操作，当冰箱存储的食品较多时，则需要人工操作很长时间，信息录入效率较低，并且也很难保证人工操作的准确性。
【发明内容】
本发明实施例提供一种冰箱内食品存储位置记录方法、装置、终端及冰箱，用以解决现有技术中食品存储位置信息录入效率较低的问题。
本发明实施例提供一种冰箱内食品存储位置记录方法，包括：
获取拍摄冰箱内部指定储物位置所得到的食品采集图像；
识别所述食品采集图像内存在的食品；
记录识别出的所述食品存储在冰箱中指定储物位置。
本发明实施例提供一种冰箱内食品存储位置记录装置，包括：
获取单元，用于获取拍摄冰箱内部指定储物位置所得到的食品采集图像；
识别单元，用于识别所述食品采集图像内存在的食品；
记录单元，用于记录识别出的所述食品存储在冰箱中指定储物位置。
本发明实施例还提供了一种智能控制终端，包括上述冰箱内食品存储位置记录装置。
本发明实施例还提供了一种冰箱，包括上述智能控制终端。
本发明实施例提供的方案中，采集冰箱指定储物位置的图像，再对采集到的图像进行识别，确定该图像中的食品，即确定该储物位置存储的食品，在确定存储的各食品的名称的同时确定了各食品在冰箱中的存储位置，并进行记录，因此不需要人工进行手动输入，可以提高食品存储位置信息的录入效率，并且保证了信息的准确性。
【附图说明】
附图用来提供对本发明的进一步理解，并且构成说明书的一部分，与本发明实施例一起用于解释本发明，并不构成对本发明的限制。在附图中：
图1为本发明实施例提供的冰箱内食品存储位置记录方法的流程图；
图2为本发明实施例1提供的冰箱内食品存储位置记录方法的流程图；
图3为本发明实施例1提供的食品识别方法的流程图；
图4为本发明实施例2提供的冰箱内食品存储位置记录方法的流程图；
图5为本发明实施例3提供的冰箱内食品存储位置记录装置的结构示意图。
【具体实施方式】
为了给出提高食品存储位置信息录入效率的实现方案，本发明实施例提供了一种冰箱内食品存储位置记录方法、装置、及冰箱，以下结合说明书附图对本发明的优选实施例进行说明，应当理解，此处所描述的优选实施例仅用于说明和解释本发明，并不用于限定本发明。并且在不冲突的情况下，本申请中的实施例及实施例中的特征可以相互组合。
本发明实施例提供一种冰箱内食品存储位置记录方法，如图1所示，包括：
步骤101、获取拍摄冰箱内部指定储物位置所得到的食品采集图像。
步骤102、识别该食品采集图像内存在的食品。
步骤103、记录识别出的该食品存储在冰箱中指定储物位置。
上述步骤101具体可以通过如下方式实现：
方式一：获取由冰箱内安置的多个图像采集装置中与冰箱内部指定储物位置对应的图像采集装置拍摄该指定储物位置所得到的食品采集图像；
方式二：获取由冰箱内安置的图像采集装置按照与冰箱内部指定储物位置对应的预设拍摄角度拍摄该指定储物位置所得到的食品采集图像。
进一步的，步骤101中的得到食品采集图像可以为拍摄冰箱内部一个指定储物位置得到的图像，也可以为拍摄冰箱内部多个指定储物位置得到的图像。
步骤102中的食品识别方法可采用图像识别、条码识别等，较佳的也可采用本发明实施例提出的图像识别和条码识别相结合的方法，能够提高食品识别的准确性及识别率。
下面结合附图，用具体实施例对本发明实施例提供的冰箱内食品存储位置记录方法进行详细描述。
实施例1：
本发明实施例1中，在对冰箱内部进行拍摄时仅针对一个指定储物位置进行拍摄。
图2所示为本发明实施例1提供的冰箱内食品存储位置记录方法的流程图，具体包括：
步骤201、获取拍摄冰箱内部一个指定储物位置所得到的食品采集图像。
当通过安置于冰箱内的图像采集装置实现该食品采集图像的拍摄时，冰箱内图像采集装置的数量可以为多个，每个图像采集装置对应一个储物位置，在拍摄冰箱内部指定储物位置时，由与该指定储物位置对应的图像采集装置进行拍摄；冰箱内图像采集装置的数量也可以为一个，该图像采集装置的每个拍摄角度对应一个储物位置，在拍摄冰箱内部指定储物位置时，由图像采集装置按照与该指定储物位置对应的拍摄角度进行拍摄。
步骤202、识别该食品采集图像内存在的食品。
本发明实施例1提供的食品识别方法的详细流程如图3所示，后文进行详细说明。
步骤203、记录识别出的食品存储在冰箱中该指定储物位置。
各食品存储位置被记录后，还可以向用户显示冰箱中已存储食品对应的食品图标及其在冰箱中的存储位置示意图，较佳的，可采用增强显示技术，以提高用户体验。
图3所示为本发明实施例1提供的食品识别方法的流程图，具体包括：
步骤301、确定食品采集图像内存在的待识别食品图像。
该步骤包括对食品采集图像进行预处理，进行待识别食品的轮廓检测及背景分割等，此部分为现有技术，故在此不再详述。
步骤302、判断待识别食品图像中是否存在食品标识条码。
当待识别食品图像中存在食品标识条码时，进入步骤303；当待识别食品图像中不存在食品标识条码时，进入步骤304。
步骤303、确定待识别食品图像中的食品为食品标识条码表征的食品，结束该食品识别流程。
对于一些携带食品标识条码且条码完整无损够能识别的食品，例如从超市购得的食品，通过食品标识条码便可识别该食品，无需执行后续步骤。
而对于一些不携带食品标识条码或者携带破损条码的食品，例如从市场购得的食品，主要通过以下步骤进行识别。
步骤304、提取待识别食品图像的特征向量。
该步骤待识别食品图像特征向量的提取方法应和预设的食品和特征向量的对应关系的建立方法对应，在本发明实施例1中，预设的食品和特征向量的对应关系可采用如下方式建立：
提取同一种食品的多个样品的样品图像的颜色特征值、形状特征值和纹理特征值；基于同一种食品的多个样品的样品图像的颜色特征值、形状特征值和纹理特征值，确定该食品对应的特征向量。
其中，在基于同一种食品的多个样品的样品图像的颜色特征值、形状特征值和纹理特征值，确定该食品对应的特征向量时，具体可以先确定该食品的多个样品的样品图像的颜色特征值的平均值，该食品的多个样品的样品图像的形状特征值的平均值，以及该食品的多个样品的样品图像的纹理特征值的平均值；将该颜色特征值的平均值、形状特征值的平均值和纹理特征值的平均值直接作为特征向量的各分量，构成该食品对应的特征向量。
较佳的，还可以先基于该食品的多个样品的样品图像的颜色特征值确定该食品对应的颜色特征值区间，基于该食品的多个样品的样品图像的形状特征值确定该食品对应的形状特征值区间，以及基于该食品的多个样品的样品图像的纹理特征值确定该食品对应的纹理特征值区间；再基于该食品对应的颜色特征值区间、形状特征值区间和纹理特征值区间，确定该食品对应的特征向量。
相应的，在提取待识别食品图像的特征向量时，具体包括如下步骤：
提取待识别食品图像的颜色特征值、形状特征值和纹理特征值；基于待识别食品图像的颜色特征值、形状特征值和纹理特征值，确定该待识别食品图像的特征向量。
其中，在基于待识别食品图像的颜色特征值、形状特征值和纹理特征值，确定该待识别食品图像的特征向量时，具体可以将该待识别食品图像的颜色特征值、形状特征值和纹理特征值直接作为特征向量的分量，构成该待识别食品图像的特征向量。
较佳的，还可以先确定待识别食品图像的颜色特征值所在的颜色特征值预设区间，待识别食品图像的形状特征值所在的形状特征值预设区间和待识别食品图像的纹理特征值所在的纹理特征值预设区间；再基于颜色特征值预设区间、形状特征值预设区间和纹理特征值预设区间，确定待识别食品图像的特征向量。
步骤305、判断预设的分别对应不同食品的多个特征向量中，是否存在与待识别食品图像的特征向量之间的相关度大于预设值的特征向量。
当预设的分别对应不同食品的多个特征向量中，存在与待识别食品图像的特征向量之间的相关度大于预设值的特征向量时，进入步骤306；当预设的分别对应不同食品的多个特征向量中，不存在与待识别食品图像的特征向量之间的相关度大于预设值的特征向量时，则确定无法识别该食品，结束该食品识别流程。
步骤306、从预设的分别对应不同食品的多个特征向量中，选择与待识别食品图像的特征向量之间的相关度最大的特征向量，作为相匹配特征向量。
相关度越大，食品识别结果的可靠性越高。
步骤307、确定待识别食品图像中的食品为相匹配特征向量对应的食品。
上述食品识别方法结合了条码识别和图像识别，并且优先条码识别，相应的，本发明实施例1也可以采用优先图像识别的方案，或者采用条码识别和图像识别同时进行的方案，基于各自的识别结果确定最终的食品识别结果。
实施例2：
本发明实施例2中，在对冰箱内部进行拍摄时对多个指定储物位置进行拍摄。
图4所示为本发明实施例2提供的冰箱内食品存储位置记录方法的流程图，具体包括：
步骤401、获取拍摄冰箱内部多个指定储物位置所得到的食品采集图像。
该步骤具体也可以通过安置于冰箱内的图像采集装置实现。
步骤402、针对该多个指定储物位置中的每个指定储物位置，识别该食品采集图像中与该指定储物位置对应的指定区域内存在的食品。
即执行该步骤时，需要先在食品采集图像中确定出与每个指定储物位置对应的指定区域，再识别每个指定区域内存在的食品。
在进行食品识别时，具体也可采用上述实施例1步骤202中的食品识别方法，如图3所示，在此不再详述。
步骤403、针对该多个指定储物位置中的每个指定储物位置，记录在该食品采集图像中与该指定储物位置对应的指定区域内识别出的该食品存储在冰箱中该指定储物位置。
各食品存储位置被记录后，还可以向用户显示冰箱中已存储食品对应的食品图标及其在冰箱中的存储位置示意图，较佳的，可采用增强显示技术，以提高用户体验。
可见，采用本发明实施例提供的冰箱内食品存储位置记录方法，避免了人工进行手动输入食品存储位置，可以提高食品存储位置信息的录入效率，并且保证了信息的准确性。
实施例3：
基于同一发明构思，根据本发明上述实施例提供的冰箱内食品存储位置记录方法，相应地，本发明实施例3还提供一种冰箱内食品存储位置记录装置，其结构示意图如图5所示，具体包括：
获取单元501，用于获取拍摄冰箱内部指定储物位置所得到的食品采集图像；
识别单元502，用于识别该食品采集图像内存在的食品；
记录单元503，用于记录识别出的该食品存储在冰箱中指定储物位置。
进一步的，获取单元501，具体用于获取由冰箱内安置的多个图像采集装置中与冰箱内部指定储物位置对应的图像采集装置拍摄该指定储物位置所得到的食品采集图像；或者获取由冰箱内安置的图像采集装置按照与冰箱内部指定储物位置对应的预设拍摄角度拍摄该指定储物位置所得到的食品采集图像。
进一步的，获取单元501，具体用于获取拍摄冰箱内部多个指定储物位置所得到的食品采集图像；
识别单元502，具体用于针对该多个指定储物位置中的每个指定储物位置，识别该食品采集图像中与该指定储物位置对应的指定区域内存在的食品；
记录单元503，具体用于针对该多个指定储物位置中的每个指定储物位置，记录在该食品采集图像中与该指定储物位置对应的指定区域内识别出的该食品存储在冰箱中该指定储物位置。
进一步的，识别单元502，具体用于确定该食品采集图像内存在的待识别食品图像；当该待识别食品图像中存在食品标识条码时，确定该待识别食品图像中的食品为该食品标识条码表征的食品；当该待识别食品图像中不存在食品标识条码时，提取该待识别食品图像的特征向量；从预设的分别对应不同食品的多个特征向量中，选择与该待识别食品图像的特征向量之间的相关度大于预设值，且与该待识别食品图像的特征向量之间的相关度最大的特征向量，作为相匹配特征向量；确定该待识别食品图像中的食品为该相匹配特征向量对应的食品。
进一步的，识别单元502，具体用于提取该待识别食品图像的颜色特征值、形状特征值和纹理特征值；基于该待识别食品图像的颜色特征值、形状特征值和纹理特征值，确定该待识别食品图像的特征向量；
识别单元502，具体还用于提取同一种食品的多个样品的样品图像的颜色特征值、形状特征值和纹理特征值；基于该同一种食品的多个样品的样品图像的颜色特征值、形状特征值和纹理特征值，确定该食品对应的特征向量。
上述各单元的功能可对应于图1-4所示流程中的相应处理步骤，在此不再赘述。
实施例4：
本发明实施例4还提供一种智能控制终端，包括如图5所示的冰箱内食品存储位置记录装置。
实施例5：
本发明实施例5还提供一种冰箱，包括上述智能控制终端。
综上所述，本发明实施例提供的方案，包括：获取拍摄冰箱内部指定储物位置所得到的食品采集图像；识别该食品采集图像内存在的食品；记录识别出的该食品存储在冰箱中指定储物位置。采用本发明实施例提供的方案，能够提高冰箱内食品存储位置信息的录入效率。
本申请的实施例所提供的冰箱内食品存储位置记录装置可通过计算机程序实现。本领域技术人员应该能够理解，上述的单元划分方式仅是众多单元划分方式中的一种，如果划分为其他单元或不划分单元，只要冰箱内食品存储位置记录装置具有上述功能，都应该在本申请的保护范围之内。
本申请是参照根据本申请实施例的方法、设备（系统）、和计算机程序产品的流程图和／或方框图来描述的。应理解可由计算机程序指令实现流程图和／或方框图中的每一流程和／或方框、以及流程图和／或方框图中的流程和／或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器，使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和／或方框图一个方框或多个方框中指定的功能的装置。
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中，使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品，该指令装置实现在流程图一个流程或多个流程和／或方框图一个方框或多个方框中指定的功能。
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上，使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理，从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和／或方框图一个方框或多个方框中指定的功能的步骤。
显然，本领域的技术人员可以对本发明进行各种改动和变型而不脱离本发明的精神和范围。这样，倘若本发明的这些修改和变型属于本发明权利要求及其等同技术的范围之内，则本发明也意图包含这些改动和变型在内。
Claims (12)
- 一种冰箱内食品存储位置记录方法，其特征在于，包括：获取拍摄冰箱内部指定储物位置所得到的食品采集图像；识别所述食品采集图像内存在的食品；记录识别出的所述食品存储在冰箱中指定储物位置。
- 如权利要求1所述的方法，其特征在于，获取拍摄冰箱内部指定储物位置所得到的食品采集图像，具体为：获取由冰箱内安置的多个图像采集装置中与冰箱内部指定储物位置对应的图像采集装置拍摄所述指定储物位置所得到的食品采集图像；或者获取由冰箱内安置的图像采集装置按照与冰箱内部指定储物位置对应的预设拍摄角度拍摄所述指定储物位置所得到的食品采集图像。
- 如权利要求1所述的方法，其特征在于，获取拍摄冰箱内部指定储物位置所得到的食品采集图像，具体为：获取拍摄冰箱内部多个指定储物位置所得到的食品采集图像；识别所述食品采集图像内存在的食品，具体为：针对所述多个指定储物位置中的每个指定储物位置，识别所述食品采集图像中与该指定储物位置对应的指定区域内存在的食品；记录识别出的所述食品存储在冰箱中指定储物位置，具体为：针对所述多个指定储物位置中的每个指定储物位置，记录在所述食品采集图像中与该指定储物位置对应的指定区域内识别出的所述食品存储在冰箱中该指定储物位置。
- 如权利要求1所述的方法，其特征在于，识别所述食品采集图像内存在的食品，具体为：确定所述食品采集图像内存在的待识别食品图像；当所述待识别食品图像中存在食品标识条码时，确定所述待识别食品图像中的食品为所述食品标识条码表征的食品；当所述待识别食品图像中不存在食品标识条码时，提取所述待识别食品图像的特征向量；从预设的分别对应不同食品的多个特征向量中，选择与所述待识别食品图像的特征向量之间的相关度大于预设值，且与所述待识别食品图像的特征向量之间的相关度最大的特征向量，作为相匹配特征向量；确定所述待识别食品图像中的食品为所述相匹配特征向量对应的食品。
- 如权利要求4所述的方法，其特征在于，提取所述待识别食品图像的特征向量，具体为：提取所述待识别食品图像的颜色特征值、形状特征值和纹理特征值；基于所述待识别食品图像的颜色特征值、形状特征值和纹理特征值，确定所述待识别食品图像的特征向量；食品与特征向量的对应关系，具体采用如下方式建立：提取同一种食品的多个样品的样品图像的颜色特征值、形状特征值和纹理特征值；基于所述同一种食品的多个样品的样品图像的颜色特征值、形状特征值和纹理特征值，确定该食品对应的特征向量。
- 一种冰箱内食品存储位置记录装置，其特征在于，包括：获取单元，用于获取拍摄冰箱内部指定储物位置所得到的食品采集图像；识别单元，用于识别所述食品采集图像内存在的食品；记录单元，用于记录识别出的所述食品存储在冰箱中指定储物位置。
- 如权利要求6所述的装置，其特征在于，所述获取单元，具体用于获取由冰箱内安置的多个图像采集装置中与冰箱内部指定储物位置对应的图像采集装置拍摄所述指定储物位置所得到的食品采集图像；或者获取由冰箱内安置的图像采集装置按照与冰箱内部指定储物位置对应的预设拍摄角度拍摄所述指定储物位置所得到的食品采集图像。
- 如权利要求6所述的装置，其特征在于，所述获取单元，具体用于获取拍摄冰箱内部多个指定储物位置所得到的食品采集图像；所述识别单元，具体用于针对所述多个指定储物位置中的每个指定储物位置，识别所述食品采集图像中与该指定储物位置对应的指定区域内存在的食品；所述记录单元，具体用于针对所述多个指定储物位置中的每个指定储物位置，记录在所述食品采集图像中与该指定储物位置对应的指定区域内识别出的所述食品存储在冰箱中该指定储物位置。
- 如权利要求6所述的装置，其特征在于，所述识别单元，具体用于确定所述食品采集图像内存在的待识别食品图像；当所述待识别食品图像中存在食品标识条码时，确定所述待识别食品图像中的食品为所述食品标识条码表征的食品；当所述待识别食品图像中不存在食品标识条码时，提取所述待识别食品图像的特征向量；从预设的分别对应不同食品的多个特征向量中，选择与所述待识别食品图像的特征向量之间的相关度大于预设值，且与所述待识别食品图像的特征向量之间的相关度最大的特征向量，作为相匹配特征向量；确定所述待识别食品图像中的食品为所述相匹配特征向量对应的食品。
- 如权利要求9所述的装置，其特征在于，所述识别单元，具体用于提取所述待识别食品图像的颜色特征值、形状特征值和纹理特征值；基于所述待识别食品图像的颜色特征值、形状特征值和纹理特征值，确定所述待识别食品图像的特征向量；所述识别单元，具体还用于提取同一种食品的多个样品的样品图像的颜色特征值、形状特征值和纹理特征值；基于所述同一种食品的多个样品的样品图像的颜色特征值、形状特征值和纹理特征值，确定该食品对应的特征向量。
- 一种智能控制终端，其特征在于，包括如权利要求6-10任一所述的冰箱内食品存储位置记录装置。
- 一种冰箱，其特征在于，包括如权利要求11所述的智能控制终端。
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310086812 | 2013-03-18 | ||
| CN201310086812.8 | 2013-03-18 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2014146431A1 true WO2014146431A1 (zh) | 2014-09-25 |
Family
ID=51549584
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2013/086188 WO2014146431A1 (zh) | 2013-03-18 | 2013-10-30 | 一种冰箱内食品存储位置记录方法、装置、终端及冰箱 |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN104061748B (zh) |
| WO (1) | WO2014146431A1 (zh) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106642969A (zh) * | 2016-11-11 | 2017-05-10 | 青岛海尔特种电冰箱有限公司 | 冰箱的食物管理方法及冰箱 |
| CN106705564A (zh) * | 2016-11-11 | 2017-05-24 | 青岛海尔特种电冰箱有限公司 | 冰箱的控制方法及冰箱 |
| CN106958974A (zh) * | 2017-05-08 | 2017-07-18 | 青岛海尔特种电冰箱有限公司 | 基于食材的冰箱温度控制方法与计算机存储介质 |
| CN106958975A (zh) * | 2017-05-08 | 2017-07-18 | 青岛海尔特种电冰箱有限公司 | 基于食材的冰箱温度控制方法与计算机存储介质 |
| CN106979659A (zh) * | 2017-05-08 | 2017-07-25 | 青岛海尔特种电冰箱有限公司 | 基于食材的冰箱温度控制方法与计算机存储介质 |
| CN106979647A (zh) * | 2017-05-08 | 2017-07-25 | 青岛海尔特种电冰箱有限公司 | 基于食材的冰箱温度控制方法与计算机存储介质 |
| US10706314B2 (en) | 2016-03-23 | 2020-07-07 | Baidu Online Network Technology (Beijing) Co., Ltd. | Image recognition method, apparatus and device, and non-volatile computer storage medium |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107886028A (zh) * | 2016-09-29 | 2018-04-06 | 九阳股份有限公司 | 一种冰箱的食材录入方法及食材录入装置 |
| CN106369910B (zh) * | 2016-11-23 | 2019-04-16 | Tcl家用电器（合肥）有限公司 | 冰箱及冰箱控制方法 |
| CN107133650A (zh) * | 2017-05-10 | 2017-09-05 | 合肥华凌股份有限公司 | 冰箱的食物识别方法、装置及冰箱 |
| CN107144087A (zh) * | 2017-05-11 | 2017-09-08 | 海尔优家智能科技（北京）有限公司 | 一种智能物品管理方法、设备及存储介质 |
| CN107477971B (zh) * | 2017-08-04 | 2020-09-18 | 三星电子（中国）研发中心 | 一种对冰箱内食物的管理方法和设备 |
| CN109425192A (zh) * | 2017-08-28 | 2019-03-05 | 合肥美的智能科技有限公司 | 指示冰箱内食材位置的方法及系统 |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7716935B2 (en) * | 2005-05-27 | 2010-05-18 | Lg Electronics Inc. | Refrigerator for managing food by using RFID |
| CN101802532A (zh) * | 2007-09-13 | 2010-08-11 | Lg电子株式会社 | 冰箱 |
| CN102538379A (zh) * | 2011-12-19 | 2012-07-04 | 四川长虹电器股份有限公司 | 一种冰箱食品信息管理装置及方法 |
| KR20120097683A (ko) * | 2011-02-25 | 2012-09-05 | 삼성전자주식회사 | 냉장고 |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6892545B2 (en) * | 2000-02-28 | 2005-05-17 | Dai Nippon Printing Co., Ltd. | Automatic refrigerator system, refrigerator, automatic cooking system, and microwave oven |
| CN102032740B (zh) * | 2009-09-29 | 2013-06-05 | 爱国者电子科技有限公司 | 冰箱 |
| KR20120021622A (ko) * | 2010-08-11 | 2012-03-09 | 삼성전자주식회사 | 냉장고 및 그 제어방법 |
| CN202734418U (zh) * | 2012-03-16 | 2013-02-13 | 海尔集团公司 | 一种冰箱 |
| CN102818429A (zh) * | 2012-08-31 | 2012-12-12 | 合肥美菱股份有限公司 | 一种利用移动终端管理冰箱内食品的方法 |
-
2013
- 2013-06-28 CN CN201310269465.2A patent/CN104061748B/zh active Active
- 2013-10-30 WO PCT/CN2013/086188 patent/WO2014146431A1/zh active Application Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7716935B2 (en) * | 2005-05-27 | 2010-05-18 | Lg Electronics Inc. | Refrigerator for managing food by using RFID |
| CN101802532A (zh) * | 2007-09-13 | 2010-08-11 | Lg电子株式会社 | 冰箱 |
| KR20120097683A (ko) * | 2011-02-25 | 2012-09-05 | 삼성전자주식회사 | 냉장고 |
| CN102538379A (zh) * | 2011-12-19 | 2012-07-04 | 四川长虹电器股份有限公司 | 一种冰箱食品信息管理装置及方法 |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10706314B2 (en) | 2016-03-23 | 2020-07-07 | Baidu Online Network Technology (Beijing) Co., Ltd. | Image recognition method, apparatus and device, and non-volatile computer storage medium |
| CN106642969A (zh) * | 2016-11-11 | 2017-05-10 | 青岛海尔特种电冰箱有限公司 | 冰箱的食物管理方法及冰箱 |
| CN106705564A (zh) * | 2016-11-11 | 2017-05-24 | 青岛海尔特种电冰箱有限公司 | 冰箱的控制方法及冰箱 |
| CN106705564B (zh) * | 2016-11-11 | 2019-04-02 | 青岛海尔特种电冰箱有限公司 | 冰箱的控制方法及冰箱 |
| CN106958974A (zh) * | 2017-05-08 | 2017-07-18 | 青岛海尔特种电冰箱有限公司 | 基于食材的冰箱温度控制方法与计算机存储介质 |
| CN106958975A (zh) * | 2017-05-08 | 2017-07-18 | 青岛海尔特种电冰箱有限公司 | 基于食材的冰箱温度控制方法与计算机存储介质 |
| CN106979659A (zh) * | 2017-05-08 | 2017-07-25 | 青岛海尔特种电冰箱有限公司 | 基于食材的冰箱温度控制方法与计算机存储介质 |
| CN106979647A (zh) * | 2017-05-08 | 2017-07-25 | 青岛海尔特种电冰箱有限公司 | 基于食材的冰箱温度控制方法与计算机存储介质 |
| CN106979659B (zh) * | 2017-05-08 | 2019-08-02 | 青岛海尔特种电冰箱有限公司 | 基于食材的冰箱温度控制方法与计算机存储介质 |
| CN106958975B (zh) * | 2017-05-08 | 2019-08-02 | 青岛海尔特种电冰箱有限公司 | 基于食材的冰箱温度控制方法与计算机存储介质 |
| CN106979647B (zh) * | 2017-05-08 | 2019-10-01 | 青岛海尔特种电冰箱有限公司 | 基于食材的冰箱温度控制方法与计算机存储介质 |
| CN106958974B (zh) * | 2017-05-08 | 2020-03-17 | 青岛海尔特种电冰箱有限公司 | 基于食材的冰箱温度控制方法与计算机存储介质 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104061748B (zh) | 2016-07-06 |
| CN104061748A (zh) | 2014-09-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2014146431A1 (zh) | 一种冰箱内食品存储位置记录方法、装置、终端及冰箱 | |
| WO2014146430A1 (zh) | 一种冰箱内食品存储位置记录方法、装置、终端及冰箱 | |
| WO2014146432A1 (zh) | 一种冰箱内食品存储控制方法、智能控制终端及冰箱 | |
| WO2020149591A1 (en) | Method and apparatus for detecting abnormality of caller | |
| WO2019088462A1 (ko) | 혈압 추정 모델 생성 시스템 및 방법과 혈압 추정 시스템 및 방법 | |
| WO2017204596A1 (ko) | 얼굴 윤곽 보정 방법 및 장치 | |
| CN111225611B (zh) | 用于帮助分析目标对象中的伤口的系统和方法 | |
| WO2017096699A1 (zh) | 可提高指纹识别率的指纹识别方法及系统 | |
| WO2015034295A1 (en) | Method and apparatus for configuring and recommending device action using user context | |
| WO2017032187A1 (zh) | 自动捕捉目标物的方法、装置及存储介质 | |
| WO2016107230A1 (zh) | 一种3d场景中重现物体的系统和方法 | |
| WO2010041836A2 (en) | Method of detecting skin-colored area using variable skin color model | |
| WO2016165298A1 (zh) | 一种图像筛选方法及图像筛选系统 | |
| WO2017067290A1 (zh) | 指纹录入方法、装置及终端设备 | |
| WO2014133251A1 (ko) | 엘에스에이치 알고리즘의 자료조회결과의 특징점을 이용한 매칭포인트 추출시스템 및 그 방법 | |
| WO2016201738A1 (zh) | 基于网络医院平台的快速挂号方法和网络医院平台 | |
| CN112650882A (zh) | 一种视频采集方法、装置及系统 | |
| WO2020186777A1 (zh) | 图像检索方法、装置、设备及计算机可读存储介质 | |
| JP2006134008A (ja) | 営業店システム | |
| CN108090982A (zh) | 一种签到方法、系统及终端设备 | |
| CN108805751A (zh) | 自助登记入住方法、装置、存储介质及终端 | |
| WO2018058955A1 (zh) | 一种穿戴式终端的防丢失方法、系统及穿戴式终端 | |
| WO2019240330A1 (ko) | 영상 기반 힘 예측 시스템 및 그 방법 | |
| CN108540760A (zh) | 视频监控识别方法、装置和系统 | |
| CN112651273A (zh) | 一种ai智能摄像跟踪的方法 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 13878795 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 13878795 Country of ref document: EP Kind code of ref document: A1 |