WO2019125094A3 - 냉장고 및 냉장고의 물품 관리 방법 - Google Patents

냉장고 및 냉장고의 물품 관리 방법 Download PDF

Info

Publication number
WO2019125094A3
WO2019125094A3 PCT/KR2019/003744 KR2019003744W WO2019125094A3 WO 2019125094 A3 WO2019125094 A3 WO 2019125094A3 KR 2019003744 W KR2019003744 W KR 2019003744W WO 2019125094 A3 WO2019125094 A3 WO 2019125094A3
Authority
WO
WIPO (PCT)
Prior art keywords
article
image
article image
control part
refrigerator
Prior art date
Application number
PCT/KR2019/003744
Other languages
English (en)
French (fr)
Other versions
WO2019125094A2 (ko
Inventor
맹지찬
Original Assignee
엘지전자 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 엘지전자 주식회사 filed Critical 엘지전자 주식회사
Priority to US16/488,191 priority Critical patent/US11499773B2/en
Priority to PCT/KR2019/003744 priority patent/WO2019125094A2/ko
Priority to KR1020197020769A priority patent/KR20210134092A/ko
Publication of WO2019125094A2 publication Critical patent/WO2019125094A2/ko
Publication of WO2019125094A3 publication Critical patent/WO2019125094A3/ko

Links

Classifications

    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D29/00—Arrangement or mounting of control or safety devices
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/08—Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
    • G06Q10/087—Inventory or stock management, e.g. order filling, procurement or balancing against orders
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/10—Image acquisition
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D2400/00—General features of, or devices for refrigerators, cold rooms, ice-boxes, or for cooling or freezing apparatus not covered by any other subclass
    • F25D2400/36—Visual displays
    • F25D2400/361—Interactive visual displays
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D2500/00—Problems to be solved
    • F25D2500/06—Stock management
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D2700/00—Means for sensing or measuring; Sensors therefor
    • F25D2700/02—Sensors detecting door opening

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • Software Systems (AREA)
  • Artificial Intelligence (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • Mathematical Physics (AREA)
  • Computing Systems (AREA)
  • Economics (AREA)
  • Biomedical Technology (AREA)
  • Molecular Biology (AREA)
  • General Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • Biophysics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Mechanical Engineering (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Thermal Sciences (AREA)
  • Marketing (AREA)
  • Quality & Reliability (AREA)
  • Finance (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Human Resources & Organizations (AREA)
  • Accounting & Taxation (AREA)
  • Operations Research (AREA)
  • Development Economics (AREA)
  • Strategic Management (AREA)
  • Tourism & Hospitality (AREA)
  • General Business, Economics & Management (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Medical Informatics (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Cold Air Circulating Systems And Constructional Details In Refrigerators (AREA)

Abstract

본 발명에 따른 냉장고는, 물품을 저장하는 저장실과, 저장실 내부를 촬영하는 카메라와, 카메라를 통해 촬영된 제1물품영상을 비전인식하여 제1물품영상에 대응되는 물품 정보를 획득하는 제어부와, 획득된 물품 정보를 저장하여 물품 영상 히스토리를 생성하는 메모리와, 제어부와 전기적으로 연결된 디스플레이를 포함한다. 또, 제어부는, 카메라를 통해서 일부가 타 물품에 의해 가려진 상태의 제2물품영상을 획득하고, 제2물품영상에서 일부가 타 물품에 의해 가려진 부분 물품 이미지를 검출하고, 물품 영상 히스토리에 근거하여 부분 물품 이미지와 매칭되는 물품을 확인할 수 있다. 그리고, 해당 부분 물품 이미지를 물품 영상 히스토리에서 확인된 물품 정보와 연계하여서 디스플레이에 디스플레이하도록 제어할 수 있다.
PCT/KR2019/003744 2019-03-29 2019-03-29 냉장고 및 냉장고의 물품 관리 방법 WO2019125094A2 (ko)

Priority Applications (3)

Application Number Priority Date Filing Date Title
US16/488,191 US11499773B2 (en) 2019-03-29 2019-03-29 Refrigerator and method for managing articles in refrigerator
PCT/KR2019/003744 WO2019125094A2 (ko) 2019-03-29 2019-03-29 냉장고 및 냉장고의 물품 관리 방법
KR1020197020769A KR20210134092A (ko) 2019-03-29 2019-03-29 냉장고 및 냉장고의 물품 관리 방법

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/KR2019/003744 WO2019125094A2 (ko) 2019-03-29 2019-03-29 냉장고 및 냉장고의 물품 관리 방법

Publications (2)

Publication Number Publication Date
WO2019125094A2 WO2019125094A2 (ko) 2019-06-27
WO2019125094A3 true WO2019125094A3 (ko) 2020-02-13

Family

ID=66992797

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2019/003744 WO2019125094A2 (ko) 2019-03-29 2019-03-29 냉장고 및 냉장고의 물품 관리 방법

Country Status (3)

Country Link
US (1) US11499773B2 (ko)
KR (1) KR20210134092A (ko)
WO (1) WO2019125094A2 (ko)

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102234691B1 (ko) * 2019-08-09 2021-04-02 엘지전자 주식회사 인공 지능을 이용하여, 물품을 관리하는 냉장고 및 그의 동작 방법
CN114294897A (zh) * 2021-04-19 2022-04-08 海信视像科技股份有限公司 冰箱及食材图标显示方法
CN113076907B (zh) * 2021-04-16 2023-03-21 青岛海尔电冰箱有限公司 冰箱内物品信息标识方法、冰箱和计算机存储介质
KR20230175257A (ko) * 2021-07-27 2023-12-29 엘지전자 주식회사 제품 재고를 관리하기 위한 냉장고 및 그 방법
US20230097905A1 (en) * 2021-09-24 2023-03-30 Haier Us Appliance Solutions, Inc. Inventory management system in a refrigerator appliance
CN113849582A (zh) * 2021-09-29 2021-12-28 珠海格力电器股份有限公司 物品存取方法、装置、设备及存储介质
CN113947770B (zh) * 2021-12-13 2022-03-08 广州微林软件有限公司 一种识别物体放置于智能箱柜不同区域的方法
CN114882349B (zh) * 2022-03-29 2024-05-24 青岛海尔制冷电器有限公司 冰箱内物品目标同一性判断方法、冰箱和计算机存储介质
CN114708503A (zh) * 2022-03-31 2022-07-05 青岛海尔电冰箱有限公司 冰箱瓶座内物品信息识别方法、冰箱和计算机存储介质
US11800068B1 (en) 2022-04-07 2023-10-24 Haier Us Appliance Solutions, Inc. Refrigerator camera modules and methods for conserving energy at the same
US20230368131A1 (en) * 2022-05-16 2023-11-16 365 Retail Markets, Llc Distance-based product event detection
US11796250B1 (en) * 2022-10-03 2023-10-24 Haier Us Appliance Solutions, Inc. Multi-camera vision system facilitating detection of door position using audio data
CN116202297A (zh) * 2023-01-17 2023-06-02 珠海格力电器股份有限公司 一种冰箱的控制方法、装置、设备及存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006338059A (ja) * 2003-08-07 2006-12-14 Matsushita Electric Ind Co Ltd 物品管理システム及びその制御用プログラム並びにその制御方法
JP2007046834A (ja) * 2005-08-09 2007-02-22 Funai Electric Co Ltd 物品保存庫、物品保存庫監視システム及び冷蔵庫監視システム
JP2010121784A (ja) * 2008-11-17 2010-06-03 Toshiba Corp 冷蔵庫の在庫管理装置
KR20120117464A (ko) * 2011-04-15 2012-10-24 엘지전자 주식회사 냉장고 및 냉장고의 제어방법
WO2014168265A1 (ko) * 2013-04-10 2014-10-16 엘지전자 주식회사 영상 인식을 이용한 냉장고의 보관 품목 관리 방법 및 그 냉장고

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8103115B2 (en) * 2007-02-26 2012-01-24 Sony Corporation Information processing apparatus, method, and program
KR101821818B1 (ko) * 2011-09-22 2018-01-24 엘지전자 주식회사 전기제품의 제어방법
US10438164B1 (en) * 2016-09-27 2019-10-08 Amazon Technologies, Inc. Merging events in interactive data processing systems
KR102327848B1 (ko) * 2017-05-18 2021-11-18 삼성전자주식회사 냉장고 및 냉장고의 음식 관리방법
US10949799B2 (en) * 2018-06-29 2021-03-16 Focal Systems, Inc. On-shelf image based out-of-stock detection

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006338059A (ja) * 2003-08-07 2006-12-14 Matsushita Electric Ind Co Ltd 物品管理システム及びその制御用プログラム並びにその制御方法
JP2007046834A (ja) * 2005-08-09 2007-02-22 Funai Electric Co Ltd 物品保存庫、物品保存庫監視システム及び冷蔵庫監視システム
JP2010121784A (ja) * 2008-11-17 2010-06-03 Toshiba Corp 冷蔵庫の在庫管理装置
KR20120117464A (ko) * 2011-04-15 2012-10-24 엘지전자 주식회사 냉장고 및 냉장고의 제어방법
WO2014168265A1 (ko) * 2013-04-10 2014-10-16 엘지전자 주식회사 영상 인식을 이용한 냉장고의 보관 품목 관리 방법 및 그 냉장고

Also Published As

Publication number Publication date
KR20210134092A (ko) 2021-11-09
US11499773B2 (en) 2022-11-15
US20200033052A1 (en) 2020-01-30
WO2019125094A2 (ko) 2019-06-27

Similar Documents

Publication Publication Date Title
WO2019125094A3 (ko) 냉장고 및 냉장고의 물품 관리 방법
EP4254285A3 (en) Refrigerator, server and method of controlling thereof
CN107864678B (zh) 对视觉指示器的检测和解译
US9813597B2 (en) Gaze tracker and method for tracking gaze thereof
CN105225217B (zh) 基于深度的背景模型更新方法和系统
GB2583243A (en) Blockchain validation system
ES2765519T3 (es) Procedimiento y dispositivo para enviar y recibir información sobre un artículo
CN109631456A (zh) 冰箱
JP2016196981A (ja) 庫内管理システムおよび庫内管理方法
WO2011001398A3 (en) Method circuit and system for matching an object or person present within two or more images
RU2016115038A (ru) Способ и устройство для распознавания объекта
KR20120117464A (ko) 냉장고 및 냉장고의 제어방법
WO2018014109A8 (en) System and method for analyzing and searching for features associated with objects
JP7164296B2 (ja) 冷蔵庫
JP7113281B2 (ja) 冷蔵庫
JP2016148503A (ja) 冷蔵庫、冷蔵庫管理方法及びプログラム
WO2019135670A3 (ko) 냉장고 및 냉장고의 물품 관리 방법
JP2015511831A5 (ko)
US20200225745A1 (en) Training of a gaze tracking model
JP2018163524A5 (ko)
US20180240247A1 (en) Generating a disparity map having reduced over-smoothing
CN108037830A (zh) 一种增强现实的实现方法
JP2018084408A (ja) 収納装置
CN114882349B (zh) 冰箱内物品目标同一性判断方法、冰箱和计算机存储介质
US20210012105A1 (en) Method and system for 3d cornea position estimation

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19732224

Country of ref document: EP

Kind code of ref document: A2