WO2022262683A1 - 制冷电器中的库存管理系统 - Google Patents

制冷电器中的库存管理系统 Download PDF

Info

Publication number
WO2022262683A1
WO2022262683A1 PCT/CN2022/098441 CN2022098441W WO2022262683A1 WO 2022262683 A1 WO2022262683 A1 WO 2022262683A1 CN 2022098441 W CN2022098441 W CN 2022098441W WO 2022262683 A1 WO2022262683 A1 WO 2022262683A1
Authority
WO
WIPO (PCT)
Prior art keywords
scanning device
contact scanning
sensor
refrigeration appliance
controller
Prior art date
Application number
PCT/CN2022/098441
Other languages
English (en)
French (fr)
Inventor
柳春宰
基里亚科斯特法诺斯
Original Assignee
海尔智家股份有限公司
青岛海尔电冰箱有限公司
海尔美国电器解决方案有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 海尔智家股份有限公司, 青岛海尔电冰箱有限公司, 海尔美国电器解决方案有限公司 filed Critical 海尔智家股份有限公司
Priority to CN202280042115.XA priority Critical patent/CN117480351A/zh
Publication of WO2022262683A1 publication Critical patent/WO2022262683A1/zh

Links

Images

Classifications

    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D29/00—Arrangement or mounting of control or safety devices
    • F25D29/005—Mounting of control devices
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D29/00—Arrangement or mounting of control or safety devices
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88—Radar or analogous systems specially adapted for specific applications
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D2500/00—Problems to be solved
    • F25D2500/06—Stock management
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D2700/00—Means for sensing or measuring; Sensors therefor
    • F25D2700/06—Sensors detecting the presence of a product

Definitions

  • the present invention relates generally to refrigeration appliances, and more particularly to a method of operating an inventory management system in a refrigeration appliance.
  • Refrigerated appliances typically include a cabinet defining a refrigerated compartment for receiving food for storage. Additionally, the refrigerated appliance includes one or more doors that are rotatably hinged to the cabinet to allow selective access to food products stored in the refrigerated compartment.
  • the refrigerating appliance may also include various storage components installed in the refrigerating compartment and designed to facilitate storing food therein. Such storage components may include shelves, boxes, shelves or drawers that receive food items within the refrigerated compartment and assist in organizing and arranging such food items.
  • Certain conventional refrigeration appliances include camera devices for monitoring food as it is added to or removed from the refrigeration appliance.
  • camera devices are useful for imaging and/or identifying specific objects, they are often unable to accurately identify the location of the object within the refrigerated compartment.
  • some conventional refrigeration appliances may include weight sensors to detect when objects are added to the shelves. However, cameras or weight sensors alone cannot usually be used alone to determine the precise location of the food item.
  • a refrigeration appliance with a system for improved inventory management would be useful. More particularly, a refrigeration appliance that includes an inventory management system capable of monitoring the entry and exit of inventory and the location of items within the refrigeration compartment would be particularly beneficial.
  • a refrigeration appliance comprising: a cabinet defining a refrigeration compartment; a door rotatably hinged to the cabinet to provide selective access to the refrigeration compartment a non-contact scanning device mounted to the cabinet for monitoring the refrigerated compartment; and a controller operatively coupled to the non-contact scanning device.
  • the controller is configured to detect motion of an object at one or more locations within the refrigerated compartment and determine the position of the object within the refrigerated compartment using the non-contact scanning device.
  • an inventory management system for a refrigeration appliance includes a cabinet defining a refrigeration compartment.
  • the inventory management system includes: a non-contact scanning device mounted to the cabinet for monitoring the refrigerated compartment; and a controller operably coupled to the non-contact scanning device, the controller being configured to Motion of an object at one or more locations within the refrigerated compartment is detected and the location of the object is determined using a non-contact scanning device.
  • FIG. 1 provides a perspective view of a refrigeration appliance according to an exemplary embodiment of the present invention.
  • FIG. 2 provides a perspective view of the exemplary refrigeration appliance of FIG. 1 , with the door of the fresh food compartment shown in an open position to reveal the inventory management system, according to an exemplary embodiment of the present invention.
  • FIG. 3 provides a side view of the exemplary food fresher and inventory management system of FIG. 2 in accordance with an exemplary embodiment of the present invention.
  • FIG. 4 provides a side view of the exemplary food fresher and inventory management system of FIG. 2 according to another exemplary embodiment of the present invention.
  • FIG. 5 provides a side view of the exemplary food fresher and inventory management system of FIG. 2 according to another exemplary embodiment of the present invention.
  • FIG. 6 provides a side view of the exemplary food fresher and inventory management system of FIG. 2 according to another exemplary embodiment of the present invention.
  • upstream refers to where the fluid flow is coming from, while “downstream” refers to the direction the fluid flow is going.
  • upstream refers to where the fluid flow is coming from
  • downstream refers to the direction the fluid flow is going.
  • includes and “including” are intended to be inclusive in a manner similar to the term “comprising”.
  • the term “or” is generally intended to be inclusive (ie, "A or B” is intended to mean “A or B or both”).
  • Approximate language is used to modify any quantitative representation that is amenable to variation without resulting in a change in the basic function to which it is related. Accordingly, a value modified by terms such as “about,” “approximately,” and “approximately” is not to be limited to the precise value specified. In at least some cases, the approximate language may correspond to the precision of the instrument used to measure the value. For example, approximate language can mean within a 10% range.
  • FIG. 1 provides a perspective view of an exemplary refrigeration appliance 100
  • FIG. 2 illustrates some refrigeration appliances 100 with doors in open positions.
  • the refrigeration appliance 100 generally defines a vertical V, a lateral L and a lateral T, and each of the vertical V, the lateral L and the lateral T is perpendicular to each other so as to generally define an orthogonal coordinate system.
  • cooling appliance 100 includes a housing 102, which is generally configured to house and/or support various components of cooling appliance 100, and may also define one or more interior chambers or compartments of cooling appliance 100. room.
  • the terms "casing”, “housing”, etc. are generally intended to refer to the outer frame or support structure for refrigeration appliance 100, including, for example, any suitable number of , type and configuration of support structures, such as systems of elongated support members, multiple interconnected panels, or some combination thereof.
  • the cabinet 102 does not necessarily need to be enclosed, but may simply comprise an open structure supporting the various components of the refrigeration appliance 100 . Rather, the case 102 may enclose some or all of the interior of the case 102 .
  • the tank 102 may have any suitable size, shape and configuration while remaining within the scope of the present invention.
  • the case 102 generally extends along a vertical direction V between a top 104 and a bottom 106, and along a lateral direction L between a first side 108 (e.g., the left side when viewed from the front as in FIG. 1 ) and a second side. Extending between sides 110 (eg, the right side as viewed from the front in FIG. 1 ) and along a lateral direction T between a front 112 and a rear 114 .
  • terms such as “left”, “right”, “front”, “rear”, “top” or “bottom” are used with reference to the viewing angle from which a user approaches the cooling appliance appliance 100 .
  • Housing 102 defines a refrigerated compartment for receiving food for storage.
  • the housing 102 defines a fresh food compartment 122 disposed at or adjacent the top 104 of the housing 102 and a freezer compartment 124 disposed at or adjacent the bottom 106 of the housing 102 .
  • the refrigeration appliance 100 is generally called a bottom-mounted refrigerator.
  • the benefits of the present invention apply to other types and styles of cooling appliances, such as ceiling mounted cooling appliances, side by side cooling appliances, or single door cooling appliances.
  • aspects of the invention may also be applicable to other electrical appliances. Accordingly, the descriptions set forth herein are for example purposes only and are not intended to be limited in any way to any particular appliance or configuration.
  • Refrigerator door 128 is rotatably hinged to the edge of housing 102 for selective access to fresh food compartment 122 .
  • a freezer door 130 is disposed below the refrigerator door 128 to selectively enter the freezer compartment 124 .
  • Freezer door 130 is coupled to a freezer drawer (not shown) slidably mounted within freezer compartment 124 .
  • refrigeration door 128 forms a seal over front opening 132 (eg, extending in a plane defined by vertical V and lateral L) defined by bin 102 .
  • front opening 132 eg, extending in a plane defined by vertical V and lateral L
  • Refrigerator door 128 and freezer door 130 are shown in a closed configuration in FIG. 1 .
  • FIG. 1 Those skilled in the art will understand that other chamber and door configurations are possible and within the scope of the present invention.
  • FIG. 2 provides a perspective view of refrigeration appliance 100 shown with refrigeration door 128 in an open position.
  • various storage components are mounted within the food preservation compartment 122 to facilitate storage of food products therein, as will be understood by those skilled in the art.
  • storage components may include boxes 134 and shelves 136 . Each of these storage components is used to receive food (eg, beverages or/or solid food) and can assist in organizing such food.
  • the box 134 can be mounted on the refrigerator door 128 or can be slid into a receiving space in the fresh food compartment 122 .
  • the storage components shown are for illustrative purposes only and that other storage components may be used and may have different sizes, shapes, and configurations.
  • Dispensing assembly 140 is typically used to dispense liquid water and/or ice. While an exemplary dispensing assembly 140 has been illustrated and described herein, it should be understood that various changes and modifications may be made to the dispensing assembly 140 while remaining within the scope of the invention.
  • the dispensing assembly 140 and its various components may be at least partially disposed within a dispenser recess 142 defined on one of the refrigeration doors 128.
  • a dispenser recess 142 is defined on the front side 112 of the refrigeration appliance 100 such that a user may operate the dispensing assembly 140 without opening the refrigeration door 128 .
  • the dispenser recess 142 is provided at a predetermined height, which is convenient for a user to take ice and enables the user to take ice without bending over.
  • the dispenser recess 142 is disposed at approximately the level of the user's chest.
  • Dispensing assembly 140 includes an ice dispenser 144 that includes a drain 146 for discharging ice from dispensing assembly 140 .
  • An actuation mechanism 148 shown as a paddle, is mounted below the drain opening 146 to operate the ice or water dispenser 144 .
  • any suitable actuation mechanism may be used to operate ice dispenser 144 .
  • ice dispenser 144 may include a sensor (such as an ultrasonic sensor) or a button instead of a paddle.
  • Drain 146 and actuation mechanism 148 are external parts of ice dispenser 144 and are mounted in dispenser recess 142 .
  • refrigerator door 128 may define an ice bin compartment 150 (FIG. 2) that houses an ice maker and ice storage bin (not shown) configured to supply ice to a dispensing device recess 142.
  • a control panel 152 is provided to control the mode of operation.
  • the control panel 152 includes one or more selection inputs 154, such as knobs, buttons, touch screen interface, etc., such as a water dispense button and an ice dispense button, for selecting a desired mode of operation, such as crushed or non-crushed ice.
  • input 154 may be used to specify a fill volume or method of operating dispense assembly 140 .
  • the input 154 may communicate with a processing device or controller 156 . Signals generated in controller 156 operate refrigeration appliance 100 and dispensing assembly 140 in response to selector input 154 .
  • a display 158 such as an indicator light or a screen, may be provided on the control panel 152 . Display 158 may be in communication with controller 156 and may display information in response to signals from controller 156 .
  • processing device may refer to one or more microprocessors or semiconductor devices, and is not necessarily limited to a single element.
  • the processing device may be programmed to operate the refrigeration appliance 100 , the dispensing assembly 140 , and other components of the refrigeration appliance 100 .
  • the processing device may include or be associated with one or more storage elements (eg, persistent storage media).
  • the storage element comprises an electrically erasable programmable read-only memory (EEPROM).
  • EEPROM electrically erasable programmable read-only memory
  • a memory element may store information accessible to a processing device, including instructions executable by the processing device.
  • the instructions may be software or any collection of instructions and/or data which, when executed by the processing means, cause the processing means to perform operations.
  • external communication system 170 is used to allow interaction, data transfer, and other communications between refrigeration appliance 100 and one or more external devices.
  • the communication may be used to provide and receive operating parameters, user instructions or notifications, performance characteristics, user preferences, or any other suitable information for improved performance of the refrigeration appliance 100 .
  • external communication system 170 may be used to communicate data or other information to enhance the performance of one or more external devices or appliances and/or to improve user interaction with such devices.
  • external communication system 170 allows controller 156 of cooling appliance 100 to communicate with a separate device external to cooling appliance 100 , generally referred to herein as external device 172 . As described in more detail below, these communications may be facilitated using wired or wireless connections, such as via network 174 .
  • external device 172 may be any suitable device separate from refrigeration appliance 100 that is configured to provide and/or receive communications, information, data, or commands to a user.
  • the external device 172 may be, for example, a personal phone, smart phone, tablet, laptop or personal computer, wearable device, smart home system, or another mobile or remote device.
  • remote server 176 may communicate with refrigeration appliance 100 and/or external device 172 over network 174 .
  • the remote server 176 may be a cloud-based server 176 and thus be located at a remote location, such as in a separate state, country, or the like.
  • external device 172 may communicate with remote server 176 over network 174, such as the Internet, to send/receive data or information, provide user input, receive user notifications or instructions, interact with or control refrigeration appliance 100 Wait.
  • external device 172 and remote server 176 may communicate with refrigeration appliance 100 to communicate similar information.
  • remote server 176 may be configured to receive and analyze images obtained by camera assembly 250, for example, to facilitate inventory analysis.
  • refrigeration appliance 100 may be performed using any type of wired or wireless connection and using any suitable type of communication network, provided below A non-limiting example of .
  • external device 172 may communicate directly or indirectly with refrigeration appliance 100 via any suitable wired or wireless communication connection or interface (eg, network 174 ).
  • network 174 may include one or more of a local area network (LAN), wide area network (WAN), personal area network (PAN), the Internet, a cellular network, any other suitable short-range or long-range wireless network, and the like.
  • any suitable communication means or protocol may be used, such as via radio, laser, infrared, Ethernet type devices and interfaces, etc.) to send communications.
  • Such communications may use various communication protocols (e.g., TCP/IP, HTTP, SMTP, FTP), encodings or formats (e.g., HTML, XML), and/or protection schemes (e.g., VPN, Secure HTTP, SSL) .
  • TCP/IP Transmission Control Protocol/IP
  • HTTP HyperText Transfer Protocol
  • SMTP Simple Transfer Protocol
  • FTP FTP
  • encodings or formats e.g., HTML, XML
  • protection schemes e.g., VPN, Secure HTTP, SSL
  • An external communication system 170 according to an exemplary embodiment of the present invention is described herein.
  • the exemplary functions and configurations of the external communication system 170 provided herein are used as examples only in order to facilitate describing aspects of the present invention.
  • System configurations may vary, other communication means may be used to communicate directly or indirectly with one or more associated appliances, other communication protocols and procedures may be implemented, etc. Such changes and modifications are considered to be within the scope of the present invention.
  • the refrigeration appliance 100 may also include an inventory management system 200 that is generally configured to monitor one or more chambers of the refrigeration appliance 100 to monitor the addition or removal of inventory. More specifically, as described in more detail below, the inventory management system 200 may include a plurality of sensors, cameras, or other detection devices for monitoring the fresh food compartment 122 to detect A retrieved object (eg, generally identified by reference numeral 202). In this regard, inventory management system 200 may use data from each of these devices to obtain a complete representation or knowledge of the identity, weight, location, and/or other qualitative or quantitative characteristics of objects 202 within food storage compartment 122 . Although inventory management system 200 is described herein as monitoring fresh food compartment 122 to detect object 202, it should be understood that aspects of the invention may be used to monitor objects or items in any other suitable appliance, compartment, or the like.
  • the inventory management system 200 may include one or more non-contact scanning devices 210 mounted within the cabinet 102 for monitoring the fresh food compartment 122 . More specifically, non-contact scanning device 210 is generally configured to detect motion of an object, such as object 202 at one or more locations within fresh food compartment 122, and determine the precise location of object 202 within fresh food compartment 122. . For example, non-contact scanning device 210 may be used to determine that object 202 has been placed on lower shelf 136 and the precise location of object 202 in the horizontal plane (eg, rear left of shelf 136 ).
  • non-contact scanning device 210 may include any suitable number, type, location, and configuration of sensors or devices for identifying the location or orientation of an object.
  • the non-contact scanning device 210 may include at least one of a proximity sensor, a time-of-flight sensor, an infrared sensor, or an optical sensor.
  • the non-contact scanning device 210 may include a Light Detection and Ranging (LiDAR) sensor.
  • LiDAR Light Detection and Ranging
  • a LiDAR system may be positioned at any suitable location within the fresh food compartment 122 (or within view of the fresh food compartment 122), and may include a transmitter and a receiver.
  • the transmitter and receiver are mounted on a single microchip or within a single device, as generally identified as non-contact scanning device 210, although other configurations are possible.
  • non-contact scanning device 210 may generally be configured to map object 202 and surrounding surfaces within fresh food compartment 122 .
  • a transmitter may be any form of energy source that may be measured or detected by a receiver, eg, for detecting the presence, position, geometry and/or orientation of object 202 .
  • the transmitter and receiver are optical tracking systems or laser tracking systems.
  • the transmitter may comprise a laser diode or other suitable energy source for generating an energy beam (as generally identified by reference numeral 212).
  • energy beam 212 may be any suitable form of electromagnetic energy having any suitable wavelength.
  • energy beam 212 is electromagnetic energy having a wavelength between approximately 500 and 1200 nm, or between approximately 700 and 1000 nm, or any other suitable wavelength.
  • energy beam 212 is infrared light having a wavelength of approximately 940 nm.
  • receivers may include optical sensors or other suitable detectors or sensors.
  • the transmitter and receiver may generally define and operate as a LiDAR system, for example, for monitoring the energy beam 212 after it has reflected off the object 202, shelf 136, cabinet 102, etc. detection.
  • the transmitter and receiver may rely on electromagnetic or other principles of optical or sonar means to detect the position and geometric data of the object 202 .
  • the non-contact scanning device 210 may include a radio wave based radio detection and ranging (radar) sensor. Other means for measuring this data are possible and within the scope of the present invention.
  • the inventory management system 200 may include any suitable number, type, and location of non-contact scanning devices 210 to enable proper mapping of all areas of the fresh food compartment 122 in accordance with exemplary embodiments of the present invention.
  • inventory management system 200 may include a single non-contact scanning device positioned proximate to the top rear corner of food preservation compartment 122 (e.g., between top 104 and rear 114 of cabinet 102 ). place).
  • the field of view of the non-contact scanning device 210 may be oriented forward along the lateral direction T toward the front opening 132 and/or downward along the vertical direction V. As shown in FIG.
  • non-contact scanning device 210 may begin monitoring object 202 before it enters fresh food compartment 122 . It is worth noting, however, that the non-contact scanning device 210 could be oriented forwards, as it would not introduce the same privacy issues as a camera being positioned in the same location and oriented in the same manner.
  • the inventory management system 200 may optionally include a plurality of non-contact scanning devices 210 , eg, as exemplified in FIG. 4 .
  • a plurality of non-contact scanning devices 210 may be spaced along the vertical V and on the rear wall 214 of the fresh food compartment 122 .
  • Each of these non-contact scanning devices 210 may be oriented such that their field of view is directed forward along the lateral direction T.
  • each non-contact scanning device may be pivotally mounted such that its angular orientation may be adjusted using the drive mechanism.
  • non-contact scanning device 210 includes a three-dimensional LiDAR system or sensor.
  • a single one-dimensional laser scanning device or LiDAR sensor may be used.
  • a single one-dimensional non-contact scanning device 210 e.g., a one-dimensional LiDAR sensor
  • the inventory management system 200 may also A series of mirrors 216 spaced at desired locations within the fresh food compartment 122 are included.
  • the emitters of the one-dimensional LiDAR system may emit beams of energy 212 that reflect off of the respective mirrors 216 such that a single sensor may obtain information about respective regions proximate to the respective mirrors 216 .
  • Other sensor and mirror configurations are possible and within the scope of the invention.
  • inventory management system 200 may also include a positioning system 220 mounted within housing 102 and generally configured to selectively position one or more contactless scanning devices 210 .
  • positioning system 220 includes one or more elongated rails (eg, generally identified by reference numeral 222 ). More specifically, the positioning system 220 may include a first rail 224 mounted to a top wall 226 of the fresh food compartment 122 and oriented along a lateral direction T. As shown in FIG. As shown, the first rail 224 generally extends from the rear wall 214 to the front opening 132 and is used to support the single (or multiple) non-contact scanning devices 210 .
  • the positioning system 220 may include a second rail 228 mounted to the rear wall 214 of the fresh food compartment 122 and generally oriented along the vertical V. As shown in FIG. Second rail 228 may generally be used to receive auxiliary non-contact scanning device 210 , which may be the same as or similar to non-contact scanning device 210 . According to an exemplary embodiment, non-contact scanning device 210 and auxiliary non-contact scanning device 210 are generally slidably coupled to first rail 224 and second rail 228 , respectively.
  • positioning system 220 may also include a belt drive system 240 operable by a controller (eg, controller 156) to selectively position the scanning device along the track.
  • controller 156 may selectively move non-contact scanning devices 210 along their respective elongated rails 222 to obtain a desired field of view and generate a complete map of fresh food compartment 122 and objects 202 disposed therein.
  • the drive system for positioning system 220 is illustrated as belt drive system 240, it should be understood that any other suitable drive system or mechanism may be used while remaining within the scope of the present invention.
  • each non-contact scanning device 210 may be pivotally mounted to a corresponding elongated track 222 via a motor mount (not shown), such that the controller 156 may cause the non-contact scanning device 210 to selectively move relative to the elongated track 222 .
  • the long track 222 pivots.
  • the non-contact scanning device 210 may be used to obtain or determine the location of the object 202 within the fresh food compartment 122 .
  • the inventory management system 200 may also include a camera assembly 250, which is generally configured and used to obtain images of the refrigeration appliance 100 during operation.
  • camera assembly 250 includes a plurality of camera devices 252 mounted to cabinet 102 , door 128 or otherwise positioned within view of food preservation compartment 122 .
  • camera assembly 250 is described herein as being used to monitor fresh food compartment 122 of refrigeration appliance 100 , it should be understood that aspects of the invention may be used to monitor any other suitable area of any other suitable appliance, such as freezer compartment 124 .
  • a plurality of cameras 252 of a camera assembly 250 are disposed about the fresh food compartment 122 and are generally oriented toward a particular area or monitoring location.
  • the field of view of each camera 252 may be limited or focused on a particular area within the fresh food compartment 122 . It is worth noting, however, that it may be desirable to position each camera 252 proximate the front opening 132 of the fresh food compartment 122 and to orient each camera 252 such that the field of view is directed into the fresh food compartment 122 . In this way, privacy concerns related to obtaining images of the user of the appliance 100 may be mitigated or completely avoided.
  • camera assembly 250 may be used to facilitate the inventory management process of refrigeration appliance 100 .
  • various camera devices 252 may be positioned at openings of the fresh food compartment 122 to monitor food items (generally identified as objects 202 ) being added to or removed from the fresh food compartment 122 .
  • cameras 252 are spaced apart along vertical V such that each camera 252 has a field of view in a particular area (e.g., top shelf, middle shelf, bottom shelf), and camera assemblies 250 There is a substantially complete view of the fresh food compartment 122 as a whole.
  • camera assembly 250 is generally used to monitor access to fresh food compartment 122 , eg, to monitor food items being added to or removed from fresh food compartment 122 , as described in more detail below.
  • each camera device 252 may be oriented in any other suitable manner for monitoring any other suitable area in or around the refrigeration appliance 100 .
  • camera assembly 250 may include any suitable number, type, size, and configuration of camera devices 252 for obtaining images of any suitable zone or area in or around refrigeration appliance 100 according to alternative embodiments.
  • each camera 252 may include features for adjusting the field of view and/or orientation.
  • the images obtained by the camera assembly 250 may vary in number, frequency, angle, resolution, detail, etc., in order to enhance the clarity of certain areas around or within the refrigeration appliance 100 .
  • the controller 156 may be configured to illuminate the refrigerated compartment with one or more light sources prior to obtaining an image.
  • controller 156 (or any other suitable dedicated controller) of refrigeration appliance 100 can be communicatively coupled to camera assembly 250 and can be programmed or used to analyze images obtained by camera assembly 250, for example, to Items that are added to or removed from the refrigeration appliance 100 are identified, as described in detail below.
  • aspects of the present invention are directed to methods for detecting such motion and enabling/disabling a camera based on its proximity or field of view relative to the moving object.
  • exemplary methods of detecting such motion and responsive actions are described herein, it should be understood that other methods for detecting motion and other responsive actions are possible and within the scope of the present invention.
  • one method of detecting motion may be to perform image analysis using sequentially obtained images, as will be described in more detail below.
  • detecting such motion may rely on one or more motion sensors 254 disposed within or mounted to the case 102 to detect such motion.
  • motion sensor 254 may be any suitable optical, acoustic, electromagnetic, or other sensor suitable for detecting motion within a space.
  • these motion sensors may include proximity sensors, time-of-flight sensors, infrared sensors, optical sensors, and the like.
  • each motion sensor 254 may establish a baseline for comparison, eg, correlating readings when no motion is detected.
  • the system of motion sensors 254 may form a grid or array from which motion may be detected.
  • Various motion sensors 254 may be used to estimate the distance to a moving object or determine the object's proximity to camera 252 .
  • an object in motion can be virtualized as a two-dimensional position. For example, if the top two sensors detect motion, then an object may be between these sensors 254 along vertical V. It should be appreciated that a weighted average can be used to obtain an accurate prediction of where motion occurs.
  • sensor configurations and analysis methods are exemplary only and may vary while remaining within the scope of the invention.
  • the controller 156 may activate only the one camera 252 closest to the location of the motion, or any other suitable configuration of cameras to best obtain one or more images of the area where the motion is located.
  • motion sensors 254 are illustrated herein as being spaced or disposed between cameras 252, it should be understood that each motion sensor 254 may be co-located and/or associated with a particular camera 252 of camera assembly 250, according to an exemplary embodiment. couplet. Exemplary methods of using motion sensor 254 are described in more detail below.
  • controller 136 may be operatively coupled to camera assembly 250 for analyzing one or more images obtained by camera assembly 250 to extract useful information about objects 202 located within fresh food compartment 122 .
  • images obtained by camera assembly 250 may be used to extract barcodes, identify products, or obtain other product information related to object 202 .
  • this analysis can be performed locally (eg, on controller 156 ), or can be sent to a remote server (eg, remote server 176 via external communication network 170 ) for analysis.
  • a remote server eg, remote server 176 via external communication network 170
  • Such analysis is intended to facilitate inventory management, for example by identifying food products that are added to or removed from the refrigerated compartment.
  • this image analysis may use any suitable image processing technique, image recognition process, or the like.
  • image analysis and the like may be used generally to refer to any suitable method of observation, analysis, image decomposition, feature extraction, image classification, etc. of one or more images, videos, or other visual representations of an object.
  • this image analysis may include the implementation of image processing techniques, image recognition techniques, or any suitable combination thereof.
  • image analysis may use any suitable image analysis software or algorithm to continuously or periodically monitor moving objects within fresh food compartment 122 . It should be appreciated that this image analysis or processing may be performed locally (eg, by controller 156 ) or remotely (eg, by offloading the image data to a remote server or network, eg, remote server 176 ).
  • analysis of the one or more images may include implementing image processing algorithms.
  • image processing and the like are generally intended to refer to any suitable method or algorithm for analyzing images that does not rely on artificial intelligence or machine learning techniques (e.g., in contrast to the machine learning image recognition process described below ).
  • image processing algorithms may rely on image differentiation, such as a pixel-by-pixel comparison of two consecutive images. This comparison can help identify substantial differences between sequentially acquired images, for example, to identify movement, the presence of certain objects, the presence of certain conditions, and the like.
  • one or more reference images may be obtained when certain conditions exist, and these reference images may be stored for future comparison with images obtained during operation of the appliance. The similarity and/or difference between the reference image and the obtained image can be used to extract useful information for improving the performance of the electrical appliance.
  • image differentiation may be used to determine when a pixel-level motion metric passes a predetermined motion threshold.
  • Processing algorithms may also include measures for isolating or eliminating noise in image comparisons, eg, due to image resolution, data transmission errors, inconsistent lighting, or other imaging errors. By removing this noise, image processing algorithms can improve accurate object detection, avoid false object detections, and isolate important objects, regions, or patterns within an image. Additionally or alternatively, the image processing algorithm may use other suitable techniques for identifying or identifying specific items or objects, such as edge matching, divide and conquer search, grayscale matching, histograms of receptive field responses, or another suitable example. process (eg, executed at controller 156 based on one or more captured images from one or more cameras). Other image processing techniques are possible and within the scope of the present invention.
  • image analysis may also include the use of artificial intelligence ("AI"), such as machine learning image recognition processes, neural network classification modules, any other suitable artificial intelligence (AI) techniques, and/or any other suitable image analysis techniques, examples of which are described in more detail below.
  • AI artificial intelligence
  • the various exemplary image analysis or evaluation procedures described below may be used independently, collectively, or interchangeably to extract detailed information about the images being analyzed to facilitate performance of one or more of the methods described herein or Improve appliance operation in other ways.
  • any suitable number and combination of image processing, image recognition, or other image analysis techniques may be used to obtain accurate analysis of the acquired images.
  • the image recognition process may use any suitable artificial intelligence technique, eg, any suitable machine learning technique, or eg, any suitable deep learning technique.
  • the image recognition process may include implementing a form of image recognition known as region-based convolutional neural network ("R-CNN") image recognition.
  • R-CNN may involve taking an input image and extracting region proposals including potential objects or regions of the image.
  • a "region proposal" may be one or more regions in an image that may belong to a particular object, or may include adjacent regions that share common pixel properties.
  • a convolutional neural network is then used to compute features from the region proposals, and the extracted features will then be used to determine the classification of each specific region.
  • the image segmentation process may be used together with R-CNN image recognition.
  • image segmentation creates pixel-based masks for individual objects in an image and provides a more detailed or fine-grained understanding of various objects within a given image.
  • image segmentation can involve dividing the image into segments (e.g., into groups of pixels containing similar attributes), which Segments can be analyzed independently or in parallel to obtain a more detailed representation of one or more objects in the image. This may be referred to in this paper as "Mask R-CNN" etc., as opposed to the regular R-CNN architecture.
  • Mask R-CNN can be based on Fast R-CNN which is slightly different from R-CNN.
  • R-CNN first applies a convolutional neural network (“CNN”), which is then assigned to region proposals on covn5 feature maps, rather than initially segmented for region proposals.
  • CNN convolutional neural network
  • standard CNNs may be used to obtain, identify or detect any other qualitative or quantitative data related to one or more objects or regions within one or more images.
  • the K-means algorithm can be used.
  • the image recognition process may use any other suitable neural network process while remaining within the scope of the present invention.
  • the step of analyzing the one or more images may include using a deep belief network (“DBN”) image recognition process.
  • the DBN image recognition process can often consist of stacking many separate unsupervised networks that use the hidden layers of each network as input to the next layer.
  • the step of analyzing the one or more images may include implementing a deep neural network (“DNN”) image recognition process, which typically involves the use of neural networks with multiple layers between Network-Inspired Computing Systems).
  • DNN deep neural network
  • Other suitable image recognition processes, neural network processes, artificial intelligence analysis techniques, and combinations of the above or other known methods may be used while remaining within the scope of the present invention.
  • the image recognition process may include detecting certain conditions based on a comparison of initial conditions, which may rely on image subtraction techniques, image stacking techniques, image stitching, and the like. For example, subtracting images can be used to train a neural network with multiple classes for future comparison and image classification.
  • the machine learning image recognition model may be actively trained by the appliance with new images, may be provided with training data from the manufacturer or from another remote source, or may be trained in any other suitable manner.
  • the image recognition process relies at least in part on a neural network trained with multiple images of appliances in different configurations, subjected to different conditions, or interacting in different ways.
  • This training data can be stored locally or remotely, and can be transmitted to a remote server for use in training other appliances and models.
  • image processing and machine learning image recognition processes can be used together to facilitate improved image analysis, object detection, or to extract other useful qualitative or quantitative information from one or more images that can be used to improve the operation or performance of an appliance data or information.
  • the methods described herein may use any or all of these techniques interchangeably to improve the image analysis process and promote improved appliance performance and consumer satisfaction.
  • the image processing algorithms and machine learning image recognition processes described herein are exemplary only and are not intended to limit the scope of the invention in any way.
  • the non-contact scanning device 210 may be particularly suited for determining the location of the object 202 within the fresh food compartment 122 .
  • camera assembly 250 may be particularly suited for identifying objects, reading barcodes, or determining other useful qualitative or quantitative information about object 202 .
  • inventory management system 200 may also include one or more weight sensors 260 disposed within fresh food compartment 122, as will be described in greater detail below.
  • weight sensor 260 is provided as or includes any suitable electronic load sensor or unit configured to generate one or more electronic signals dependent on (eg, proportional to) a load placed thereon.
  • weight sensor 260 may comprise a suitable strain gauge, force sensitive resistor, capacitive sensor, hydraulic sensor (eg, with deformable hydraulic tubes), or pneumatic sensor (eg, with deformable pneumatic tubes)—as will be understood .
  • one or more weight sensors 260 may be operatively coupled to each shelf 136 (e.g., or to a portion of a shelf 136), to each cassette 134, or to any other suitable location for measuring the weight of an object 202. .
  • such weight sensors 210 may be mounted in mechanical communication with each shelf 136 to sense the weight or mass supported thereon.
  • the weight sensor 260 may detect a change in the weight of the shelf to determine the weight of the object 202 being added or removed.
  • the weight sensor 260 can also be used in combination with the non-contact scanning device 210 to accurately determine the position or orientation of the object 202 within the fresh food compartment 122 .

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Remote Sensing (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Combustion & Propulsion (AREA)
  • Mechanical Engineering (AREA)
  • Thermal Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Chemical & Material Sciences (AREA)
  • Electromagnetism (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Physics & Mathematics (AREA)
  • Cold Air Circulating Systems And Constructional Details In Refrigerators (AREA)

Abstract

一种制冷电器(100)，包括：箱体(102)，该箱体(102)限定制冷间室；门体，该门体可旋转地铰接到箱体(102)，以提供选择性达到制冷间室的途径；以及库存管理系统(200)，该库存管理系统(200)安装在制冷间室内，用于监测位于制冷间室内的物体。库存管理系统(200)可以包括非接触扫描装置(210)、摄像组件(250)和/或一个或多个重量传感器(260)，它们一起工作，以检测、识别和定位位于制冷间室内的物体。

Description

制冷电器中的库存管理系统 技术领域
本发明总体涉及制冷电器，更具体地涉及制冷电器中的库存管理系统的操作方法。
背景技术
制冷电器通常包括箱体，该箱体限定用于接收食品以便储存的制冷间室。另外，制冷电器包括一个或多个门体，这些门体可旋转地铰接到箱体，以允许选择性地接近制冷间室中储存的食品。制冷电器还可以包括安装在制冷间室内并且设计成便于在其中储存食品的各种储存部件。这种储存部件可以包括在制冷间室内接收食品并且辅助组织和布置这种食品的搁架、盒、层架或抽屉。
值得注意的是，经常期望监测制冷电器中的食品，了解哪些食品被添加到制冷电器内或从制冷电器内取出，并且具有与食品的存在有关的其他信息。某些传统的制冷电器包括用于在食品被添加到制冷电器或从制冷电器取出时监测食品的摄像装置。然而，虽然摄像装置对于成像和/或识别特定物体是有用的，但是它们经常不能精确地识别物体在制冷间室内的位置。另外，某些传统制冷电器可能包括重量传感器以检测物体何时被添加到层架。然而，通常不能单独使用摄像装置或重量传感器来确定食品的精确定位。
因此，具有用于改进库存管理的系统的制冷电器将是有用的。更特别地，包括能够监测进入和离开库存以及物品在制冷间室内的定位的库存管理系统的制冷电器将是特别有益的。
发明内容
本发明的各个方面以及优点将会在下文的描述中进行阐述，或者是通过描述可以显而易见的，或者是可以通过实施本发明而学到。
在一个示例性实施方式中，提供了一种制冷电器，包括：箱体，该箱体限定制冷间室；门体，该门体可旋转地铰接到箱体，以提供选择性达到制冷间室的途径；非接触扫描装置，该非接触扫描装置安装到箱体，用于监测制冷间室；以及控制器，该控制器可操作地联接到非接触扫描装置。控制器被配置为检测制冷间室内的一个 或多个位置处的物体的运动，并且使用非接触扫描装置确定制冷间室内的物体的位置。
在另一示例性实施方式中，提供了一种用于制冷电器的库存管理系统。制冷电器包括限定制冷间室的箱体。该库存管理系统包括：非接触扫描装置，该非接触扫描装置安装到箱体，用于监测制冷间室；和控制器，该控制器可操作地联接到非接触扫描装置，控制器被配置为检测制冷间室内的一个或多个位置处的物体的运动，并且使用非接触扫描装置确定物体的位置。
参照下文的描述以及所附权利要求，本发明的这些和其它的特征、方面以及优点将变得更容易理解。结合在本说明书中并且构成本说明书一部分的附图显示了本发明的实施方式并且与描述一起用于对本发明的原理进行解释。
附图说明
参照附图，说明书中阐述了面向本领域普通技术人员的本发明的完整公开，这种公开使得本领域普通技术人员能够实现本发明，包括本发明的最佳实施例。
图1提供了根据本发明的示例性实施方式的制冷电器的立体图。
图2提供了根据本发明的示例性实施方式的图1的示例性制冷电器的立体图，其中食物保鲜室的门体被示出为处于打开位置以露出库存管理系统。
图3提供了根据本发明的示例性实施方式的图2的示例性食物保鲜室和库存管理系统的侧视图。
图4提供了根据本发明的另一个示例性实施方式的图2的示例性食物保鲜室和库存管理系统的侧视图。
图5提供了根据本发明的另一个示例性实施方式的图2的示例性食物保鲜室和库存管理系统的侧视图。
图6提供了根据本发明的另一个示例性实施方式的图2的示例性食物保鲜室和库存管理系统的侧视图。
附图标记在本说明书和附图中的重复使用旨在表示本发明的相同或相似的特征或元件。
具体实施方式
现在将详细地参照本发明的实施方式，其中的一个或多个示例示于附图中。每 个示例都以对发明进行解释的方式给出，并不对本发明构成限制。实际上，对于本领域技术人员而言显而易见的是，能够在不偏离本发明的范围或者精神的前提下对本发明进行多种改型和变型。例如，作为一个实施方式的一部分示出或者进行描述的特征能够用于另一个实施方式，从而产生又一个实施方式。因此，期望的是，本发明覆盖落入所附权利要求及其等同形式的范围内的这些改型以及变型。
如本文所用的，术语“第一”、“第二”和“第三”可以互换使用以将一个部件与另一个部件区分开，并且这些术语并不旨在表示各个部件的位置或重要性。术语“上游”和“下游”是指相对于流体通路中的流体流动的相对方向。例如，“上游”是指流体流动的来向，而“下游”是指流体流动的去向。术语“包括(includes)”和“包括(including)”旨在以类似于术语“包括(comprising)”的方式为包括的。类似地，术语“或”通常旨在是包括的(即，“A或B”旨在意指“A或B或两者”)。
如本文在整个说明书和权利要求书中使用的近似语言被应用于修饰任何定量表示，该定量表示可容许在不导致其相关的基本功能改变的情况下变化。因此，由诸如“大约”、“近似”以及“大致”的术语修饰的值不限于所指定的精确值。在至少一些情况下，近似语言可对应于用于测量值的仪器的精度。例如，近似语言可以指在10％的范围内。
现在参见附图，将描述根据本发明的示例性方面的示例性电器。具体地，图1提供了示例性制冷电器100的立体图，图2示例了一些门体处于打开位置的制冷电器100。如图示例，制冷电器100通常限定竖向V、横向L和侧向T，竖向V、横向L和侧向T中的每一个相互垂直，使得大体限定正交坐标系。
根据示例性实施方式，制冷电器100包括箱体102，该箱体通常用于容纳和/或支撑制冷电器100的各种部件，并且还可限定制冷电器100的一个或多个内部腔室或间室。在这点上，如本文所用的，术语“箱体”、“壳体”等通常旨在指用于制冷电器100的外框架或支撑结构，例如，包括由任何合适的材料形成的任何合适数量、类型和构造的支撑结构，诸如细长支撑构件、多个互连面板或其一些组合的系统。应当理解，箱体102不一定需要围合，而是可以简单地包括支撑制冷电器100的各种元件的开放结构。相反，箱体102可以包围箱体102内部的一些或所有部分。应当理解，箱体102可具有任何合适的尺寸、形状和构造，同时保持在本发明的范围内。
如图示例，箱体102通常沿着竖向V在顶部104与底部106之间延伸，沿着横向L在第一侧108(例如，如图1中从前方观察时的左侧)与第二侧110(例如，如 图1中从前方观察时的右侧)之间延伸，并且沿着侧向T在前部112与后部114之间延伸。一般而言，诸如“左”、“右”、“前”、“后”、“顶部”或“底部”的术语是参考用户接近制冷电器电器100的视角来使用的。
壳体102限定用于接收食品以便储存的制冷间室。特别地，壳体102限定设置在壳体102的顶部104处或与其相邻设置的食物保鲜室122和布置在壳体102的底部106处或与其相邻布置的冷冻室124。由此可见，制冷电器100通常被称为底置式冰箱。然而，认识到，本发明的益处适用于其他类型和样式的制冷电器，例如，顶置式制冷电器、对开门式制冷电器或单门制冷电器。而且，本发明的方面也可以适用于其他电器。因此，本文阐述的描述仅出于示例目的，而无意于在任何方面限制任何特定的电器或配置。
冷藏门体128可旋转地铰接到壳体102的边缘，以便选择性地进入食物保鲜室122。另外，在冷藏门体128的下方布置冷冻门体130，以便选择性地进入冷冻室124。冷冻门体130联接至可滑动地安装在冷冻室124内的冷冻抽屉(未示出)。通常，冷藏门体128在由箱体102限定的前开口132(例如，在由竖向V和横向L限定的平面内延伸)上形成密封。在这点上，当冷藏门体128打开时，用户可以通过前开口132将物品放置在食物保鲜室122内，然后可以关闭冷藏门体128以便于气候控制。冷藏门体128和冷冻门体130在图1中被示出为处于关闭构造。本领域技术人员将理解，其它腔室和门体构造是可行的，并且在本发明的范围内。
图2提供了在冷藏门体128处于打开位置的情况下示出的制冷电器100的立体图。如图2所示，如本领域技术人员将理解的，各种储存部件被安装在食物保鲜室122内，以促进食品在其中的储存。特别地，储存部件可以包括盒134和层架136。这些储存部件中的每一个用于接收食品(例如，饮料或/或固体食品)，并且可以辅助组织这种食品。如图所示，盒134可以安装在冷藏门体128上或者可以滑入食物保鲜室122中的容纳空间中。应当理解，所示的储存部件仅用于说明的目的，并且可以使用其它储存部件，并且其它储存部件可以具有不同的尺寸、形状以及构造。
再次参见图1，将描述根据本发明的示例性实施方式的分配组件140。虽然将示例并描述分配组件140的几个不同的示例性实施方式，但类似的附图标记可用于指代类似的部件和特征。分配组件140通常用于分配液态水和/或冰。虽然在本文中示例并描述了示例性分配组件140，但应当理解，可以在保持在本发明的范围内的同时对分配组件140进行各种变更和修改。
分配组件140及其各种部件可以至少部分地设置在限定于冷藏门体128中的一 个上的分配器凹部142内。在这点上，分配器凹部142限定在制冷电器100的前侧112上，使得用户可以在不打开冷藏门体128的情况下操作分配组件140。另外，分配器凹部142设置在预定高度处，该预定高度方便用户取冰，并且使得用户能够在不需要弯腰的情况下取冰。在示例性实施方式中，分配器凹部142设置在接近用户的胸部水平的位置处。
分配组件140包括冰分配器144，该分配器包括用于从分配组件140排出冰的排放口146。被示出为拨片的致动机构148安装在排放口146下方，以便操作冰或水分配器144。在可选示例性实施方式中，可以使用任意合适的致动机构来操作冰分配器144。例如，冰分配器144可以包括传感器(诸如超声传感器)或按钮，而不是拨片。排放口146和致动机构148是冰分配器144的外部零件，并且安装在分配器凹部142中。与之相比，冷藏门体128可以限定容纳制冰机和储冰盒(未示出)的冰盒室150(图2)，该制冰机和储冰盒被构造成将冰供应至分配器凹部142。
设置控制面板152，以便控制操作模式。例如，控制面板152包括一个或多个选择输入154，诸如旋钮、按钮、触摸屏界面等，诸如水分配按钮和冰分配按钮，用于选择期望的操作模式，诸如碎冰或非碎冰。另外，输入154可以用于指定填充容积或操作分配组件140的方法。在这点上，输入154可以与处理装置或控制器156通信。在控制器156中生成的信号响应于选择器输入154操作制冷电器100和分配组件140。另外，可以在控制面板152上设置显示器158，诸如指示灯或屏幕。显示器158可以与控制器156通信，并且可以响应于来自控制器156的信号而显示信息。
如本文中使用的，“处理装置”或“控制器”可以指一个或多个微处理器或半导体装置，并且不必限于单个元件。处理装置可以被编程为操作制冷电器100、分配组件140以及制冷电器100的其他部件。处理装置可以包括一个或多个存储元件(例如，永久存储介质)或与其关联。在一些这种实施方式中，存储元件包括电可擦可编程只读存储器(EEPROM)。通常，存储元件可以存储处理装置可访问的信息，包括可以由处理装置执行的指令。可选地，指令可以是软件或指令和/或数据的任意集合，该软件或指令和/或数据的任意集合在由处理装置执行时，使得处理装置执行操作。
仍然参见图1，将描述根据本发明的示例性实施方式的外部通信系统170的示意图。通常，外部通信系统170用于允许制冷电器100与一个或多个外部装置之间的交互、数据传送和其他通信。例如，该通信可以用于提供和接收操作参数、用户指令或通知、性能特性、用户偏好或用于制冷电器100的改进性能的任何其它合适 的信息。另外，应当理解，外部通信系统170可用于传送数据或其它信息，以提高一个或多个外部装置或电器的性能和/或改进与这种装置的用户交互。
例如，外部通信系统170允许制冷电器100的控制器156与制冷电器100外部的单独装置通信，该单独装置在本文中通常被称为外部装置172。如以下更详细描述的，这些通信可以使用有线或无线连接(诸如经由网络174)来促进。通常，外部装置172可以是与制冷电器100分开的任何合适的装置，该装置被配置为向用户提供和/或从用户接收通信、信息、数据或命令。在这点上，外部装置172可以是例如个人电话、智能电话、平板电脑、膝上型或个人计算机、可穿戴装置、智能家庭系统或者另一移动或远程装置。
另外，远程服务器176可以通过网络174与制冷电器100和/或外部装置172通信。在这点上，例如，远程服务器176可以是基于云的服务器176，由此位于远处位置，诸如在单独的州、国家等。根据示例性实施方式，外部装置172可通过网络174(诸如因特网)与远程服务器176通信，以发送/接收数据或信息、提供用户输入、接收用户通知或指令、与制冷电器100交互或控制制冷电器等。另外，外部装置172和远程服务器176可以与制冷电器100通信以传送类似的信息。根据示例性实施方式，远程服务器176可被配置为接收和分析由摄像组件250获得的图像，例如以便于库存分析。
通常，可以使用任何类型的有线或无线连接并且使用任何合适类型的通信网络来进行制冷电器100、外部装置172、远程服务器176和/或其它用户装置或电器之间的通信，下面提供了通信网络的非限制性示例。例如，外部装置172可以通过任何合适的有线或无线通信连接或接口(例如网络174)与制冷电器100直接或间接通信。例如，网络174可以包括局域网(LAN)、广域网(WAN)、个域网(PAN)、因特网、蜂窝网络、任何其他合适的短程或远程无线网络等中的一个或多个。另外，可以使用任何合适的通信装置或协议(诸如经由
Figure PCTCN2022098441-appb-000001
无线电、激光、红外、以太网类型的装置和接口等)来发送通信。另外，这种通信可以使用各种通信协议(例如，TCP/IP、HTTP、SMTP、FTP)、编码或格式(例如，HTML、XML)和/或保护方案(例如，VPN、安全HTTP、SSL)。
本文描述了根据本发明的示例性实施方式的外部通信系统170。然而，应当理解，本文提供的外部通信系统170的示例性功能和配置仅用作示例，以便于描述本发明的各方面。系统配置可以变化，其他通信装置可以用于直接或间接地与一个或多个关联的电器通信，可以实施其他通信协议和步骤等。这些变化和修改被认为在 本发明的范围内。
现在一般参见图2至图6，制冷电器100还可以包括库存管理系统200，该库存管理系统通常配置为监测制冷电器100的一个或多个腔室，以监测库存的添加或取出。更具体地，如以下更详细地描述的，库存管理系统200可以包括多个传感器、摄像装置或其他检测装置，其用于监测食物保鲜室122，以检测设置在食物保鲜室122中或从其取出的物体(例如，通常由附图标记202标识)。在这点上，库存管理系统200可以使用来自这些装置中的每一个的数据来获得食物保鲜室122内的物体202的身份、重量、位置和/或其它定性或定量特性的完整表示或知识。尽管库存管理系统200在本文中被描述为监测食物保鲜室122，以便检测物体202，但是应当理解，本发明的各方面可以用于监测任何其他合适的电器、腔室等中的物体或物品。
如图2至图6中示意性地示出的，库存管理系统200可以包括一个或多个非接触扫描装置210，其安装在箱体102内，用于监测食物保鲜室122。更具体地，非接触扫描装置210通常被配置为检测物体(例如在食物保鲜室122内的一个或多个位置处的物体202)的运动，并且确定物体202在食物保鲜室122内的精确位置。例如，非接触扫描装置210可以用于确定物体202已经被放置在下层架136上、以及物体202在水平面内的精确位置(例如层架136的左后)。
通常，非接触扫描装置210可以包括用于识别物体的位置或取向的任何合适数量、类型、位置和配置的传感器或装置。例如，非接触扫描装置210可以包括接近传感器、飞行时间传感器、红外传感器或光学传感器中的至少一个。具体地，非接触扫描装置210可以包括光探测和测距(LiDAR)传感器。通常，LiDAR系统可以设置在食物保鲜室122内的任何适当的位置处(或者在食物保鲜室122的视野内)，并且可以包括发射器和接收器。根据示例性实施方式，发射器和接收器安装在单个微芯片上或单个装置内，如通常标识为非接触扫描装置210，但其他配置也是可行的。如下所述，非接触扫描装置210通常可以被配置为对食物保鲜室122内的物体202和周围表面进行绘图。
通常，发射器可以是任何形式的能量源，其可以由接收器测量或检测，例如用于检测物体202的存在、位置、几何形状和/或取向。例如，根据所示例的实施方式，发射器和接收器是光学跟踪系统或激光跟踪系统。在这点上，例如，发射器可以包括激光二极管或用于生成能量束(如通常由附图标记212标识)的其它合适的能量源。通常，能量束212可以是具有任何合适波长的任何合适形式的电磁能。例如，根据示例性实施方式，能量束212是波长在大约500至1200nm之间、或在大约700 至1000nm之间、或任何其它合适波长的电磁能。根据另一示例性实施方式，能量束212是具有大约940nm波长的红外光。
类似地，接收器可以包括光学传感器或其他合适的检测器或传感器。这样，例如，发射器和接收器通常可以定义LiDAR系统并作为LiDAR系统来运行，该LiDAR系统例如用于在能量束212已经从物体202、层架136、箱体102等反射离开之后对其进行检测。然而，根据可选实施方式，发射器和接收器可以依赖于电磁或其它光学或声纳装置的原理来检测物体202的位置和几何数据。例如，根据可选实施方式，非接触扫描装置210可以包括基于无线电波的无线电探测和测距(雷达)传感器。用于测量该数据的其它装置也是可行的，并且在本发明的范围内。
值得注意的是，根据本发明的示例性实施方式，库存管理系统200可以包括任何合适数量、类型和位置的非接触扫描装置210，以便实现对食物保鲜室122的所有区域的适当绘图。例如，简要地参见图3，库存管理系统200可以包括单个非接触扫描装置，该非接触扫描装置设置为接近食物保鲜室122的顶后角(例如，在箱体102的顶部104和后部114处)。另外，非接触扫描装置210的视场可以沿着侧向T向前朝向前开口132和/或沿着竖向V向下定向。这样，非接触扫描装置210可以在物体202进入食物保鲜室122之前开始监测该物体。然而，值得注意的是，非接触扫描装置210可以向前定向，因为它不会引入与摄像装置设置于相同位置并以相同方式定向相同的隐私问题。
为了获得食物保鲜室122的更好的整体视图或绘图，库存管理系统200可以可选地包括多个非接触扫描装置210，例如，如图4示例。在这点上，多个非接触扫描装置210可以沿着竖向V并且在食物保鲜室122的后壁214上隔开。这些非接触扫描装置210中的每一个都可以被定向为使得它们的视场沿着侧向T指向前方。另外，应当理解，各个非接触扫描装置可以被枢转地安装，使得其角取向可以使用驱动机构来调节。
值得注意的是，上述非接触扫描装置210包括三维LiDAR系统或传感器。然而，根据可选实施方式，可以使用单个一维激光扫描装置或LiDAR传感器。在这点上，如图5中最佳示出的，单个一维非接触扫描装置210(例如，一维LiDAR传感器)可以安装在食物保鲜室122的顶后角，并且库存管理系统200还可以包括一系列在食物保鲜室122内的期望位置处隔开的反射镜216。这样，一维LiDAR系统的发射器可以发射能量束212，该能量束从各个反射镜216反射离开，使得单个传感器可以获得关于接近相应反射镜216的各个区域的信息。其它传感器和反射镜构造是可行 的，并且在本发明的范围内。
现在简要地参见图6，库存管理系统200还可以包括定位系统220，该定位系统安装在箱体102内，并且通常被配置为选择性地定位一个或多个非接触扫描装置210。例如，根据所示例的实施方式，定位系统220包括一个或多个细长轨道(例如，通常由附图标记222标识)。更具体地，定位系统220可以包括第一轨道224，该第一轨道安装到食物保鲜室122的顶壁226并且沿着侧向T定向。如图示例，第一轨道224通常从后壁214延伸到前开口132，并且用于支撑单个(或多个)非接触扫描装置210。
另外，定位系统220可以包括第二轨道228，该第二轨道安装到食物保鲜室122的后壁214，并且通常沿着竖向V定向。第二轨道228通常可以用于接收辅助非接触扫描装置210，其可以与非接触扫描装置210相同或类似。根据示例性实施方式，非接触扫描装置210和辅助非接触扫描装置210通常分别可滑动地联接到第一轨道224和第二轨道228。
如图6示意性所示，定位系统220还可包括皮带驱动系统240，该皮带驱动系统可由控制器(例如控制器156)操作，以选择性地沿着轨道定位扫描装置。这样，控制器156可以使非接触扫描装置210选择性地沿着它们各自的细长轨道222移动，以获得期望的视场并生成食物保鲜室122和设置在其中的物体202的完整绘图。尽管用于定位系统220的驱动系统被示例为皮带驱动系统240，但是应当理解，可以使用任何其它合适的驱动系统或机构，同时保持在本发明的范围内。另外，应当理解，各个非接触扫描装置210可以经由电机安装件(未示出)枢转地安装到相应的细长轨道222，使得控制器156可以使非接触扫描装置210选择性地相对于细长轨道222枢转。
如上所示，非接触扫描装置210可以用于获得或确定物体202在食物保鲜室122内的定位。然而，根据示例性实施方式，可能期望更好地理解物体202的定性或定量特性以促进改进的库存管理。因此，库存管理系统200还可以包括摄像组件250，该摄像组件通常设置和用于在运行期间获得制冷电器100的图像。具体地，根据所示例的实施方式，摄像组件250包括多个摄像装置252，这些摄像装置安装到箱体102、门体128或以其他方式设置在食物保鲜室122的视野内。尽管本文将摄像组件250描述为用于监测制冷电器100的食物保鲜室122，但是应当理解，本发明的各方面可以用于监测任何其他合适的电器的任何其他合适的区域，例如冷冻室124。
如图2至图5中最佳示出的，摄像组件250的多个摄像装置252设置在食物保 鲜室122周围，并且通常朝向特定区域或监测位置定向。在这点上，例如，各个摄像装置252的视场可以被限制到或聚焦在食物保鲜室122内的特定区域上。然而，值得注意的是，可能期望将各个摄像装置252设置为接近食物保鲜室122的前开口132并且定向各个摄像装置252，使得视场被引导到食物保鲜室122中。这样，可以减轻或完全避免与获得电器100的用户的图像有关的隐私问题。根据示例性实施方式，摄像组件250可以用于促进制冷电器100的库存管理过程。由此可见，各个摄像装置252可以设置在食物保鲜室122的开口处，以监测被添加到食物保鲜室122或从其中取出的食品(通常标识为物体202)。
根据所示例的实施方式，摄像装置252沿着竖向V隔开，使得各个摄像装置252具有特定区域(例如，顶部层架、中间层架、底部层架)中的视场，并且摄像组件250作为整体具有食物保鲜室122的大致完整的视图。由此，摄像组件250通常用于监测食物保鲜室122的入口，例如，用于监测向食物保鲜室122添加或从其取出的食品，如以下更详细描述的。
根据另一些实施方式，各个摄像装置252可以以任意其他合适的方式定向成用于监测制冷电器100内或周围的任意其他合适的区域。应当理解，根据可选实施方式，摄像组件250可以包括任意合适数量、类型、尺寸和配置的摄像装置252，用于获得制冷电器100内或周围的任意合适的区或区域的图像。另外，应当理解，各个摄像装置252可以包括用于调节视场和/或取向的特征。
应当理解，由摄像组件250获得的图像可以在数量、频率、角度、分辨率、细节等方面变化，以便提高制冷电器100周围或内的特定区域的清晰度。另外，根据示例性实施方式，控制器156可以用于在获得图像之前使用一个或多个光源照亮制冷间室。值得注意的是，制冷电器100的控制器156(或任意其他合适的专用控制器)可以通信地联接到摄像组件250，并且可以被编程或用于分析由摄像组件250获得的图像，例如，以便识别被添加到制冷电器100或从其取出的物品，如以下详细描述的。
值得注意的是，根据本发明的示例性实施方式，通过仅操作摄像组件250的检测运动或移动物体的这些摄像装置252或者以其他方式最佳地查看这样的移动的这些摄像装置，可以节省数据传输和计算机资源。由此可见，本发明的各方面致力于用于检测这种运动并基于摄像装置相对于运动中的物体的接近度或视场来启用/停用摄像装置的方法。尽管本文描述了检测这种运动和响应动作的示例性方法，但是应当理解，用于检测运动和其他响应动作的其他方法是可行的并且在本发明的范围内。
根据示例性实施方式，一种检测运动的方法可以是使用顺序获得的图像来实施图像分析，如以下将更详细描述的。根据另一示例性实施方式，检测这种运动可以依赖于设置在箱体102内或安装到箱体的一个或多个运动传感器254来检测这种运动。根据示例性实施方式，运动传感器254可以是任何合适的光学、声学、电磁或其他适于检测空间内的运动的传感器。例如，这些运动传感器可以包括接近传感器、飞行时间传感器、红外传感器、光学传感器等。
通常，各个运动传感器254可以建立用于比较的基线，例如，当没有检测到运动时与读数相关联。由此，运动传感器254的系统可以形成网格或阵列，从该网格或阵列可以检测运动。各个运动传感器254可以用于估计距移动物体的距离或确定该物体到摄像装置252的接近度。通过分析和比较来自一些或所有传感器254的反馈，可以将运动中的物体虚拟为二维位置。例如，如果顶部的两个传感器检测到运动，那么物体可能在沿着竖向V的这些传感器254之间。应当理解，加权平均可以用于获得对运动发生的位置的准确预测。另外，应当理解，传感器配置和分析方法仅是示例性的，并且可以在保持在本发明的范围内的同时变化。
根据示例性实施方式，控制器156可以仅启动最靠近运动位置的一个摄像装置252，或者启动摄像装置的任何其它合适的配置，以最佳地获得运动所在区域的一个或多个图像。尽管运动传感器254在本文中被示例为间隔或设置在摄像装置252之间，但是应当理解，根据示例性实施方式，各个运动传感器254可以与摄像组件250的特定摄像装置252共同定位和/或相关联。以下将更详细地描述使用运动传感器254的示例性方法。
通常，控制器136可以可操作地联接到摄像组件250，用于分析由摄像组件250获得的一个或多个图像，以提取关于位于食物保鲜室122内的物体202的有用信息。在这点上，例如，由摄像组件250获得的图像可以用于提取条形码、识别产品、或获得与物体202有关的其他产品信息。值得注意的是，该分析可以在本地(例如，在控制器156上)执行，或者可以被发送到远程服务器(例如，经由外部通信网络170的远程服务器176)以用于分析。这种分析旨在例如通过识别被添加到制冷间室或从制冷间室取出的食品来促进库存管理。
根据示例性实施方式，该图像分析可以使用任何合适的图像处理技术、图像识别过程等。如本文所用的，术语“图像分析”等通常可以用于指代物体的一个或多个图像、视频或其他视觉表示的观察、分析、图像分解、特征提取、图像分类等的任何合适的方法。如以下更详细地解释的，该图像分析可以包括图像处理技术、图 像识别技术或其任何适当组合的实施。在这点上，图像分析可以使用任何合适的图像分析软件或算法来持续地或周期性地监测食物保鲜室122内的移动物体。应当理解，该图像分析或处理可以在本地(例如，由控制器156)或远程(例如，通过将图像数据卸载到远程服务器或网络，例如，远程服务器176)执行。
具体地，对一个或多个图像的分析可以包括实施图像处理算法。如本文所用的，术语“图像处理”等通常旨在指代用于分析图像的不依赖于人工智能或机器学习技术的任何合适的方法或算法(例如，与以下描述的机器学习图像识别过程形成对比)。例如，图像处理算法可以依赖于图像区分，例如两个连续图像的逐像素比较。该比较可以帮助识别顺序获得的图像之间的实质差异，例如，以识别移动、特定物体的存在、特定条件的存在等。例如，当特定条件存在时，可以获得一个或多个参考图像，并且这些参考图像可以被存储，以用于将来与在电器运行期间获得的图像进行比较。参考图像与获得的图像之间的相似性和/或差异可以用于提取用于提高电器性能的有用信息。例如，图像区分可以用于确定像素级运动度量何时通过预定运动阈值。
处理算法还可以包括用于隔离或消除例如由于图像分辨率、数据传输误差、不一致照明或其他成像误差而产生的图像比较中的噪声的措施。通过消除这种噪声，图像处理算法可以改善准确的物体检测，避免错误的物体检测，并且隔离图像内的重要物体、区域或图案。另外或可选地，图像处理算法可以使用用于识别或标识特定物品或物体的其他合适的技术，诸如边缘匹配、分治搜索、灰度匹配、感受野响应的直方图或另一合适的例程(例如，基于来自一个或多个摄像装置的一个或多个捕获的图像在控制器156处执行)。其它图像处理技术也是可行的，并且在本发明的范围内。
除了上述图像处理技术之外，图像分析还可以包括利用人工智能(“AI”)，诸如机器学习图像识别过程、神经网络分类模块、任何其他合适的人工智能(AI)技术和/或任何其他合适的图像分析技术，其示例将在下面更详细地描述。而且，以下描述的各个示例性图像分析或评估过程可以独立地、共同地或可互换地使用，以提取关于被分析的图像的详细信息，从而促进本文描述的一个或多个方法的执行或以其他方式改进电器运行。根据示例性实施方式，可以使用任何合适数量的图像处理、图像识别或其他图像分析技术及其组合来获得对所获得的图像的准确分析。
在这点上，图像识别过程可以使用任意合适的人工智能技术，例如，任意合适的机器学习技术，或者例如，任意合适的深度学习技术。根据示例性实施方式，图 像识别过程可以包括实施称为基于区域的卷积神经网络(“R-CNN”)图像识别的一种形式的图像识别。一般而言，R-CNN可包括取得输入图像并提取包括图像的潜在物体或区域的区域建议。在这点上，“区域建议”可以是图像中可能属于特定物体的一个或多个区域，或者可以包括共享共同像素特性的相邻区域。然后使用卷积神经网络来从区域建议计算特征，然后将使用所提取的特征来确定各个特定区域的分类。
根据另一些实施方式，可以将图像分割过程与R-CNN图像识别一起使用。通常，图像分割为图像中的各个物体创建基于像素的掩码，并且提供对给定图像内的各种物体的更详细或更精细的理解。在这点上，代替处理整个图像(即，像素的大集合，其中许多像素可能不包含有用信息)，图像分割可以涉及将图像划分为片段(例如，划分为包含类似属性的像素组)，这些片段可以独立地或并行地分析，以获得图像中的一个或多个物体的更详细表示。这在本文中可以被称为“掩码R-CNN”等，与常规的R-CNN架构相反。例如，掩码R-CNN可以基于与R-CNN略微不同的快速R-CNN。例如，R-CNN首先应用卷积神经网络(“CNN”)，然后将其分配给covn5特性图上的区域推荐，而不是初始地分割为区域推荐。另外，根据示例性实施方式，标准CNN可用于获得、识别或检测与一个或多个图像内的一个或多个物体或区域有关的任何其他定性或定量数据。另外，可以使用K均值算法。
根据另一些实施方式，图像识别过程可以使用任意其他合适的神经网络过程，同时保持在本发明的范围内。例如，分析一个或多个图像的步骤可以包括使用深度信念网络(“DBN”)图像识别过程。DBN图像识别过程通常可以包括堆叠许多单独的无监督网络，这些网络使用各个网络的隐藏层作为下一层的输入。根据另一些实施方式，分析一个或多个图像的步骤可以包括实施深度神经网络(“DNN”)图像识别过程，其通常包括使用在输入与输出之间具有多个层的神经网络(由生物神经网络启示的计算系统)。可以使用其他合适的图像识别过程、神经网络过程、人工智能分析技术以及上述或其他已知方法的组合，同时保持在本发明的范围内。
另外，应当理解，可以使用各种传送技术，但是不需要使用这样的技术。如果使用传送技术学习，则可以利用公共数据集来预训练神经网络架构，诸如VGG16/VGG19/ResNet50，然后可以利用电器特定数据集来重新训练最后一层。另外或可选地，图像识别过程可包括基于初始条件的比较而检测某些条件，可依赖于图像减影技术、图像堆叠技术、图像拼接等。例如，减影图像可以用于训练具有多个类别的神经网络，以用于将来的比较和图像分类。
应当理解，机器学习图像识别模型可以由电器利用新图像主动训练，可以被提 供有来自制造商或来自另一远程源的训练数据，或者可以以任何其它合适的方式训练。例如，根据示例性实施方式，该图像识别过程至少部分地依赖于神经网络，该神经网络利用不同配置的电器的多个图像训练、经历不同条件或以不同方式交互。该训练数据可以本地或远程地存储，并且可以被传送到远程服务器以用于训练其他电器和模型。
应当理解，图像处理和机器学习图像识别过程可以一起使用，以便于改进的图像分析、物体检测，或者从一个或多个图像中提取可以用于改进电器的运行或性能的其他有用的定性或定量数据或信息。实际上，本文描述的方法可以可互换地使用这些技术中的任何或全部来改进图像分析过程并且促进改进的电器性能和消费者满意度。本文描述的图像处理算法和机器学习图像识别过程仅是示例性的，并且不旨在以任何方式限制本发明的范围。
如上所述，非接触扫描装置210可以特别适于确定物体202在食物保鲜室122内的位置。另外，摄像组件250可以特别适合于识别物体、读取条形码、或确定与物体202有关的其他有用的定性或定量信息。然而，可能进一步期望确定食物保鲜室122内的物体202的重量。因此，库存管理系统200还可以包括设置在食物保鲜室122内的一个或多个重量传感器260，如将在下面更详细地描述的。通常，重量传感器260被提供为或包括任何合适的电子负荷传感器或单元，其被配置为根据(例如，与其成比例)设置在其上的负荷生成一个或多个电子信号。例如，重量传感器260可以包括合适的应变计、力敏电阻器、电容传感器、液压传感器(例如，具有可变形的液压管)或气动传感器(例如，具有可变形的气动管)—如将理解的。
如上所述，一个或多个重量传感器260可以可操作地联接到各个层架136(例如，或层架136的一部分)、各个盒134、或用于测量物体202的重量的任何其它合适的位置。具体地，例如，这种重量传感器210可以安装为与各个层架136机械连通，以检测其上支撑的重量或质量。例如，当物体202被添加到食物保鲜室122或从其取出时，重量传感器260可以检测层架重量的变化，以确定被添加或取出的物体202的重量。值得注意的是，重量传感器260还可以与非接触扫描装置210结合使用，以便精确地确定物体202在食物保鲜室122内的位置或方位。
本书面描述使用示例对本发明进行了公开(其中包括最佳实施例)，并且还使本领域技术人员能够实施本发明(其中包括制造和使用任意装置或系统并且执行所包含的任意方法)。本发明的可专利范围通过权利要求进行限定，并且可以包括本领域技术人员能够想到的其它的示例。如果这种其它的示例包括与权利要求的字面语言 没有区别的结构元件，或者如果这种其它的示例包括与权利要求的字面语言没有实质区别的等同结构元件，则期望这种其它的示例落入权利要求的范围中。

Claims (15)

  1. 一种制冷电器，其特征在于，包括：
    箱体，该箱体限定制冷间室；
    门体，该门体可旋转地铰接到所述箱体，以提供选择性地达到所述制冷间室的途径；
    非接触扫描装置，该非接触扫描装置安装到所述箱体，用于监测所述制冷间室；以及
    控制器，该控制器可操作地联接到所述非接触扫描装置，所述控制器被配置为：
    检测所述制冷间室内的一个或多个位置处的物体的运动；并且
    使用所述非接触扫描装置确定所述制冷间室内的所述物体的位置。
  2. 根据权利要求1所述的制冷电器，其特征在于，所述非接触扫描装置包括接近传感器、飞行时间传感器、红外传感器或光学传感器中的至少一个；或，所述非接触扫描装置包括光探测和测距传感器，或所述非接触扫描装置包括基于无线电波的无线电探测和测距传感器。
  3. 根据权利要求1所述的制冷电器，其特征在于，所述非接触扫描装置包括一维激光扫描装置，所述制冷电器还包括：一个或多个反射镜，该一个或多个反射镜用于重定向从所述一维激光扫描装置发射的光的至少一部分；或，所述非接触扫描装置包括三维激光扫描装置。
  4. 根据权利要求1所述的制冷电器，其特征在于，所述制冷电器还包括：
    定位系统，该定位系统安装在所述箱体内，用于选择性地定位所述非接触扫描装置。
  5. 根据权利要求4所述的制冷电器，其特征在于，所述定位系统包括：
    一个或多个细长轨道，所述非接触扫描装置可滑动地接收在所述一个或多个细长轨道内；以及
    皮带驱动系统，该皮带驱动系统可操作地联接到所述非接触扫描装置，以用于使所述非接触扫描装置沿着所述一个或多个细长轨道选择性地滑动。
  6. 根据权利要求5所述的制冷电器，其特征在于，所述一个或多个细长轨道包括：
    第一轨道，该第一轨道安装到所述箱体的顶壁并且沿着横向定向，以用于接收所述非接触扫描装置；以及
    第二轨道，该第二轨道安装到所述箱体的后壁并且沿着竖向定向，以用于接收辅助非接触扫描装置。
  7. 根据权利要求1所述的制冷电器，其特征在于，所述非接触扫描装置被安装用于监测所述制冷间室内的第一区域，所述制冷电器还包括：
    辅助非接触扫描装置，该辅助非接触扫描装置监测所述制冷间室内的第二区域。
  8. 根据权利要求1所述的制冷电器，其特征在于，还包括：
    摄像组件，该摄像组件安装到所述箱体，用于监测所述制冷间室；其中，所述摄像组件设置在所述制冷间室的前开口处，并且具有指向所述制冷间室中的视场；所述控制器可操作地联接到所述摄像组件，所述控制器被配置为：
    使用所述摄像组件获得所述制冷间室中的所述物体的一个或多个图像。
  9. 根据权利要求8所述的制冷电器，其特征在于，所述控制器被配置为分析所述一个或多个图像，以提取条形码、识别产品、或获得与所述物体有关的其他产品信息；或，所述控制器被配置为使用图像处理技术或机器学习图像识别过程来分析所述一个或更多个图像。
  10. 根据权利要求1所述的制冷电器，其特征在于，还包括：
    重量传感器，该重量传感器可操作地联接到层架，以用于检测所述层架的重量，其中，所述控制器可操作地联接到所述重量传感器，以用于在所述物体放置在所述层架上时确定所述物体的放置位置或测量所述物体的重量。
  11. 一种用于制冷电器的库存管理系统，其特征在于，所述制冷电器包括限定制冷间室的箱体，所述库存管理系统包括：
    非接触扫描装置，该非接触扫描装置安装到所述箱体，用于监测所述制冷间室；以及
    控制器，该控制器可操作地联接到所述非接触扫描装置，所述控制器被配置为：
    检测所述制冷间室内的一个或多个位置处的物体的运动；并且
    使用所述非接触扫描装置确定所述物体的位置。
  12. 根据权利要求11所述的库存管理系统，其特征在于，所述非接触扫描装置包括接近传感器、飞行时间传感器、红外传感器或光学传感器中的至少一个。
  13. 根据权利要求11所述的库存管理系统，其特征在于，还包括：
    定位系统，该定位系统安装在所述箱体内，用于选择性地定位所述非接触扫描装置。
  14. 根据权利要求11所述的库存管理系统，其特征在于，还包括：
    摄像组件，该摄像组件安装到所述箱体，用于监测所述制冷间室，其中，所述摄像组件设置在所述制冷间室的前开口处，并且具有指向所述制冷间室中的视场。
  15. 根据权利要求11所述的库存管理系统，其特征在于，还包括：
    重量传感器，该重量传感器可操作地联接到层架，以用于检测所述层架的重量，其中，所述控制器可操作地联接到所述重量传感器，以用于在所述物体放置在所述层架上时确定所述物体的放置位置或测量所述物体的重量。
PCT/CN2022/098441 2021-06-14 2022-06-13 制冷电器中的库存管理系统 WO2022262683A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202280042115.XA CN117480351A (zh) 2021-06-14 2022-06-13 制冷电器中的库存管理系统

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US17/346,337 2021-06-14
US17/346,337 US20220397338A1 (en) 2021-06-14 2021-06-14 Inventory management system in a refrigerator appliance

Publications (1)

Publication Number Publication Date
WO2022262683A1 true WO2022262683A1 (zh) 2022-12-22

Family

ID=84389726

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/098441 WO2022262683A1 (zh) 2021-06-14 2022-06-13 制冷电器中的库存管理系统

Country Status (3)

Country Link
US (1) US20220397338A1 (zh)
CN (1) CN117480351A (zh)
WO (1) WO2022262683A1 (zh)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102575865A (zh) * 2009-10-07 2012-07-11 松下电器产业株式会社 空气调节机
US20140252091A1 (en) * 2013-03-07 2014-09-11 Canopy Tours Inc. Apparatus and Method for Customized Product Data Management
CN105008833A (zh) * 2013-04-23 2015-10-28 Lg电子株式会社 冰箱及其控制方法
CN107850384A (zh) * 2015-06-05 2018-03-27 埃尔瓦有限公司 智能冰箱
CN109073317A (zh) * 2016-05-02 2018-12-21 Bsh家用电器有限公司 制冷器具、格板和用于监测冷藏物品的方法
US20190353421A1 (en) * 2018-05-18 2019-11-21 Haier Us Appliance Solutions, Inc. Inventory system for a refrigerator appliance
CN111386435A (zh) * 2017-11-27 2020-07-07 三菱电机株式会社 冰箱及冰箱系统

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104990357B (zh) * 2015-06-26 2018-03-23 青岛海尔股份有限公司 冰箱冷藏室的分区制冷控制方法和分区制冷控制装置
US10474987B2 (en) * 2015-08-05 2019-11-12 Whirlpool Corporation Object recognition system for an appliance and method for managing household inventory of consumables
US11422517B2 (en) * 2019-06-05 2022-08-23 International Business Machines Corporation Automated transfer of items between compartments of a smart appliance

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102575865A (zh) * 2009-10-07 2012-07-11 松下电器产业株式会社 空气调节机
US20140252091A1 (en) * 2013-03-07 2014-09-11 Canopy Tours Inc. Apparatus and Method for Customized Product Data Management
CN105008833A (zh) * 2013-04-23 2015-10-28 Lg电子株式会社 冰箱及其控制方法
CN107850384A (zh) * 2015-06-05 2018-03-27 埃尔瓦有限公司 智能冰箱
CN109073317A (zh) * 2016-05-02 2018-12-21 Bsh家用电器有限公司 制冷器具、格板和用于监测冷藏物品的方法
CN111386435A (zh) * 2017-11-27 2020-07-07 三菱电机株式会社 冰箱及冰箱系统
US20190353421A1 (en) * 2018-05-18 2019-11-21 Haier Us Appliance Solutions, Inc. Inventory system for a refrigerator appliance

Also Published As

Publication number Publication date
CN117480351A (zh) 2024-01-30
US20220397338A1 (en) 2022-12-15

Similar Documents

Publication Publication Date Title
US11499773B2 (en) Refrigerator and method for managing articles in refrigerator
US9117281B2 (en) Surface segmentation from RGB and depth images
US11599928B2 (en) Refrigerator and method for managing products in refrigerator
WO2021032181A1 (zh) 用于制冷电器的分配控制系统
US20220325946A1 (en) Selective image capture using a plurality of cameras in a refrigerator appliance
US10475310B1 (en) Operation method for security monitoring system
WO2022105718A1 (zh) 制冷电器的库存管理系统
WO2022262683A1 (zh) 制冷电器中的库存管理系统
WO2021091481A1 (en) System for object identification and content quantity estimation through use of thermal and visible spectrum images
US11796250B1 (en) Multi-camera vision system facilitating detection of door position using audio data
US20220414391A1 (en) Inventory management system in a refrigerator appliance
WO2023036099A1 (zh) 制冷电器中的库存管理系统
US20240068742A1 (en) Gasket leak detection in a refrigerator appliance
US20230308611A1 (en) Multi-camera vision system in a refrigerator appliance
US20210123652A1 (en) Sensor assembly for detecting the level of ice within an ice making appliance
WO2023020499A1 (zh) 制冷设备
WO2023046040A1 (zh) 制冷电器中的库存管理系统
US20240111897A1 (en) Multi-camera vision system facilitating authentication and secure data transfer
US11965691B2 (en) Refrigerator appliance with smart drawers
WO2023151694A1 (zh) 具有智能门体警报的制冷电器
US20230058922A1 (en) Appliance with collocated cameras
US20240346766A1 (en) Modelling method and system, and storage container comprising the system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22824163

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 202280042115.X

Country of ref document: CN

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 22824163

Country of ref document: EP

Kind code of ref document: A1