WO2022095995A1 - Appareil de réfrigération et procédé de suivi d'articles stockés - Google Patents

Appareil de réfrigération et procédé de suivi d'articles stockés Download PDF

Info

Publication number
WO2022095995A1
WO2022095995A1 PCT/CN2021/129260 CN2021129260W WO2022095995A1 WO 2022095995 A1 WO2022095995 A1 WO 2022095995A1 CN 2021129260 W CN2021129260 W CN 2021129260W WO 2022095995 A1 WO2022095995 A1 WO 2022095995A1
Authority
WO
WIPO (PCT)
Prior art keywords
barcode
refrigeration appliance
user
scanner module
data
Prior art date
Application number
PCT/CN2021/129260
Other languages
English (en)
Chinese (zh)
Inventor
柳春宰
C. 麦卡宾大卫
Original Assignee
海尔智家股份有限公司
青岛海尔电冰箱有限公司
海尔美国电器解决方案有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 海尔智家股份有限公司, 青岛海尔电冰箱有限公司, 海尔美国电器解决方案有限公司 filed Critical 海尔智家股份有限公司
Publication of WO2022095995A1 publication Critical patent/WO2022095995A1/fr

Links

Images

Classifications

    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D29/00—Arrangement or mounting of control or safety devices
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D2400/00—General features of, or devices for refrigerators, cold rooms, ice-boxes, or for cooling or freezing apparatus not covered by any other subclass
    • F25D2400/36—Visual displays
    • F25D2400/361—Interactive visual displays
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D2500/00—Problems to be solved
    • F25D2500/06—Stock management
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D2700/00—Means for sensing or measuring; Sensors therefor
    • F25D2700/04—Sensors detecting the presence of a person
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D2700/00—Means for sensing or measuring; Sensors therefor
    • F25D2700/06—Sensors detecting the presence of a product

Definitions

  • the present invention generally relates to tracking items within storage enclosures such as refrigeration appliances.
  • refrigeration appliances typically include a box that defines a refrigeration compartment.
  • the user can place food or objects in the refrigerated compartment in order to prevent the spoilage of such food. Thereby, the useful life of the perishable item or object can be increased.
  • a large number of stored items may accumulate in the refrigeration compartment of the refrigerator.
  • users of the refrigeration appliance may have difficulty identifying items located within the refrigeration appliance. Additionally, the user may have difficulty determining the quantity of certain items within the refrigeration appliance.
  • the user may then accidentally buy too many or unwanted items. For example, certain food products do not perish easily in the refrigerated compartment, and such food products may be consumed infrequently. Thereby, the food product can be kept in the refrigerated compartment for a longer period of time. The user may forget the food item and buy a substitute despite already having an acceptable item. In this way, it may cause inconvenience to the user or cost money unnecessarily. Additionally or alternatively, some users may not be aware that certain items have been removed or consumed. As such, the user may not be able to replace or replenish such items.
  • Some existing appliances have attempted to address these problems by requiring the user to manually enter individual items that are stored to generate a list of stored items.
  • Other appliances have used various methods, such as rulers, to estimate or guess the quantity or identification of stored items.
  • this attempt is not cumbersome and prone to inaccuracy.
  • it may be difficult for a user to know when a particular item has been removed or expired and thus may need to be replaced.
  • a refrigeration appliance with features for assisting a user in tracking the contents of the refrigeration appliance's refrigerated compartment.
  • a refrigerated appliance with features to assist a user in accurately tracking the refrigerated compartment contents of the refrigerated appliance in order to establish an inventory of stored items or a "shopping list" of desired items disposed within the refrigerated compartment.
  • a refrigeration appliance may include a cabinet, a door, a scanner module, and a controller operably coupled to the scanner module.
  • the door may be rotatably hinged to the cabinet to provide selective access to the refrigerated compartment.
  • the scanner module can be mounted to the case.
  • the controller may be configured to initiate operational routines.
  • the operational routine may include: initiating a scan sequence at the scanner module; identifying barcode capture of a product barcode of the stored item based on the scan sequence; processing barcode data captured by barcode according to one or more predetermined user preferences; based on the processed barcode The data establishes an item identifier; and directs an update to the user list with the established item identifier.
  • a method of operating a refrigeration appliance may include: initiating a scan sequence at the scanner module; and identifying barcode capture of a product barcode of the stored item based on the scan sequence.
  • the method may further include processing the barcode data captured by the barcode according to one or more predetermined user preferences.
  • the method may further include: establishing an item identifier based on the processed barcode data; and directing an update to the user manifest with the established item identifier.
  • FIG. 1 provides a front view of a refrigeration appliance according to an exemplary embodiment of the present invention.
  • Figure 2 provides a front view of a refrigeration appliance in accordance with an exemplary embodiment of the present invention, with the refrigerated door shown in an open position.
  • FIG. 3 provides a system block diagram of a refrigeration appliance according to an exemplary embodiment of the present invention.
  • FIG. 4 provides a flowchart illustrating a method of operating a refrigeration appliance according to an exemplary embodiment of the present invention.
  • FIG. 5 provides a flowchart illustrating a method of operating a refrigeration appliance according to an exemplary embodiment of the present invention.
  • the present invention provides a method of assisting in managing an inventory of food products within a storage enclosure such as a refrigeration appliance or food storage cabinet.
  • the method may include one or more steps for determining what items (ie, stored items) were added to or removed from the storage housing. The determination may be made using information gathered using barcodes printed or embedded on one or more food items within the refrigerator.
  • FIG. 1 provides a front view of a refrigeration appliance 100 according to an exemplary embodiment of the present invention, with the refrigeration door 128 of the refrigeration appliance 100 shown in a closed position.
  • FIG. 2 provides a front view of the refrigeration appliance 100 with the refrigerator door 128 shown in an open position to reveal the fresh food compartment 122 of the refrigeration appliance 100 .
  • the refrigeration appliance 100 includes a housing or box 120 extending along the vertical direction V between the top 101 and the bottom 102 .
  • the bin 120 defines a refrigerated compartment for receiving food items for storage.
  • the case 120 defines a food preservation compartment 122 disposed at or adjacent to the top 101 of the case 120 and a freezer compartment 124 disposed at or adjacent to the bottom 102 of the case 120 .
  • the refrigeration appliance 100 is generally referred to as a bottom-mounted refrigerator.
  • the benefits of the present invention are applicable to other types and styles of storage enclosures, such as overhead refrigeration appliances, side-by-side refrigeration appliances, or non-refrigerated food storage cabinet enclosures. Accordingly, the descriptions set forth herein are for illustrative purposes only and are not intended to limit any particular storage housing or refrigerator cavity configuration in any way.
  • the refrigerator door 128 is rotatably hinged to the edge of the box 120 for selective access to the food preservation compartment 122 .
  • a freezing door 130 is arranged below the refrigerating door 128 so as to selectively enter the freezing compartment 124 .
  • the freezer door 130 is coupled to a freezer drawer 142 (not shown) slidably mounted within the freezer compartment 124 . As described above, the refrigerator door 128 and the freezer door 130 are shown in the closed position in FIG. 1 , and the refrigerator door 128 is shown in the open position in FIG. 2 .
  • the storage components include a box 140 installed in the food preservation compartment 122 , a drawer 142 and a shelf 144 .
  • Box 140, drawer 142, and shelf 144 are configured to receive stored items (e.g., beverages or solid foods) and may help organize such foods.
  • the drawer 142 may receive fresh food (eg, vegetables, fruit, or cheese) and increase the useful life of such fresh food.
  • Refrigeration appliance 100 also includes features to assist a user in identifying food items located within food preservation compartment 122 or freezer compartment 124 .
  • a user may utilize these features, for example, to view food products (ie, stored items) stored in food preservation compartment 122 or freezer compartment 124, or to create an inventory or list of such stored items.
  • Such inventory or inventory may be formed, at least in part, using one or more product barcodes (eg, printed on or on the packaging in which the stored items are held). This feature is discussed in more detail below.
  • FIG. 3 provides a schematic diagram of the refrigeration appliance 100 .
  • the refrigeration appliance 100 includes a controller 150 operatively coupled or in communication with components of a refrigeration system of the refrigeration appliance 100 that is configured to cool the food preservation compartment 122 or the freezer compartment 124 (FIG. 2).
  • Components include compressor 170 , evaporator fan 172 and condenser fan 174 .
  • Controller 150 may selectively operate such components to cool food preservation compartment 122 or freezer compartment 124 .
  • the controller 150 is also in communication with a thermostat (eg, a thermocouple or thermistor).
  • the thermostat may be provided in the food preservation compartment 122 or the freezer compartment 124 .
  • the controller 150 may receive a signal corresponding to the temperature of the food preservation compartment 122 or the freezer compartment 124 from the thermostat.
  • the controller 150 may also include an internal timer for calculating the elapsed time period.
  • the controller 150 may include memory and one or more microprocessors, CPUs, etc., such as a general-purpose or special-purpose microprocessor, for executing programmed instructions or micro-control code associated with the operation of the refrigeration appliance 100 .
  • the memory may represent random access memory such as DRAM or read only memory such as ROM or FLASH.
  • the processor executes permanently programmed instructions stored in memory.
  • the instructions include a software package configured to operate the appliance 100, or to execute an operating routine (eg, one or more of the exemplary methods 400 and 500 described below with reference to FIGS. 4 and 5 ).
  • the memory may be a separate component from the processor, or may be contained on a board within the processor.
  • controller 150 may be implemented without the use of a microprocessor (eg, using a combination of discrete analog or digital logic circuits; such as switches, amplifiers, integrators, comparators, flip-flops, AND gates, etc.) To perform control functions instead of relying on software.
  • a microprocessor eg, using a combination of discrete analog or digital logic circuits; such as switches, amplifiers, integrators, comparators, flip-flops, AND gates, etc.
  • the controller 150 may be provided at various locations throughout the refrigeration appliance 100 . Input/output (“I/O”) signals may be routed between the controller 150 and various operating components of the refrigeration appliance 100 .
  • I/O Input/output
  • One or more components of refrigeration appliance 100 may communicate (eg, in electrical communication) with controller 150 via one or more conductive signal lines or a shared communication bus. Additionally or alternatively, one or more components of refrigeration appliance 100 may communicate with controller 150 (eg, wirelessly) via one or more wireless signal bands.
  • the refrigeration appliance 100 further includes a camera or scanner module 160 .
  • Scanner module 160 may be any type of device suitable for detecting or capturing printed product barcodes (eg, reflected light pulses or two-dimensional images).
  • the scanner module 160 may include a pen-type reader or a laser scanner with a beam emitter and a reflective reader that captures reflected light pulses (eg, light pulses projected from the beam emitter). Once received, such light pulses can be identified as reflected from the product barcode (eg, before the barcode is decoded), as will be appreciated.
  • the scanner module 160 may include a video camera or digital camera with an electronic image sensor (eg, a charge coupled device (CCD) or CMOS sensor).
  • the scanner module 160 is in communication with the controller 150 (eg, in electrical communication or wireless communication) such that the controller 150 can receive from the scanner module 160 corresponding reflected light pulses or images captured by the scanner module 160 Signal.
  • the scanner module 160 is provided on the refrigeration appliance 100 .
  • scanner module 160 is mounted within food preservation compartment 122 at its top (eg, adjacent top 101 ).
  • a scanner module 160 eg, a beam emitter or camera
  • the scanner module 160 may point downward.
  • the camera is directed toward one or more refrigeration compartments (eg, food preservation compartment 122 - FIG. 2 ).
  • scanner module 160 may be directed to at least a portion of any particular one or combination of drawer 142 and shelf 144 (FIG. 2).
  • the scanner module 160 may capture reflected light pulses or images thereof from one of the drawers 142, all the drawers 142, one of the shelves 144, all the shelves 144, or any suitable combination thereof.
  • the scanner module 160 is illustrated as being mounted within the food preservation compartment 122 , it should be understood that additional or alternative embodiments include mounting in another suitable portion of the refrigeration appliance (such as the side of the bladder that defines the food preservation compartment 122 ).
  • a scanner assembly eg, a pen reader with an electronic image sensor, a laser scanner, or a digital camera
  • a scanner assembly mounted at the door 128 may be directed to the exterior or front of the refrigeration appliance 100, whereby an image of a user or area positioned forward from the refrigeration appliance 100 may be captured (eg, when the corresponding door is in closed position).
  • the scanner module 160 may capture one or more reflected light pulses or two-dimensional images.
  • a scan sequence may be provided for emitting or projecting light from a light emitter, the reflection of which may be received at the scanner module 160 . Once received, the light pulse can be transmitted to the controller 150 and decoded (e.g., by measuring its intensity), as will be appreciated.
  • a scan sequence may provide for capturing one or more two-dimensional images (eg, as a video feed or a series of consecutive still images) that may be transmitted to the controller 150 (eg, as a data signal) , as commonly understood.
  • the refrigeration appliance 100 includes an integrated display 180 .
  • the integrated display 180 may be mounted on the refrigerator door 128 ( FIG. 1 ) or at any other suitable location on the refrigeration appliance 100 .
  • the integrated display 180 is in communication with the controller 150 such that the integrated display 180 can receive signals from the controller 150 corresponding to light pulses or images captured by the scanner module 160 .
  • the integrated display 180 may receive such signals from the controller 150 and visually present the image to the user.
  • the integrated display 180 may include, for example, a liquid crystal display panel (LCD), a plasma display panel (PDP), or any other suitable mechanism for displaying images (eg, a projector).
  • LCD liquid crystal display panel
  • PDP plasma display panel
  • the refrigeration appliance 100 may also include a communication component 184 in communication with the controller 150 .
  • communication assembly 184 may be mounted on any suitable portion of refrigeration appliance 100 , such as within cabinet 120 or door 128 .
  • the communication components include speakers (eg, electrodynamic speakers, electrostatic speakers, planar magnetic speakers, piezoelectric speakers, etc.).
  • the speakers may be configured to generate sound waves from one or more electrical signals (eg, digital sound signals received from the controller 150). Thereby, the speaker can audibly convey information to the user.
  • the communication components include microphones (eg, dynamic microphones, ribbon microphones, fiber optic microphones, piezoelectric microphones, etc.).
  • the microphone may generate one or more electrical signals (eg, to be received by the controller 150 ) from one or more received sound waves (eg, from a user). As such, the microphone may receive audible prompts or commands from the user that may be directed to the controller 150 .
  • refrigeration appliance 100 includes a network interface (not shown) that couples refrigeration appliance 100 (eg, controller 150 ) to network 190 such that refrigeration appliance 100 can transmit and receive information through network 190 .
  • Network 190 may be any wired or wireless network, such as a WAN, LAN or HAN.
  • the refrigeration appliance 100 includes a user detection assembly 186 .
  • the user detection component 186 includes one or more sensors configured to detect biometrics or personalized indicia corresponding to a particular individual user.
  • the user detection component 186 may include a forward-facing camera configured to recognize a user's face based on the captured two-dimensional image.
  • user detection component 186 may include a fingerprint imaging sensor configured to visually detect a user's fingerprint.
  • the user detection component 186 may include a signal detection sensor configured to detect in a wireless communication frequency band (eg, the BLE band using short wavelength UHF radio waves in the ISM frequency band of 2.4 to 2.485 GHz) device address.
  • the device address may be, for example, a programmed Bluetooth address of the mobile display 182 (eg, set on or with a personal computer, cell phone, tablet, stationary kitchen hub, etc.) and when to approach the refrigeration appliance 100.
  • scanner module 160 is included as part of user detection component 186 .
  • user detection component 186 may be configured to identify a user from a two-dimensional image captured at scanner module 160 .
  • the controller 150 is also configured to identify one or more defining characteristics under the user's elbow, such as skin color, arm/hand size, jewelry, typical clothing, and the like. As will be appreciated, identifying such defining features may be accomplished by edge matching, divide-and-conquer search, grayscale matching, histogram of receptive field responses, or another suitable routine (eg, based on one or more captured from scanner module 160 ). image is executed at the controller 150).
  • the scan sequence may be initiated by a predetermined user action, such as opening a door 128, detecting movement within a refrigerated compartment (eg, food preservation compartment 122), occupancy of the user detection assembly 186, or the presence of a user detection assembly 186, attesting user input at communication component 184 or integrated display 180, and the like.
  • a predetermined user action such as opening a door 128, detecting movement within a refrigerated compartment (eg, food preservation compartment 122), occupancy of the user detection assembly 186, or the presence of a user detection assembly 186, attesting user input at communication component 184 or integrated display 180, and the like.
  • one or more remote servers 192 are in operative communication with the controller 150 .
  • the remote server 192 may be used to host the retailer's point of sale system.
  • remote server 192 may be or include a retailer point-of-sale server that tracks, for example, identifiers and quantities of items purchased, time or date stamps of items purchased, pricing of items purchased, customer identifiers (ie, purchase customer's identifier), etc. Additionally or alternatively, the remote server 192 may be used to host the retailer's inventory management system.
  • the remote server 192 may include or be provided as a retailer inventory management server that, for example, tracks inventory data (eg, expiration data, location data, cost data, etc.) related to items offered for sale by the retailer.
  • the remote server 192 may include or be provided as a user database.
  • the remote server 192 may include a database that includes data about a particular user (or group of users) (ie, user profiles), such as item history for stored items, "shopping" for stored items to be purchased or replaced manifest”, identification data, one or more images, etc.
  • the remote server 192 may be used to host one or more other databases of information (eg, including product data related to commercially available items, such as barcodes, identifications, quantities related to the items) , price or expiration related data).
  • Remote server 192 may be implemented using any suitable computing device.
  • Remote server 192 may include one or more processors and one or more storage devices (ie, memories).
  • the one or more processors may be any suitable processing device (eg, processor cores, microprocessors, ASICs, FPGAs, microcontrollers, etc.) and may be one processor or operably connected processors .
  • the storage device may include one or more non-transitory computer-readable storage media, such as RAM, ROM, EEPROM, EPROM, flash memory devices, magnetic disks, etc., and combinations thereof.
  • the storage device may store data and instructions that are executed by the processor to cause the remote server 192 to perform operations.
  • the instructions may be instructions for receiving/transmitting user profile data signals, receiving/transmitting inventory management data signals, receiving/transmitting data signals related to stored items (ie, product data signals), and the like.
  • the storage device may also include data that may be retrieved, manipulated, created, or stored by the processor, such as user profile data, customer identification data, inventory data, expiration data, product data, and the like.
  • Data can be stored in one or more databases.
  • the one or more databases may be connected to the remote server 192 via a high bandwidth LAN or WAN, or may also be connected to the remote server 192 via the network 502 .
  • One or more databases can be partitioned so that they are located in multiple locations.
  • the remote server 192 includes a network interface such that the remote server 192 can connect to and communicate with one or more network nodes through one or more networks (eg, network 190).
  • the remote server 192 may exchange data with one or more nodes over the network 190.
  • remote server 192 may exchange data with controller 150 .
  • remote server 192 may also exchange data with any number of client devices over network 190 (eg, mobile display 182).
  • scanner module 160 and controller 150 are configured to capture barcodes via one or more reflected light pulses or two-dimensional images.
  • multiple sequential scans eg, at a predetermined rate or pattern
  • Sequential scans eg, previously captured pulses or images and most recently captured pulses or images
  • controller 150 may be recorded (eg, temporarily) and compared at controller 150 . Based on the comparison, changes or differences between consecutive images can be detected.
  • the scanning sequence may then be stopped or paused based on one or more end conditions, such as expiration of a predetermined time period, failure to detect further changes in consecutive images, or closing of door 128 .
  • the controller 150 may automatically attempt to identify items within the field of view of the scanner module 160 (eg, stored items such as food).
  • identifying such an item may be performed by looking up a captured barcode (eg, image or decoded barcode data) or correlating it with a pre-established database of product data, including identification (eg, what type of food product) identified or enclosed in a package on which a barcode is printed), the quantity of the item stored (e.g., the number, volume, or mass of individual units), the price of the item stored, or the expected expiration of the item stored (e.g., based on the The estimated expiration date of the known shelf life of the stored item).
  • FIGS. 4 and 5 illustrate a method of operating the refrigeration appliance 100 (FIG. 1) including the scanner module 160 described above.
  • Method 400 or 500 may be performed, for example, by controller 150 (FIG. 3).
  • controller 150 may communicate with scanner module 160, integrated display 180 (FIG. 3), mobile display 182 (FIG. 3), communication component 184, user detection component 186, or remote server 192, as discussed.
  • controller 150 may send and receive signals to and from scanner module 160 , integrated display 180 , mobile display 182 , communication component 184 , user detection component 186 , or remote server 192 .
  • Controller 150 may also generally be operably coupled to other suitable components of appliance 100 to facilitate operation of appliance 100 .
  • the method according to the present invention may allow for improved detection of one or more items within eg refrigeration appliances. Additionally or alternatively, the detection may be performed while reducing processing demands on one or more controllers, processors or processing devices of the refrigeration appliance.
  • the method 400 includes initiating a scanning sequence at the scanner module.
  • the scan sequence may include capturing one or more reflected pulses or two-dimensional images.
  • one or more scans of one or more specific stored items may be performed.
  • multiple scans may be obtained as part of a scan sequence.
  • the scanning sequence may include capturing multiple 2D images (eg, a first 2D image, a subsequent second 2D image, etc.), such as in a video feed or a series of consecutive still images (eg, taken according to predetermined rates or conditions) or captured).
  • the pulses or images ie, scans
  • the controller eg, as data signals
  • the capture can then be recorded (eg, temporarily) for further processing or evaluation.
  • 410 depends on identifying a particular user. For example, any further recording or evaluation of the scan sequence or pulses or images from the scanner assembly may be blocked until a particular user is identified (eg, automatically or alternatively, via manual selection).
  • Identification of a particular user may include receiving a user detection signal indicative of a biometric or a personalized indicia corresponding to a particular individual user, as described above.
  • the user detection signal may include a captured two-dimensional image of a particular user's face. From the captured two-dimensional image, the user can be identified.
  • the user detection signal may include a fingerprint image from which a particular user's fingerprint may be identified.
  • the user detection signal may include the detection device address of the particular user mobile display (e.g., detected on a wireless communication band such as the BLE band using short wavelength UHF radio waves in the ISM band of 2.4 to 2.485 GHz).
  • the scanning sequence is initiated in response to detecting movement within a refrigeration compartment (eg, a food preservation compartment) of the refrigeration appliance.
  • a refrigeration compartment eg, a food preservation compartment
  • scans from the scanner module can be prevented from being recorded or evaluated until movement is detected (eg, at the scanner module or a separate sensor).
  • movement may be detected by receiving light pulses of light reflected from a beam emitter of a scanner module.
  • changes in light or pixels captured by a scanner module can be detected (eg, between multiple images captured over time) that are indicative of changes in the scanner module's field of view, as generally understood. Movement of one or more objects.
  • movement may be detected in response to receiving a signal from a separate sensor, such as a switch selectively engaged with the door.
  • switches are generally understood and, for example, can simultaneously control the activation of lights for illuminating a refrigerated compartment.
  • opening the refrigerated door may activate the light and transmit a signal indicative of movement within the refrigerated compartment.
  • the scan sequence may continue until one or more end conditions are met.
  • the end condition may include the expiration of a predetermined period of time (eg, a time span) after the start of the corresponding motion detection.
  • the end condition may include failure to detect additional changes in sequential scans of the scan sequence. In other words, the scan sequence may end after the sequential pulses or image stops changing or further movement is detected.
  • the end condition may specifically require a preset number or time period of unaltered sequential scans.
  • the end condition may include detecting closing of the door of the refrigerated compartment. In other words, the scan sequence may end in response to the door being moved to the closed position.
  • method 400 includes barcode capture identifying a product barcode of a stored item on the scan sequence.
  • 420 may be provided for identifying at 410 that the product barcode is overlaid or within the field of view of the scanner assembly (ie, identifying the presence of the product barcode).
  • reflected light pulses may be detected as barcode reflections, as will be understood.
  • product barcodes may be identified within a two-dimensional image captured at a camera of a scanner assembly, as will be further understood.
  • method 400 includes processing barcode data captured by the barcode according to one or more predetermined user preferences. For example, barcode data that has been captured and recognized for product barcodes can be decoded to obtain text or character strings. This decoding is generally understood. If the decoding attempt is unsuccessful, method 400 may return to 410 (eg, to obtain a new capture of the product barcode).
  • the decoded barcode data is transmitted to a remote server.
  • the decoded barcode data may be transmitted from the controller of the refrigeration appliance via the connected network.
  • the barcode data may be associated with "personal data" of the user profile (eg, inventory or history of stored items).
  • the barcode data may be matched (or attempted to be matched) to a corresponding product identifier (eg, the name of the product or stored item on which the captured and decoded product barcode is held).
  • Matching barcode data may include comparing the decoded barcode data to a database of programmed barcodes (eg, stored in a remote server or another network-connected server). Once matched, method 400 may proceed to 440 . However, if a matching barcode is not possible (eg, because no corresponding programmed barcode was found), method 400 may still proceed to 440 .
  • method 400 includes establishing an item identifier for the stored item (eg, captured within the scan of 410 ).
  • the item identifier may be based on the processed barcode data of 430 . In other words, what the item identifier is (or can be) is determined, at least in part, by the result of processing the barcode data.
  • the barcode data may match the programmed barcode
  • 440 may include receiving product data (eg, the identification or name of the product, the quantity or size of the product, the product's pricing, expected expiration of the product, etc.).
  • product data eg, the identification or name of the product, the quantity or size of the product, the product's pricing, expected expiration of the product, etc.
  • the received product data may relate to stored items that match the corresponding programmed barcodes.
  • 440 may include initiating a secondary identification step.
  • a two-dimensional image of the stored item may be recorded if the preferences programmed by the user allow it.
  • a two-dimensional image may be captured at the scanner assembly (eg, during 410 or subsequently in response to 430). If capturing or storing a 2D image is not possible (eg, due to user preference, physical limitations, inappropriate image conditions, etc.), the user may be prompted to enter the item identifier manually (eg, using a physical keyboard at the refrigeration appliance, voice input or any other suitable input system, as will be understood).
  • method 400 includes directing an update to the user manifest with the established item identifier.
  • a list of users may typically be provided as currently in the refrigerated compartment (ie, stored items) or have been determined to be needed (eg, because the stored item has been removed from the refrigerated compartment, the stored item has expired, or has been An inventory or shopping list of products identified as user expectations).
  • the user list may include "personal data" stored locally on a remote server or refrigeration appliance.
  • the user manifest may be accessible on the user's mobile display (e.g., provided on or using a personal computer, cell phone, tablet, stationary kitchen hub, etc.) ).
  • the established item identifier may include one or more portions of the received product data. Thereby, these parts of the product data can be stored on the user list so that the user can quickly and easily understand the product.
  • the established item identifier may include 430 a two-dimensional image. Thereby, the captured two-dimensional image can be stored on the user checklist so that the user can quickly and easily understand the product.
  • method 500 includes initiating a scan sequence at the scanner module.
  • the scan sequence may include capturing one or more reflected pulses or two-dimensional images. Specifically, one or more scans of one or more specific stored items (eg, within a refrigerated compartment) may be performed. Optionally, multiple scans may be obtained as part of a scan sequence.
  • the scanning sequence may include capturing multiple 2D images (eg, a first 2D image, a subsequent second 2D image, etc.), such as in a video feed or a series of consecutive still images (eg, taken according to predetermined rates or conditions) or captured).
  • the pulses or images ie, scans
  • the controller eg, as data signals
  • the capture can then be recorded (eg, temporarily) for further processing or evaluation.
  • 510 depends on identifying a particular user. For example, any further recording or evaluation of the scan sequence or pulses or images from the scanner assembly may be blocked until a particular user is identified (eg, automatically or alternatively, via manual selection).
  • Identification of a particular user may include receiving a user detection signal indicative of a biometric or a personalized indicia corresponding to a particular individual user, as described above.
  • the user detection signal may include a captured two-dimensional image of a particular user's face. From the captured two-dimensional image, the user can be identified.
  • the user detection signal may include a fingerprint image from which a particular user's fingerprint may be identified.
  • the user detection signal may include the detection device address of a particular user mobile display (eg, detected on a wireless communication band such as the BLE band using short wavelength UHF radio waves in the ISM band of 2.4 to 2.485 GHz).
  • the scanning sequence is initiated in response to detecting movement within a refrigeration compartment (eg, a food preservation compartment) of the refrigeration appliance.
  • a refrigeration compartment eg, a food preservation compartment
  • scans from the scanner module can be prevented from being recorded or evaluated until movement is detected (eg, at the scanner module or a separate sensor).
  • movement may be detected by receiving light pulses of light reflected from a beam emitter of a scanner module.
  • changes in light or pixels captured by a scanner module can be detected (eg, between multiple images captured over time) that are indicative of changes in the scanner module's field of view, as generally understood. Movement of one or more objects.
  • movement may be detected in response to receiving a signal from a separate sensor, such as a switch selectively engaged with the door.
  • switches are generally understood and, for example, can simultaneously control the activation of lights for illuminating the refrigerated compartment.
  • opening the refrigerated door may activate the light and transmit a signal indicative of movement within the refrigerated compartment.
  • the scan sequence may continue until one or more end conditions are met.
  • the end condition may include the expiration of a predetermined period of time (eg, a time span) after the start of the corresponding motion detection.
  • the end condition may include failure to detect additional changes in sequential scans of the scan sequence. In other words, the scan sequence can end after the sequential pulses or image stops changing or further movement is detected.
  • the end condition may specifically require a preset number or time period of unaltered sequential scans.
  • the end condition may include detecting closing of the door of the refrigerated compartment. In other words, the scan sequence may end in response to the door being moved to the closed position.
  • method 500 includes barcode capture that identifies a product barcode of a stored item on the scan sequence.
  • 520 may be provided for identifying at 510 that the product barcode is overlaid or within the field of view of the scanner assembly (ie, identifying the presence of the product barcode).
  • reflected light pulses may be detected as barcode reflections, as will be understood.
  • product barcodes may be identified within a two-dimensional image captured at a camera of a scanner assembly, as will be further understood.
  • method 400 includes processing barcode data captured by the barcode according to one or more predetermined user preferences. Specifically, an attempt is made to decode barcode data of product barcodes that have been captured and identified. This decoding is generally understood to provide text or strings. If the decoding attempt is unsuccessful, method 500 may return to 510 (eg, to obtain a new capture of the product barcode).
  • 530 includes transmitting the decoded barcode data from the controller of the refrigeration appliance via the connected network.
  • the barcode data is associated with "personal data" of the user profile (eg, inventory or history of stored items).
  • the remote server may attempt to match barcode data to specific corresponding product identifiers with a set of programmed databases of "product data" (eg, the name of the product or stored item on which the captured and decoded product barcode is held) .
  • Matching barcode data may include comparing the decoded barcode data to a database of programmed barcodes (eg, stored in a remote server or another network-connected server).
  • the programmed barcode may include, for example, the corresponding identification or name of the product, the quantity or size of the product, the pricing of the product, the expected expiration of the product, and the like.
  • Method 500 may continue based on the results of the match. If data is available (ie, an attempt to match barcode data to a particular programmed barcode was successful), method 500 may continue to 542 . Additionally, if no images are included, the method may continue to 544 .
  • the method may proceed to 546 according to one or more user preferences (eg, set by the user at the refrigeration appliance). Specifically, the user may indicate whether it is acceptable to update the user list without an image of the product and whether it is acceptable to uniquely identify the product by the image. Thus, method 500 may proceed to 544 if the user selects the desired update of the image or the image-specific identification is acceptable. If the user has selected the image-specific identification as unacceptable, method 500 may proceed to 546 .
  • user preferences eg, set by the user at the refrigeration appliance. Specifically, the user may indicate whether it is acceptable to update the user list without an image of the product and whether it is acceptable to uniquely identify the product by the image.
  • method 500 may proceed to 544 if the user selects the desired update of the image or the image-specific identification is acceptable. If the user has selected the image-specific identification as unacceptable, method 500 may proceed to 546 .
  • method 500 includes transmitting product data that includes or corresponds to the programmed barcode data with the programmed barcode data (eg, identification or name of the product, quantity or size of the product, pricing of the product, expected expiration of the product, etc.) .
  • a remote server may transmit product data to "personal data" associated with the user and visible at the refrigeration appliance or mobile display.
  • the received product data may relate to stored items that match corresponding programmed barcodes.
  • product data may be established as an item identifier or part of an item identifier.
  • the method includes requesting a two-dimensional image corresponding to the product (ie, the stored item).
  • a two-dimensional image may be captured by the refrigeration appliance, such as during 510 or alternatively in response to 542 .
  • the two-dimensional image may be requested by a remote server (eg, using a search provider or a separately connected remote server).
  • the two-dimensional image can be transmitted to "personal data" associated with the user and can be viewed at the refrigeration appliance or on a remote or mobile display.
  • the two-dimensional image may be created as or part of the item identifier.
  • method 500 includes prompting for manual entry of an item identifier.
  • manual input may be requested (eg, through a message, notification, or display at the refrigeration appliance).
  • such input may be received from the user (eg, at the refrigeration appliance using a physical keyboard, voice input, or any other suitable input system, as will be appreciated).
  • the received manual input can be compared to a previously updated (eg, identified item or product) list. For example, if the manual input is determined to match the previous update (or within an acceptable margin of error), the manual input may be established as the item identifier or part of the item identifier.
  • method 500 may proceed to 550 .
  • method 500 includes directing an update to the user manifest with the established item identifier.
  • a list of users may typically be provided as currently in the refrigerated compartment (ie, stored items) or have been determined to be needed (eg, because the stored item has been removed from the refrigerated compartment, the stored item has expired, or has been An inventory or shopping list of products identified as user expectations).
  • the user list may include "personal data" stored locally on a remote server or refrigeration appliance.
  • the user manifest may be accessible on the user's mobile display (e.g., provided on or using a personal computer, cell phone, tablet, stationary kitchen hub, etc.) ).
  • a notification signal such as a prompt audio or visual output signal, may be transmitted to the refrigeration appliance to notify the user that the user list has been updated.

Landscapes

  • Engineering & Computer Science (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Physics & Mathematics (AREA)
  • Mechanical Engineering (AREA)
  • Thermal Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Cold Air Circulating Systems And Constructional Details In Refrigerators (AREA)

Abstract

La présente invention concerne un appareil de réfrigération comprenant un corps de boîte, un corps de porte, un module de scanneur et un dispositif de commande fonctionnellement accouplé au module de scanneur. Le corps de porte est articulé de manière rotative sur le corps de boîte, de façon à permettre d'atteindre sélectivement une chambre de réfrigération. Le module de scanneur est monté dans le corps de boîte. Le dispositif de commande est conçu pour déclencher un programme de fonctionnement. Le programme de fonctionnement comprend les étapes consistant à : déclencher une séquence de balayage au niveau du module de scanneur ; identifier, sur la base de la séquence de balayage, des captures de codes-barres de produits codes-barres d'articles stockés ; traiter des données de codes-barres des captures de codes-barres selon une ou plusieurs préférences d'utilisateur prédéfinies ; établir des identifiants d'article sur la base des données de codes-barres traitées ; et guider la mise à jour de la liste d'un utilisateur à l'aide des identifiants d'articles établis.
PCT/CN2021/129260 2020-11-09 2021-11-08 Appareil de réfrigération et procédé de suivi d'articles stockés WO2022095995A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US17/092,645 2020-11-09
US17/092,645 US20220146190A1 (en) 2020-11-09 2020-11-09 Refrigerator appliances and methods for tracking stored items

Publications (1)

Publication Number Publication Date
WO2022095995A1 true WO2022095995A1 (fr) 2022-05-12

Family

ID=81454286

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/129260 WO2022095995A1 (fr) 2020-11-09 2021-11-08 Appareil de réfrigération et procédé de suivi d'articles stockés

Country Status (2)

Country Link
US (1) US20220146190A1 (fr)
WO (1) WO2022095995A1 (fr)

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1690625A (zh) * 2004-04-21 2005-11-02 浙江工业大学 网络冰箱
CN102297564A (zh) * 2011-09-13 2011-12-28 合肥美菱股份有限公司 一种冰箱用食品管理系统及管理方法
CN104949460A (zh) * 2015-06-24 2015-09-30 广西大学 一种附带过期提醒的电冰箱
CN105402989A (zh) * 2015-12-30 2016-03-16 合肥美的电冰箱有限公司 冰箱的食品存储方法及冰箱
CN105605878A (zh) * 2016-02-19 2016-05-25 四川长虹电器股份有限公司 智能冰箱食品录入方法及系统
CN106203193A (zh) * 2015-05-04 2016-12-07 阿里巴巴集团控股有限公司 产品保质期监控方法、系统以及扫描装置、终端、编码盒
US20170219278A1 (en) * 2016-02-01 2017-08-03 Hon Hai Precision Industry Co., Ltd. Smart refrigeration system
CN107477971A (zh) * 2017-08-04 2017-12-15 三星电子（中国）研发中心 一种对冰箱内食物的管理方法和设备
CN108302892A (zh) * 2017-12-29 2018-07-20 青岛海尔股份有限公司 智能冰箱与基于智能冰箱的信息提醒方法
CN110500847A (zh) * 2018-05-16 2019-11-26 辜红珍 自动提醒冰箱内食品保质期的方法
CN110671881A (zh) * 2019-09-16 2020-01-10 珠海格力电器股份有限公司 一种冰箱保鲜控制方法和系统
CN111486656A (zh) * 2020-04-08 2020-08-04 海信（山东）冰箱有限公司 一种冷藏设备及其控制方法

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6313014B2 (ja) * 2013-08-27 2018-04-18 東芝ライフスタイル株式会社 カメラシステム、冷蔵庫
US11761701B2 (en) * 2016-01-25 2023-09-19 Sun Kyong Lee Refrigerator inventory device
CN110167141A (zh) * 2018-02-14 2019-08-23 华为技术有限公司 一种寻呼消息的传输方法
WO2019211821A1 (fr) * 2018-05-04 2019-11-07 Porteros De Luz Veronica Réfrigérateur compartimenté
AU2020227568B2 (en) * 2019-02-25 2023-08-10 Lg Electronics Inc. Refrigerator
KR20190104955A (ko) * 2019-08-23 2019-09-11 엘지전자 주식회사 냉장고 및 그의 구동 방법과 정보 제공 시스템
CN111277671A (zh) * 2020-03-18 2020-06-12 天津商业大学 一种物联网智能家用冰箱
US20220128291A1 (en) * 2020-10-23 2022-04-28 Mama Gaia Smart Fridge Corporation dba Mama Gaia Artificial intelligence (ai) refrigerator

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1690625A (zh) * 2004-04-21 2005-11-02 浙江工业大学 网络冰箱
CN102297564A (zh) * 2011-09-13 2011-12-28 合肥美菱股份有限公司 一种冰箱用食品管理系统及管理方法
CN106203193A (zh) * 2015-05-04 2016-12-07 阿里巴巴集团控股有限公司 产品保质期监控方法、系统以及扫描装置、终端、编码盒
CN104949460A (zh) * 2015-06-24 2015-09-30 广西大学 一种附带过期提醒的电冰箱
CN105402989A (zh) * 2015-12-30 2016-03-16 合肥美的电冰箱有限公司 冰箱的食品存储方法及冰箱
US20170219278A1 (en) * 2016-02-01 2017-08-03 Hon Hai Precision Industry Co., Ltd. Smart refrigeration system
CN105605878A (zh) * 2016-02-19 2016-05-25 四川长虹电器股份有限公司 智能冰箱食品录入方法及系统
CN107477971A (zh) * 2017-08-04 2017-12-15 三星电子（中国）研发中心 一种对冰箱内食物的管理方法和设备
CN108302892A (zh) * 2017-12-29 2018-07-20 青岛海尔股份有限公司 智能冰箱与基于智能冰箱的信息提醒方法
CN110500847A (zh) * 2018-05-16 2019-11-26 辜红珍 自动提醒冰箱内食品保质期的方法
CN110671881A (zh) * 2019-09-16 2020-01-10 珠海格力电器股份有限公司 一种冰箱保鲜控制方法和系统
CN111486656A (zh) * 2020-04-08 2020-08-04 海信（山东）冰箱有限公司 一种冷藏设备及其控制方法

Also Published As

Publication number Publication date
US20220146190A1 (en) 2022-05-12

Similar Documents

Publication Publication Date Title
CN108025871B (zh) 收容库的库存管理系统以及库存管理方法
US9208520B2 (en) Shelf life expiration date management
WO2021057820A1 (fr) Appareil de réfrigération et procédé de suivi d'articles stockés
JP2018146177A (ja) 物品貯蔵庫の在庫管理装置
JP7012263B2 (ja) 冷蔵庫
US11335010B2 (en) Methods for viewing and tracking stored items
US11493268B2 (en) Refrigerator appliance having a weight-detecting drawer assembly
JP7281755B2 (ja) 冷蔵庫
JP7012261B2 (ja) 冷蔵庫
US10785456B1 (en) Methods for viewing and tracking stored items
JP2022103368A (ja) 冷蔵庫
US11732960B2 (en) Refrigerator appliance having a weight-detecting shelf assembly
WO2022095995A1 (fr) Appareil de réfrigération et procédé de suivi d'articles stockés
JP2019102016A (ja) 庫内管理サーバ、電子商取引サーバ、商品購入支援システムおよびプログラム
JP7475000B2 (ja) 入出庫管理装置、入出庫管理システム、及び、入出庫管理方法
JP2021089105A (ja) 食材管理システム
US11800068B1 (en) Refrigerator camera modules and methods for conserving energy at the same
US20220065524A1 (en) Refrigerator appliance having a movable camera
US11927389B2 (en) Refrigerator appliance having a weight-detecting shelf assembly
US11692767B2 (en) Refrigerator appliance and methods of user identification
JP7289084B2 (ja) 冷蔵庫
WO2021057768A1 (fr) Appareil réfrigérant et procédé pour verrouiller sélectivement un sous-récipient
JP7289083B2 (ja) 冷蔵庫
JP2023099664A (ja) 冷蔵庫
JP2023100328A (ja) 食品管理システム、食品貯蔵庫およびプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21888687

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21888687

Country of ref document: EP

Kind code of ref document: A1