WO2022095995A1

WO2022095995A1 - Refrigeration appliance and method for tracking stored articles

Info

Publication number: WO2022095995A1
Application number: PCT/CN2021/129260
Authority: WO
Inventors: 柳春宰; C. 麦卡宾大卫
Original assignee: 海尔智家股份有限公司; 青岛海尔电冰箱有限公司; 海尔美国电器解决方案有限公司
Priority date: 2020-11-09
Filing date: 2021-11-08
Publication date: 2022-05-12
Also published as: US20220146190A1

Abstract

A refrigeration appliance, comprising a box body, a door body, a scanner module, and a controller operatively coupled to the scanner module. The door body is rotatably hinged to the box body, so as to provide a way to selectively reach a refrigeration chamber. The scanner module is mounted in the box body. The controller is configured to initiate an operating routine. The operating routine comprises: initiating a scan sequence at the scanner module; identifying, on the basis of the scan sequence, barcode captures of product barcodes of stored articles; processing barcode data of the barcode captures according to one or more predetermined user preferences; establishing article identifiers on the basis of the processed barcode data; and guiding update of a user's list by using the established article identifiers.

Description

Refrigeration appliance and method for tracking stored items

technical field

The present invention generally relates to tracking items within storage enclosures such as refrigeration appliances.

Background technique

Storage enclosures such as refrigeration appliances and food storage cabinets often provide an enclosed chamber for receiving multiple items or objects. For example, refrigeration appliances typically include a box that defines a refrigeration compartment. The user can place food or objects in the refrigerated compartment in order to prevent the spoilage of such food. Thereby, the useful life of the perishable item or object can be increased.

Over time, a large number of stored items (eg, food) may accumulate in the refrigeration compartment of the refrigerator. As the stored items accumulate, users of the refrigeration appliance may have difficulty identifying items located within the refrigeration appliance. Additionally, the user may have difficulty determining the quantity of certain items within the refrigeration appliance. Especially when multiple users are adding/removing items to/from a common refrigeration appliance without communicating with other users, the user may then accidentally buy too many or unwanted items. For example, certain food products do not perish easily in the refrigerated compartment, and such food products may be consumed infrequently. Thereby, the food product can be kept in the refrigerated compartment for a longer period of time. The user may forget the food item and buy a substitute despite already having an acceptable item. In this way, it may cause inconvenience to the user or cost money unnecessarily. Additionally or alternatively, some users may not be aware that certain items have been removed or consumed. As such, the user may not be able to replace or replenish such items.

Some existing appliances have attempted to address these problems by requiring the user to manually enter individual items that are stored to generate a list of stored items. Other appliances have used various methods, such as rulers, to estimate or guess the quantity or identification of stored items. However, this attempt is not cumbersome and prone to inaccuracy. Also, it may be difficult for a user to know when a particular item has been removed or expired and thus may need to be replaced.

Accordingly, it would be useful to have a refrigeration appliance with features for assisting a user in tracking the contents of the refrigeration appliance's refrigerated compartment. In particular, it would be useful to have a refrigerated appliance with features to assist a user in accurately tracking the refrigerated compartment contents of the refrigerated appliance in order to establish an inventory of stored items or a "shopping list" of desired items disposed within the refrigerated compartment.

SUMMARY OF THE INVENTION

Various aspects and advantages of the invention will be set forth in the description that follows, or will be apparent from the description, or may be learned by practice of the invention.

In an exemplary aspect of the present invention, a refrigeration appliance is provided. The refrigeration appliance may include a cabinet, a door, a scanner module, and a controller operably coupled to the scanner module. The door may be rotatably hinged to the cabinet to provide selective access to the refrigerated compartment. The scanner module can be mounted to the case. The controller may be configured to initiate operational routines. The operational routine may include: initiating a scan sequence at the scanner module; identifying barcode capture of a product barcode of the stored item based on the scan sequence; processing barcode data captured by barcode according to one or more predetermined user preferences; based on the processed barcode The data establishes an item identifier; and directs an update to the user list with the established item identifier.

In another exemplary aspect of the present invention, a method of operating a refrigeration appliance is provided. The method may include: initiating a scan sequence at the scanner module; and identifying barcode capture of a product barcode of the stored item based on the scan sequence. The method may further include processing the barcode data captured by the barcode according to one or more predetermined user preferences. The method may further include: establishing an item identifier based on the processed barcode data; and directing an update to the user manifest with the established item identifier.

These and other features, aspects and advantages of the present invention will become more readily understood with reference to the following description and appended claims. The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention.

Description of drawings

With reference to the accompanying drawings, the complete disclosure of the present invention is set forth in the specification for those skilled in the art to enable those skilled in the art to practice the invention, including the best embodiment of the invention.

FIG. 1 provides a front view of a refrigeration appliance according to an exemplary embodiment of the present invention.

Figure 2 provides a front view of a refrigeration appliance in accordance with an exemplary embodiment of the present invention, with the refrigerated door shown in an open position.

3 provides a system block diagram of a refrigeration appliance according to an exemplary embodiment of the present invention.

4 provides a flowchart illustrating a method of operating a refrigeration appliance according to an exemplary embodiment of the present invention.

5 provides a flowchart illustrating a method of operating a refrigeration appliance according to an exemplary embodiment of the present invention.

Detailed ways

Reference will now be made in detail to the embodiments of the present invention, one or more examples of which are illustrated in the accompanying drawings. Each example is given by way of explanation of the invention, not limitation of the invention. In fact, it will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the scope of the invention. For example, features shown or described as part of one embodiment can be used on another embodiment to yield yet another embodiment. Therefore, it is intended that the present invention cover such modifications and variations as fall within the scope of the appended claims and their equivalents.

As used herein, the term "or" is generally intended to be inclusive (ie, "A or B" is intended to mean "A or B or both"). The terms "first," "second," and "third" are used interchangeably to distinguish one element from another, and these terms are not intended to denote the position or importance of each element.

In general, the present invention provides a method of assisting in managing an inventory of food products within a storage enclosure such as a refrigeration appliance or food storage cabinet. The method may include one or more steps for determining what items (ie, stored items) were added to or removed from the storage housing. The determination may be made using information gathered using barcodes printed or embedded on one or more food items within the refrigerator.

Turning now to the drawings, FIG. 1 provides a front view of a refrigeration appliance 100 according to an exemplary embodiment of the present invention, with the refrigeration door 128 of the refrigeration appliance 100 shown in a closed position. FIG. 2 provides a front view of the refrigeration appliance 100 with the refrigerator door 128 shown in an open position to reveal the fresh food compartment 122 of the refrigeration appliance 100 .

The refrigeration appliance 100 includes a housing or box 120 extending along the vertical direction V between the top 101 and the bottom 102 . The bin 120 defines a refrigerated compartment for receiving food items for storage. In particular, the case 120 defines a food preservation compartment 122 disposed at or adjacent to the top 101 of the case 120 and a freezer compartment 124 disposed at or adjacent to the bottom 102 of the case 120 . It can be seen that the refrigeration appliance 100 is generally referred to as a bottom-mounted refrigerator. However, it is recognized that the benefits of the present invention are applicable to other types and styles of storage enclosures, such as overhead refrigeration appliances, side-by-side refrigeration appliances, or non-refrigerated food storage cabinet enclosures. Accordingly, the descriptions set forth herein are for illustrative purposes only and are not intended to limit any particular storage housing or refrigerator cavity configuration in any way.

The refrigerator door 128 is rotatably hinged to the edge of the box 120 for selective access to the food preservation compartment 122 . In addition, a freezing door 130 is arranged below the refrigerating door 128 so as to selectively enter the freezing compartment 124 . The freezer door 130 is coupled to a freezer drawer 142 (not shown) slidably mounted within the freezer compartment 124 . As described above, the refrigerator door 128 and the freezer door 130 are shown in the closed position in FIG. 1 , and the refrigerator door 128 is shown in the open position in FIG. 2 .

Turning now to FIG. 2, as will be understood by those skilled in the art, various storage components are installed within the food preservation compartment 122 to facilitate storage of food products therein. In particular, the storage components include a box 140 installed in the food preservation compartment 122 , a drawer 142 and a shelf 144 . Box 140, drawer 142, and shelf 144 are configured to receive stored items (e.g., beverages or solid foods) and may help organize such foods. As an example, the drawer 142 may receive fresh food (eg, vegetables, fruit, or cheese) and increase the useful life of such fresh food.

Refrigeration appliance 100 also includes features to assist a user in identifying food items located within food preservation compartment 122 or freezer compartment 124 . A user may utilize these features, for example, to view food products (ie, stored items) stored in food preservation compartment 122 or freezer compartment 124, or to create an inventory or list of such stored items. Such inventory or inventory may be formed, at least in part, using one or more product barcodes (eg, printed on or on the packaging in which the stored items are held). This feature is discussed in more detail below.

FIG. 3 provides a schematic diagram of the refrigeration appliance 100 . The refrigeration appliance 100 includes a controller 150 operatively coupled or in communication with components of a refrigeration system of the refrigeration appliance 100 that is configured to cool the food preservation compartment 122 or the freezer compartment 124 (FIG. 2). Components include compressor 170 , evaporator fan 172 and condenser fan 174 . Controller 150 may selectively operate such components to cool food preservation compartment 122 or freezer compartment 124 . The controller 150 is also in communication with a thermostat (eg, a thermocouple or thermistor). The thermostat may be provided in the food preservation compartment 122 or the freezer compartment 124 . The controller 150 may receive a signal corresponding to the temperature of the food preservation compartment 122 or the freezer compartment 124 from the thermostat. The controller 150 may also include an internal timer for calculating the elapsed time period.

The controller 150 may include memory and one or more microprocessors, CPUs, etc., such as a general-purpose or special-purpose microprocessor, for executing programmed instructions or micro-control code associated with the operation of the refrigeration appliance 100 . The memory may represent random access memory such as DRAM or read only memory such as ROM or FLASH. In some embodiments, the processor executes permanently programmed instructions stored in memory. For certain embodiments, the instructions include a software package configured to operate the appliance 100, or to execute an operating routine (eg, one or more of the

exemplary methods

400 and 500 described below with reference to FIGS. 4 and 5 ). ). The memory may be a separate component from the processor, or may be contained on a board within the processor. Alternatively, the controller 150 may be implemented without the use of a microprocessor (eg, using a combination of discrete analog or digital logic circuits; such as switches, amplifiers, integrators, comparators, flip-flops, AND gates, etc.) To perform control functions instead of relying on software.

The controller 150 may be provided at various locations throughout the refrigeration appliance 100 . Input/output (“I/O”) signals may be routed between the controller 150 and various operating components of the refrigeration appliance 100 . One or more components of refrigeration appliance 100 may communicate (eg, in electrical communication) with controller 150 via one or more conductive signal lines or a shared communication bus. Additionally or alternatively, one or more components of refrigeration appliance 100 may communicate with controller 150 (eg, wirelessly) via one or more wireless signal bands.

In some embodiments, the refrigeration appliance 100 further includes a camera or scanner module 160 . Scanner module 160 may be any type of device suitable for detecting or capturing printed product barcodes (eg, reflected light pulses or two-dimensional images). As an example, the scanner module 160 may include a pen-type reader or a laser scanner with a beam emitter and a reflective reader that captures reflected light pulses (eg, light pulses projected from the beam emitter). Once received, such light pulses can be identified as reflected from the product barcode (eg, before the barcode is decoded), as will be appreciated. As an additional or alternative example, the scanner module 160 may include a video camera or digital camera with an electronic image sensor (eg, a charge coupled device (CCD) or CMOS sensor). From one or more images, such as by edge matching, divide-and-conquer search, grayscale matching, histogram of receptive field responses, or another suitable routine (eg, based on one or more captured from scanner module 160 ) image is executed at controller 150) to detect or identify product barcodes. When assembled, the scanner module 160 is in communication with the controller 150 (eg, in electrical communication or wireless communication) such that the controller 150 can receive from the scanner module 160 corresponding reflected light pulses or images captured by the scanner module 160 Signal.

Typically, the scanner module 160 is provided on the refrigeration appliance 100 . In some embodiments, scanner module 160 is mounted within food preservation compartment 122 at its top (eg, adjacent top 101 ). For example, a scanner module 160 (eg, a beam emitter or camera) may be affixed to or guided through the walls defining the interior of the food preservation compartment 122 . In such an embodiment, as shown in FIG. 2, the scanner module 160 may point downward.

In some embodiments, the camera is directed toward one or more refrigeration compartments (eg, food preservation compartment 122 - FIG. 2 ). For example, scanner module 160 may be directed to at least a portion of any particular one or combination of drawer 142 and shelf 144 (FIG. 2). Thus, the scanner module 160 may capture reflected light pulses or images thereof from one of the drawers 142, all the drawers 142, one of the shelves 144, all the shelves 144, or any suitable combination thereof.

Although the scanner module 160 is illustrated as being mounted within the food preservation compartment 122 , it should be understood that additional or alternative embodiments include mounting in another suitable portion of the refrigeration appliance (such as the side of the bladder that defines the food preservation compartment 122 ). A scanner assembly (eg, a pen reader with an electronic image sensor, a laser scanner, or a digital camera) at the wall or door 128). Optionally, a scanner assembly mounted at the door 128 may be directed to the exterior or front of the refrigeration appliance 100, whereby an image of a user or area positioned forward from the refrigeration appliance 100 may be captured (eg, when the corresponding door is in closed position).

During use, such as during a scanning sequence, the scanner module 160 may capture one or more reflected light pulses or two-dimensional images. As an example, a scan sequence may be provided for emitting or projecting light from a light emitter, the reflection of which may be received at the scanner module 160 . Once received, the light pulse can be transmitted to the controller 150 and decoded (e.g., by measuring its intensity), as will be appreciated. As an additional or alternative example, a scan sequence may provide for capturing one or more two-dimensional images (eg, as a video feed or a series of consecutive still images) that may be transmitted to the controller 150 (eg, as a data signal) , as commonly understood.

In certain embodiments, the refrigeration appliance 100 includes an integrated display 180 . The integrated display 180 may be mounted on the refrigerator door 128 ( FIG. 1 ) or at any other suitable location on the refrigeration appliance 100 . The integrated display 180 is in communication with the controller 150 such that the integrated display 180 can receive signals from the controller 150 corresponding to light pulses or images captured by the scanner module 160 . The integrated display 180 may receive such signals from the controller 150 and visually present the image to the user. The integrated display 180 may include, for example, a liquid crystal display panel (LCD), a plasma display panel (PDP), or any other suitable mechanism for displaying images (eg, a projector).

Separate from or in addition to the integrated display 180 , the refrigeration appliance 100 may also include a communication component 184 in communication with the controller 150 . In general, communication assembly 184 may be mounted on any suitable portion of refrigeration appliance 100 , such as within cabinet 120 or door 128 . In certain embodiments, the communication components include speakers (eg, electrodynamic speakers, electrostatic speakers, planar magnetic speakers, piezoelectric speakers, etc.). As will be appreciated, the speakers may be configured to generate sound waves from one or more electrical signals (eg, digital sound signals received from the controller 150). Thereby, the speaker can audibly convey information to the user. In additional or alternative embodiments, the communication components include microphones (eg, dynamic microphones, ribbon microphones, fiber optic microphones, piezoelectric microphones, etc.). As will be appreciated, the microphone may generate one or more electrical signals (eg, to be received by the controller 150 ) from one or more received sound waves (eg, from a user). As such, the microphone may receive audible prompts or commands from the user that may be directed to the controller 150 .

In an exemplary embodiment, refrigeration appliance 100 includes a network interface (not shown) that couples refrigeration appliance 100 (eg, controller 150 ) to network 190 such that refrigeration appliance 100 can transmit and receive information through network 190 . Network 190 may be any wired or wireless network, such as a WAN, LAN or HAN.

In an alternative embodiment, the refrigeration appliance 100 includes a user detection assembly 186 . Typically, the user detection component 186 includes one or more sensors configured to detect biometrics or personalized indicia corresponding to a particular individual user. As an example, the user detection component 186 may include a forward-facing camera configured to recognize a user's face based on the captured two-dimensional image. As another example, user detection component 186 may include a fingerprint imaging sensor configured to visually detect a user's fingerprint. As yet another example, the user detection component 186 may include a signal detection sensor configured to detect in a wireless communication frequency band (eg, the BLE band using short wavelength UHF radio waves in the ISM frequency band of 2.4 to 2.485 GHz) device address. The device address may be, for example, a programmed Bluetooth address of the mobile display 182 (eg, set on or with a personal computer, cell phone, tablet, stationary kitchen hub, etc.) and when to approach the refrigeration appliance 100.

In some embodiments, scanner module 160 is included as part of user detection component 186 . As an example, user detection component 186 may be configured to identify a user from a two-dimensional image captured at scanner module 160 . In some such embodiments, the controller 150 is also configured to identify one or more defining characteristics under the user's elbow, such as skin color, arm/hand size, jewelry, typical clothing, and the like. As will be appreciated, identifying such defining features may be accomplished by edge matching, divide-and-conquer search, grayscale matching, histogram of receptive field responses, or another suitable routine (eg, based on one or more captured from scanner module 160 ). image is executed at the controller 150).

Optionally, the scan sequence may be initiated by a predetermined user action, such as opening a door 128, detecting movement within a refrigerated compartment (eg, food preservation compartment 122), occupancy of the user detection assembly 186, or the presence of a user detection assembly 186, attesting user input at communication component 184 or integrated display 180, and the like.

In some implementations, one or more remote servers 192 , such as web servers, are in operative communication with the controller 150 . The remote server 192 may be used to host the retailer's point of sale system. In other words, remote server 192 may be or include a retailer point-of-sale server that tracks, for example, identifiers and quantities of items purchased, time or date stamps of items purchased, pricing of items purchased, customer identifiers (ie, purchase customer's identifier), etc. Additionally or alternatively, the remote server 192 may be used to host the retailer's inventory management system. In other words, the remote server 192 may include or be provided as a retailer inventory management server that, for example, tracks inventory data (eg, expiration data, location data, cost data, etc.) related to items offered for sale by the retailer. Also additionally or alternatively, the remote server 192 may include or be provided as a user database. In other words, the remote server 192 may include a database that includes data about a particular user (or group of users) (ie, user profiles), such as item history for stored items, "shopping" for stored items to be purchased or replaced manifest”, identification data, one or more images, etc. Further, additionally or alternatively, the remote server 192 may be used to host one or more other databases of information (eg, including product data related to commercially available items, such as barcodes, identifications, quantities related to the items) , price or expiration related data).

Remote server 192 may be implemented using any suitable computing device. Remote server 192 may include one or more processors and one or more storage devices (ie, memories). The one or more processors may be any suitable processing device (eg, processor cores, microprocessors, ASICs, FPGAs, microcontrollers, etc.) and may be one processor or operably connected processors . The storage device may include one or more non-transitory computer-readable storage media, such as RAM, ROM, EEPROM, EPROM, flash memory devices, magnetic disks, etc., and combinations thereof. The storage device may store data and instructions that are executed by the processor to cause the remote server 192 to perform operations. For example, the instructions may be instructions for receiving/transmitting user profile data signals, receiving/transmitting inventory management data signals, receiving/transmitting data signals related to stored items (ie, product data signals), and the like.

The storage device may also include data that may be retrieved, manipulated, created, or stored by the processor, such as user profile data, customer identification data, inventory data, expiration data, product data, and the like. Data can be stored in one or more databases. The one or more databases may be connected to the remote server 192 via a high bandwidth LAN or WAN, or may also be connected to the remote server 192 via the network 502 . One or more databases can be partitioned so that they are located in multiple locations.

The remote server 192 includes a network interface such that the remote server 192 can connect to and communicate with one or more network nodes through one or more networks (eg, network 190). The remote server 192, in turn, may exchange data with one or more nodes over the network 190. In particular, remote server 192 may exchange data with controller 150 . Although not shown, it will be appreciated that remote server 192 may also exchange data with any number of client devices over network 190 (eg, mobile display 182).

In certain embodiments, scanner module 160 and controller 150 are configured to capture barcodes via one or more reflected light pulses or two-dimensional images. Alternatively, multiple sequential scans (eg, at a predetermined rate or pattern) may be obtained as part of a scan sequence. Sequential scans (eg, previously captured pulses or images and most recently captured pulses or images) may be recorded (eg, temporarily) and compared at controller 150 . Based on the comparison, changes or differences between consecutive images can be detected. Optionally, the scanning sequence may then be stopped or paused based on one or more end conditions, such as expiration of a predetermined time period, failure to detect further changes in consecutive images, or closing of door 128 .

Based on one or more barcode scans, the controller 150 may automatically attempt to identify items within the field of view of the scanner module 160 (eg, stored items such as food). As will be appreciated, identifying such an item may be performed by looking up a captured barcode (eg, image or decoded barcode data) or correlating it with a pre-established database of product data, including identification (eg, what type of food product) identified or enclosed in a package on which a barcode is printed), the quantity of the item stored (e.g., the number, volume, or mass of individual units), the price of the item stored, or the expected expiration of the item stored (e.g., based on the The estimated expiration date of the known shelf life of the stored item).

Turning now to FIGS. 4 and 5 , flowcharts of

methods

400 and 500 in accordance with exemplary embodiments of the present invention are provided. In general, FIGS. 4 and 5 illustrate a method of operating the refrigeration appliance 100 (FIG. 1) including the scanner module 160 described above.

Method

400 or 500 may be performed, for example, by controller 150 (FIG. 3). For example, controller 150 may communicate with scanner module 160, integrated display 180 (FIG. 3), mobile display 182 (FIG. 3), communication component 184, user detection component 186, or remote server 192, as discussed. During operation, controller 150 may send and receive signals to and from scanner module 160 , integrated display 180 , mobile display 182 , communication component 184 , user detection component 186 , or remote server 192 . Controller 150 may also generally be operably coupled to other suitable components of appliance 100 to facilitate operation of appliance 100 .

Advantageously, the method according to the present invention may allow for improved detection of one or more items within eg refrigeration appliances. Additionally or alternatively, the detection may be performed while reducing processing demands on one or more controllers, processors or processing devices of the refrigeration appliance.

4-5 depict steps performed in a particular order for purposes of example and discussion. Using the summary provided herein, one of ordinary skill in the art should appreciate that the steps of any method described herein may be modified, adapted, rearranged, omitted, or expanded in various ways without departing from the scope of the invention (except in otherwise described). As such, the steps of

methods

400 and 500 are non-exclusive, and one or more steps may be interchanged with or added to

other methods

500 or 400, as will be appreciated.

Turning in particular to FIG. 4, at 410, the method 400 includes initiating a scanning sequence at the scanner module. As described above, the scan sequence may include capturing one or more reflected pulses or two-dimensional images. Specifically, one or more scans of one or more specific stored items (eg, within a refrigerated compartment) may be performed. Optionally, multiple scans may be obtained as part of a scan sequence. For example, the scanning sequence may include capturing multiple 2D images (eg, a first 2D image, a subsequent second 2D image, etc.), such as in a video feed or a series of consecutive still images (eg, taken according to predetermined rates or conditions) or captured). When captured at the scanner module, the pulses or images (ie, scans) may be transmitted to the controller (eg, as data signals). The capture can then be recorded (eg, temporarily) for further processing or evaluation.

In some embodiments, 410 depends on identifying a particular user. For example, any further recording or evaluation of the scan sequence or pulses or images from the scanner assembly may be blocked until a particular user is identified (eg, automatically or alternatively, via manual selection). Identification of a particular user may include receiving a user detection signal indicative of a biometric or a personalized indicia corresponding to a particular individual user, as described above. As an example, the user detection signal may include a captured two-dimensional image of a particular user's face. From the captured two-dimensional image, the user can be identified. As another example, the user detection signal may include a fingerprint image from which a particular user's fingerprint may be identified. As yet another example, the user detection signal may include the detection device address of the particular user mobile display (e.g., detected on a wireless communication band such as the BLE band using short wavelength UHF radio waves in the ISM band of 2.4 to 2.485 GHz).

In additional or alternative embodiments, the scanning sequence is initiated in response to detecting movement within a refrigeration compartment (eg, a food preservation compartment) of the refrigeration appliance. Thereby, scans from the scanner module can be prevented from being recorded or evaluated until movement is detected (eg, at the scanner module or a separate sensor). As an example, movement may be detected by receiving light pulses of light reflected from a beam emitter of a scanner module. As another example, changes in light or pixels captured by a scanner module can be detected (eg, between multiple images captured over time) that are indicative of changes in the scanner module's field of view, as generally understood. Movement of one or more objects. As yet another example, movement may be detected in response to receiving a signal from a separate sensor, such as a switch selectively engaged with the door. Such switches are generally understood and, for example, can simultaneously control the activation of lights for illuminating a refrigerated compartment. Thus, opening the refrigerated door may activate the light and transmit a signal indicative of movement within the refrigerated compartment.

Optionally, the scan sequence may continue until one or more end conditions are met. As an example, the end condition may include the expiration of a predetermined period of time (eg, a time span) after the start of the corresponding motion detection. As another example, the end condition may include failure to detect additional changes in sequential scans of the scan sequence. In other words, the scan sequence may end after the sequential pulses or image stops changing or further movement is detected. The end condition may specifically require a preset number or time period of unaltered sequential scans. As yet another example, the end condition may include detecting closing of the door of the refrigerated compartment. In other words, the scan sequence may end in response to the door being moved to the closed position.

At 420 , method 400 includes barcode capture identifying a product barcode of a stored item on the scan sequence. Specifically, 420 may be provided for identifying at 410 that the product barcode is overlaid or within the field of view of the scanner assembly (ie, identifying the presence of the product barcode). As an example, reflected light pulses may be detected as barcode reflections, as will be understood. As an additional or alternative example, product barcodes may be identified within a two-dimensional image captured at a camera of a scanner assembly, as will be further understood.

At 430 , method 400 includes processing barcode data captured by the barcode according to one or more predetermined user preferences. For example, barcode data that has been captured and recognized for product barcodes can be decoded to obtain text or character strings. This decoding is generally understood. If the decoding attempt is unsuccessful, method 400 may return to 410 (eg, to obtain a new capture of the product barcode).

In some embodiments, the decoded barcode data is transmitted to a remote server. Specifically, the decoded barcode data may be transmitted from the controller of the refrigeration appliance via the connected network. At the remote server, the barcode data may be associated with "personal data" of the user profile (eg, inventory or history of stored items). Additionally or alternatively, the barcode data may be matched (or attempted to be matched) to a corresponding product identifier (eg, the name of the product or stored item on which the captured and decoded product barcode is held). Matching barcode data may include comparing the decoded barcode data to a database of programmed barcodes (eg, stored in a remote server or another network-connected server). Once matched, method 400 may proceed to 440 . However, if a matching barcode is not possible (eg, because no corresponding programmed barcode was found), method 400 may still proceed to 440 .

At 440 , method 400 includes establishing an item identifier for the stored item (eg, captured within the scan of 410 ). Specifically, the item identifier may be based on the processed barcode data of 430 . In other words, what the item identifier is (or can be) is determined, at least in part, by the result of processing the barcode data.

As an example, if the barcode data matches the programmed barcode, 440 may include receiving product data (eg, the identification or name of the product, the quantity or size of the product, the product's pricing, expected expiration of the product, etc.). Thus, the received product data may relate to stored items that match the corresponding programmed barcodes.

As an additional or optional example, if matching barcode data fails, 440 may include initiating a secondary identification step. For example, a two-dimensional image of the stored item may be recorded if the preferences programmed by the user allow it. For example, a two-dimensional image may be captured at the scanner assembly (eg, during 410 or subsequently in response to 430). If capturing or storing a 2D image is not possible (eg, due to user preference, physical limitations, inappropriate image conditions, etc.), the user may be prompted to enter the item identifier manually (eg, using a physical keyboard at the refrigeration appliance, voice input or any other suitable input system, as will be understood).

At 450, method 400 includes directing an update to the user manifest with the established item identifier. A list of users may typically be provided as currently in the refrigerated compartment (ie, stored items) or have been determined to be needed (eg, because the stored item has been removed from the refrigerated compartment, the stored item has expired, or has been An inventory or shopping list of products identified as user expectations). The user list may include "personal data" stored locally on a remote server or refrigeration appliance. Optionally, the user manifest may be accessible on the user's mobile display (e.g., provided on or using a personal computer, cell phone, tablet, stationary kitchen hub, etc.) ).

In some embodiments, the established item identifier may include one or more portions of the received product data. Thereby, these parts of the product data can be stored on the user list so that the user can quickly and easily understand the product. In additional or alternative embodiments, the established item identifier may include 430 a two-dimensional image. Thereby, the captured two-dimensional image can be stored on the user checklist so that the user can quickly and easily understand the product.

Turning now to FIG. 5, at 510, method 500 includes initiating a scan sequence at the scanner module. As described above, the scan sequence may include capturing one or more reflected pulses or two-dimensional images. Specifically, one or more scans of one or more specific stored items (eg, within a refrigerated compartment) may be performed. Optionally, multiple scans may be obtained as part of a scan sequence. For example, the scanning sequence may include capturing multiple 2D images (eg, a first 2D image, a subsequent second 2D image, etc.), such as in a video feed or a series of consecutive still images (eg, taken according to predetermined rates or conditions) or captured). When captured at the scanner module, the pulses or images (ie, scans) may be transmitted to the controller (eg, as data signals). The capture can then be recorded (eg, temporarily) for further processing or evaluation.

In some implementations, 510 depends on identifying a particular user. For example, any further recording or evaluation of the scan sequence or pulses or images from the scanner assembly may be blocked until a particular user is identified (eg, automatically or alternatively, via manual selection). Identification of a particular user may include receiving a user detection signal indicative of a biometric or a personalized indicia corresponding to a particular individual user, as described above. As an example, the user detection signal may include a captured two-dimensional image of a particular user's face. From the captured two-dimensional image, the user can be identified. As another example, the user detection signal may include a fingerprint image from which a particular user's fingerprint may be identified. As yet another example, the user detection signal may include the detection device address of a particular user mobile display (eg, detected on a wireless communication band such as the BLE band using short wavelength UHF radio waves in the ISM band of 2.4 to 2.485 GHz).

In additional or alternative embodiments, the scanning sequence is initiated in response to detecting movement within a refrigeration compartment (eg, a food preservation compartment) of the refrigeration appliance. Thereby, scans from the scanner module can be prevented from being recorded or evaluated until movement is detected (eg, at the scanner module or a separate sensor). As an example, movement may be detected by receiving light pulses of light reflected from a beam emitter of a scanner module. As another example, changes in light or pixels captured by a scanner module can be detected (eg, between multiple images captured over time) that are indicative of changes in the scanner module's field of view, as generally understood. Movement of one or more objects. As yet another example, movement may be detected in response to receiving a signal from a separate sensor, such as a switch selectively engaged with the door. Such switches are generally understood and, for example, can simultaneously control the activation of lights for illuminating the refrigerated compartment. Thus, opening the refrigerated door may activate the light and transmit a signal indicative of movement within the refrigerated compartment.

Optionally, the scan sequence may continue until one or more end conditions are met. As an example, the end condition may include the expiration of a predetermined period of time (eg, a time span) after the start of the corresponding motion detection. As another example, the end condition may include failure to detect additional changes in sequential scans of the scan sequence. In other words, the scan sequence can end after the sequential pulses or image stops changing or further movement is detected. The end condition may specifically require a preset number or time period of unaltered sequential scans. As yet another example, the end condition may include detecting closing of the door of the refrigerated compartment. In other words, the scan sequence may end in response to the door being moved to the closed position.

At 520, method 500 includes barcode capture that identifies a product barcode of a stored item on the scan sequence. Specifically, 520 may be provided for identifying at 510 that the product barcode is overlaid or within the field of view of the scanner assembly (ie, identifying the presence of the product barcode). As an example, reflected light pulses may be detected as barcode reflections, as will be understood. As an additional or alternative example, product barcodes may be identified within a two-dimensional image captured at a camera of a scanner assembly, as will be further understood.

At 530, method 400 includes processing barcode data captured by the barcode according to one or more predetermined user preferences. Specifically, an attempt is made to decode barcode data of product barcodes that have been captured and identified. This decoding is generally understood to provide text or strings. If the decoding attempt is unsuccessful, method 500 may return to 510 (eg, to obtain a new capture of the product barcode).

Once decoding is successful, 530 includes transmitting the decoded barcode data from the controller of the refrigeration appliance via the connected network. At the remote server, the barcode data is associated with "personal data" of the user profile (eg, inventory or history of stored items). Also, the remote server may attempt to match barcode data to specific corresponding product identifiers with a set of programmed databases of "product data" (eg, the name of the product or stored item on which the captured and decoded product barcode is held) . Matching barcode data may include comparing the decoded barcode data to a database of programmed barcodes (eg, stored in a remote server or another network-connected server). The programmed barcode may include, for example, the corresponding identification or name of the product, the quantity or size of the product, the pricing of the product, the expected expiration of the product, and the like.

Method 500 may continue based on the results of the match. If data is available (ie, an attempt to match barcode data to a particular programmed barcode was successful), method 500 may continue to 542 . Additionally, if no images are included, the method may continue to 544 .

If data is not available (ie, an attempt to match barcode data to a particular programmed barcode was unsuccessful), the method may proceed to 546 according to one or more user preferences (eg, set by the user at the refrigeration appliance). Specifically, the user may indicate whether it is acceptable to update the user list without an image of the product and whether it is acceptable to uniquely identify the product by the image. Thus, method 500 may proceed to 544 if the user selects the desired update of the image or the image-specific identification is acceptable. If the user has selected the image-specific identification as unacceptable, method 500 may proceed to 546 .

At 542 , method 500 includes transmitting product data that includes or corresponds to the programmed barcode data with the programmed barcode data (eg, identification or name of the product, quantity or size of the product, pricing of the product, expected expiration of the product, etc.) . For example, a remote server may transmit product data to "personal data" associated with the user and visible at the refrigeration appliance or mobile display. As described above, the received product data may relate to stored items that match corresponding programmed barcodes. Also, product data may be established as an item identifier or part of an item identifier.

At 544, the method includes requesting a two-dimensional image corresponding to the product (ie, the stored item). A two-dimensional image may be captured by the refrigeration appliance, such as during 510 or alternatively in response to 542 . Alternatively, the two-dimensional image may be requested by a remote server (eg, using a search provider or a separately connected remote server). Once requested and received, the two-dimensional image can be transmitted to "personal data" associated with the user and can be viewed at the refrigeration appliance or on a remote or mobile display. Also, the two-dimensional image may be created as or part of the item identifier.

At 546, method 500 includes prompting for manual entry of an item identifier. Specifically, manual input may be requested (eg, through a message, notification, or display at the refrigeration appliance). Once manual input is requested, such input may be received from the user (eg, at the refrigeration appliance using a physical keyboard, voice input, or any other suitable input system, as will be appreciated). The received manual input can be compared to a previously updated (eg, identified item or product) list. For example, if the manual input is determined to match the previous update (or within an acceptable margin of error), the manual input may be established as the item identifier or part of the item identifier.

After 542 , 544 or 546 , method 500 may proceed to 550 .

At 550, method 500 includes directing an update to the user manifest with the established item identifier. A list of users may typically be provided as currently in the refrigerated compartment (ie, stored items) or have been determined to be needed (eg, because the stored item has been removed from the refrigerated compartment, the stored item has expired, or has been An inventory or shopping list of products identified as user expectations). The user list may include "personal data" stored locally on a remote server or refrigeration appliance. Optionally, the user manifest may be accessible on the user's mobile display (e.g., provided on or using a personal computer, cell phone, tablet, stationary kitchen hub, etc.) ).

After the user list is updated, a notification signal, such as a prompt audio or visual output signal, may be transmitted to the refrigeration appliance to notify the user that the user list has been updated.

This written description uses examples to disclose the invention, including the best embodiment, and also to enable any person skilled in the art to practice the invention, including making and using any devices or systems and performing any incorporated methods. The patentable scope of the invention is defined by the claims, and may include other examples that occur to those skilled in the art. Such other examples are intended to fall within the scope of such other examples if they include structural elements that do not differ from the literal language of the claims, or if they include equivalent structural elements with insubstantial differences from the literal languages of the claims within the scope of the claims.

Claims

A refrigeration appliance, characterized in that the refrigeration appliance comprises:

a box, which defines a refrigeration compartment;

a door rotatably hinged to the box to provide selective access to the refrigeration compartment;

a scanner module mounted to the enclosure; and

a controller operably coupled to the scanner module, the controller configured to initiate an operational routine including:

initiating a scan sequence at the scanner module;

barcode capture to identify product barcodes of stored items based on the scan sequence;

processing the barcode data captured by the barcode according to one or more predetermined user preferences;

establishing an item identifier based on the processed barcode data; and

Updates to the user list are directed with the established item identifiers.
The refrigeration appliance of claim 1, wherein the scanner module includes a beam emitter or a camera directed toward the refrigeration compartment.
The refrigeration appliance of claim 1, wherein processing barcode data includes decoding the barcode capture.
4. The refrigeration appliance of claim 3, wherein processing barcode data includes transmitting the decoded barcode data to a remote server.
The refrigeration appliance of claim 1, wherein establishing an item identifier includes recording a two-dimensional image of the stored item.
6. The refrigeration appliance of claim 5, wherein directing the update to the user list includes initiating storage of the two-dimensional image on the user list.
6. The refrigeration appliance of claim 5, wherein the operating routine further comprises capturing the two-dimensional image during the scanning sequence.
The refrigeration appliance of claim 1, wherein establishing an item identifier includes receiving product data related to the stored item.
9. The refrigeration appliance of claim 8, wherein directing the update to the user list includes initiating storage of one or more portions of the received product data on the user list.
A method of operating a refrigeration appliance, characterized in that the method comprises the following steps:

initiating a scan sequence at the scanner module;

barcode capture to identify product barcodes of stored items based on the scan sequence;

processing the barcode data captured by the barcode according to one or more predetermined user preferences;

establishing an item identifier based on the processed barcode data; and

Updates to the user list are directed with the established item identifiers.
11. The method of claim 10, wherein the scanner module includes a beam emitter or camera directed toward the refrigerated compartment.
11. The method of claim 10, wherein processing barcode data comprises decoding the barcode capture.
13. The method of claim 12, wherein processing barcode data comprises transmitting the decoded barcode data to a remote server.
11. The method of claim 10, wherein establishing an item identifier includes recording a two-dimensional image of the stored item.
15. The method of claim 14, wherein directing the update to the user list includes initiating storage of the two-dimensional image on the user list.
15. The method of claim 14, further comprising capturing the two-dimensional image during the scanning sequence.
11. The method of claim 10, wherein establishing an item identifier includes receiving product data related to the stored item.
18. The method of claim 17, wherein directing the update to the user manifest includes initiating storage of one or more portions of the received product data on the user manifest.