WO2023209511A1 - Armoire de gestion d'inventaire intelligente - Google Patents

Armoire de gestion d'inventaire intelligente Download PDF

Info

Publication number
WO2023209511A1
WO2023209511A1 PCT/IB2023/054051 IB2023054051W WO2023209511A1 WO 2023209511 A1 WO2023209511 A1 WO 2023209511A1 IB 2023054051 W IB2023054051 W IB 2023054051W WO 2023209511 A1 WO2023209511 A1 WO 2023209511A1
Authority
WO
WIPO (PCT)
Prior art keywords
product
inventory management
management cabinet
storage area
housing
Prior art date
Application number
PCT/IB2023/054051
Other languages
English (en)
Inventor
Edward R. Kernick
Yasemar Perez
Original Assignee
Johnson & Johnson Surgical Vision, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US17/965,555 external-priority patent/US20230343444A1/en
Application filed by Johnson & Johnson Surgical Vision, Inc. filed Critical Johnson & Johnson Surgical Vision, Inc.
Publication of WO2023209511A1 publication Critical patent/WO2023209511A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/08—Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
    • G06Q10/087—Inventory or stock management, e.g. order filling, procurement or balancing against orders

Definitions

  • the present disclosure relates to smart inventory management cabinets for surgical implants.
  • the smart inventory management cabinets may be designed to store ophthalmic lenses, and more particularly to systems to dispense ophthalmic objects, record and track patient information, determine different lenses for patients, and to track and control inventory of ophthalmic lenses in the offices of eye care professionals.
  • An example inventory management cabinet includes a housing defining a storage area, the storage area being configured to receive a product, and a plurality of slots arranged within the housing, each of the slots being configured to receive a respective unit of the product.
  • the cabinet also includes at least one imaging device configured to capture information about the product.
  • the cabinet further includes a controller operably coupled to the at least imaging device, where the controller includes a processor and a memory having computer-executable instructions stored thereon. The controller is configured to detect activity within the storage area of the housing, and control the at least one imaging device to initiate capture one or more images of the product in response to detecting activity within the storage area of the housing.
  • activity within the storage area of the housing is optionally detected using the at least one imaging device.
  • the cabinet includes a motion sensor configured to detect presence of an object within the storage area of the housing.
  • activity within the storage area of the housing is detected using the motion sensor.
  • the cabinet includes a camera configured to detect the presence of an object within the storage area of the housing.
  • activity within the storage area is detected using the camera.
  • the cabinet includes a plurality of presence sensors configured to detect presence of a respective unit of the product in a respective one of the plurality of slots.
  • activity within the storage area of the housing is detected using the presence sensors.
  • each of the presence sensors includes a light emitter and a photodetector.
  • the controller is further configured to extract information from the one or more images of the product captured by the at least one imaging device.
  • the extracted information is used to inventory the product.
  • the controller is further configured to extract information from the one or more images of the product captured by the at least one imaging device by receiving the one or more images of the product from the at least one imaging device, and analyzing the one or images of the product to extract respective product identifiers associated with respective units of the product.
  • the controller is further configured to inventory the product based, at least in part, on the extracted information, for example, by decoding the respective product identifiers associated with the respective units of the product, and using the respective product identifiers, associating the respective units of the product with the respective slots.
  • each of the respective product identifiers is a one-dimensional (ID) barcode, a two-dimensional (2D) barcode, a three-dimensional (3D) barcode, a universal product code (UPC), a stock keeping unit (SKU), text, or a graphic.
  • ID one-dimensional
  • 2D two-dimensional
  • 3D three-dimensional
  • UPC universal product code
  • SKU stock keeping unit
  • the cabinet includes a plurality of visual indicators configured to indicate respective positions of the respective units of the product within the housing.
  • each of the visual indicators is at least one of a light emitter or a graphical display.
  • the housing includes an external frame, and at least one of the visual indicators is arranged on or adjacent to the external frame.
  • a respective visual indicator is arranged on, within, or adjacent to each one of the respective slots.
  • the cabinet includes a plurality of imaging devices, each of the imaging devices being configured to capture information about the product located in a respective region of the storage area of the housing.
  • the cabinet includes a human machine interface (HMI) configured to provide a communication interface between a user and the inventory management cabinet.
  • HMI human machine interface
  • each of the respective units of the product is a product package.
  • the product package includes a surgical implant, for example an intraocular lens or an orthopedic implant.
  • the product package includes a surgical tool.
  • the surgical tool may be related to orthopedic implants, but devices in other medical areas are also envisioned. By way of non-limiting example, the following devices may be included: sutures; staple tools; catheters; and capital equipment disposables.
  • the controller is further configured to transmit an inventory of the product over a network to a remote system such as a remote database, for example.
  • a remote system such as a remote database
  • the controller is further configured to receive a request for the desired unit of the product, transmit the request for the desired unit of the product over a network to a remote system, and receive a response from the remote system.
  • the response includes a slot where the desired unit of product is located.
  • the remote system comprises a database.
  • Another example inventory management cabinet includes a housing defining a storage area, the storage area being configured to receive a product, and a plurality of drawers arranged within the housing, each of the drawers comprising a plurality of slots, each of the slots being configured to receive a respective unit of the product.
  • the cabinet also includes a plurality of imaging devices configured to capture information about the product.
  • the cabinet further includes a controller operably coupled to the at least imaging device, where the controller includes a processor and a memory having computer-executable instructions stored thereon. The controller is configured to detect activity within the storage area of the housing, and control the imaging devices to initiate capture one or more images of the product in response to detecting activity within the storage area of the housing.
  • the system includes a first inventory management cabinet and a second inventory management cabinet. Additionally, the system includes a human machine interface (HMI) configured to provide a communication interface between a user and the first and second inventory management cabinets. It is also envisioned that additional inventory management cabinets may be included in the system, such that a system may be composed of one or more cabinets that are physically attached or separate.
  • HMI human machine interface
  • additional inventory management cabinets may be included in the system, such that a system may be composed of one or more cabinets that are physically attached or separate.
  • the definition of a singular particular location in the software or in the user interface can be composed of a leader cabinet and a follower. By way of non-limiting example, a further combination of leader and follower may make up the location, thus making the system scalable.
  • the method includes detecting activity within a storage area of a housing of an inventory management cabinet; automatically initiating capture one or more images of a product within the storage area of the housing in response to detecting activity within the storage area of the housing; and inventorying the product based, at least in part, using information extracted from the one or more images of the product.
  • the method optionally further includes providing the inventory management cabinet.
  • the inventory management cabinet is a cabinet as described above.
  • FIGURE 1 is a perspective view of an example inventory management cabinet.
  • FIGURE 2 is another perspective view of the example inventory management cabinet of Fig. 1.
  • FIGURE 3 is a cross section view of the example inventory management cabinet of Fig. 1 showing a plurality of imaging devices.
  • FIGURE 4 is a zoomed in view of the region shown in the dashed box of Fig. 3.
  • FIGURE 5 is a perspective view of a portion of the example inventory management cabinet of Fig. 1 showing a plurality of imaging devices.
  • FIGURE 6 is a perspective view of a portion of the example inventory management cabinet of Fig. 1 showing a motion sensor.
  • FIGURE 7 is a side view of a portion of the example inventory management cabinet of Fig. 1 showing a plurality of presence sensors.
  • FIGURE 8 is a zoomed-in view of a portion of Fig. 7.
  • FIGURE 9 is a perspective view of a portion of the example inventory management cabinet of Fig. 1 showing a plurality of slots in the storage area.
  • FIGURE 10 is a perspective view of a portion of the example inventory management cabinet of Fig. 1 showing a plurality of visual indicators.
  • FIGURE 11 is a perspective view of a portion of the example inventory management cabinet of Fig. 1 showing the electronics compartment including the controller.
  • FIGURE 12 is a perspective view of a portion of the example inventory management cabinet of Fig. 1 showing a cut-away portion in the housing that allows a user to access the cabinet and an output device (e.g., speakers).
  • an output device e.g., speakers
  • FIGURE 13 is a system overview of the inventory management cabinet in an example described herein.
  • FIGURE 14 is a schematic diagram of system inputs for the inventory management cabinet in an example described herein.
  • FIGURE 15 is a schematic diagram of system outputs for the inventory management cabinet in an example described herein.
  • FIGURE 16 is a diagram showing a plurality of product slots (by row and column) for the inventory management cabinet in an example described herein.
  • FIGURE 17 is a flow diagram illustrating example process operations for the inventory management cabinet in an example described herein.
  • FIGURE 18 is an architecture diagram for the inventory management cabinet in an example described herein.
  • FIGURE 19 is a perspective view of a modular system including a plurality of inventory management cabinets.
  • FIGURE 20 is an example computing device.
  • FIGURE 21 is an example operating environment for the implementations described herein.
  • FIGURES 22A-22B are perspective views of another example inventory management cabinet.
  • Fig. 22A illustrates a four-drawer implementation with dummy storage space.
  • Fig. 22B illustrates a four-drawer implementation without dummy storage space.
  • FIGURE 23 is a perspective view of the cabinet shown in Fig. 22B with an open drawer.
  • FIGURES 24A-24C illustrate components within the drawers of the cabinets shown in Figs. 22A-23.
  • Fig. 24A illustrates a tray.
  • Fig. 24B illustrates dividers, which can be arranged in the tray.
  • Fig. 24C illustrates a plurality of trays arranged inside a drawer with and without units of product.
  • Ranges may be expressed herein as from “about” one particular value, and/or to "about” another particular value. When such a range is expressed, an aspect includes from the one particular value and/or to the other particular value. Similarly, when values are expressed as approximations, by use of the antecedent "about,” it will be understood that the particular value forms another aspect. It will be further understood that the endpoints of each of the ranges are significant both in relation to the other endpoint, and independently of the other endpoint. As used herein, the terms “about” or “approximately” when referring to a measurable value such as an amount, a percentage, and the like, is meant to encompass variations of ⁇ 20%, ⁇ 10%, ⁇ 5%, or ⁇ 1% from the measurable value.
  • Inventory management cabinets, systems, and methods are described herein. Such cabinets, systems, and methods can be used to track/inventory product such as contact lenses.
  • the cabinets, systems, and methods described herein are capable of: (i) keeping track of units of product removed from storage, (ii) informing the user of stocking needs, (iii) automatically placing orders for product, (iv) including storage space for all regularly prescribed lenses, and/or (v) working during power outages.
  • FIGs. 1-12 an inventory management cabinet 100 is shown. Inventory management operations are described in US 2020-0364648 and US 2020-0364650, the disclosures of which are incorporated herein by reference in their entireties. Such operations may include inventorying product and facilitating product retrieval requests.
  • the cabinet 100 includes a housing 102 defining a storage area 102a, the storage area 102a being configured to receive a product, and a plurality of slots arranged within the housing 102, each of the slots being configured to receive a respective unit of the product.
  • Each of the respective units of the product is a product package.
  • the product package includes a surgical implant, for example an intraocular lens. It should be understood that an intraocular lens is provided only as an example. This disclosure contemplates that the product package may include other items or objects including, but not limited to, orthopedic implants (e.g., patella, tibial, femoral, spinal, etc. components) or surgical tools.
  • the cabinet 100 also includes at least one imaging device 104 configured to capture information about the product.
  • the cabinet includes a plurality of imaging devices, each of the imaging devices being configured to capture information about the product located in a respective region of the storage area 102a of the housing 102.
  • the imaging devices can optionally be arranged throughout the storage area 102a, each imaging device being configured to capture images of different regions of the storage area 102a.
  • the imaging device 104 is coupled to a controller (discussed below) through one or more communication links.
  • This disclosure contemplates the communication links are any suitable communication link.
  • a communication link may be implemented by any medium that facilitates data exchange including, but not limited to, wired, wireless and optical links.
  • the imaging device 104 is a digital camera such as a universal serial bus (USB) digital camera.
  • the digital camera may capture compressed images (e.g., MJPEG format) or uncompressed images (e.g., UYVY format).
  • compressed images e.g., MJPEG format
  • uncompressed images e.g., UYVY format.
  • USB digital camera is See3CAM_130-13MP 4K or more generally e-con Systems See3Cam series.
  • Another example of myriad suitable cameras would be the USB 3.1 High Resolution Autofocus Camera. Imaging devices are known in the art and therefore not described in further detail herein.
  • the cabinet 100 can include a plurality of imaging devices 104, and the imaging devices 104 can be arranged throughout the storage area 102a.
  • the imaging devices 104 there are twelve imaging devices 104, where 6 imaging devices 104 are arranged on each of right and left vertical supports 102b of the housing 102.
  • the vertical supports 102b are on the front side of the housing 102, and the imaging devices 104 are mounted such that the product within the storage area 102a is within the fields of view of the imaging devices 104.
  • the imaging devices 104 are arranged with equal spacing from one another along the vertical supports 102b.
  • Each of the imaging devices 104 is configured to capture images of different regions of the storage area 102a.
  • Such regions may or may not overlap with regions captured by other imaging devices 104. It should be understood that the number and/or arrangement of imaging devices 104 shown in Fig. 3 are provided only as examples. This disclosure contemplates providing a cabinet with a different number and/or arrangement of imaging devices.
  • the cabinet can include twelve digital cameras, for example USB cameras, and the digital cameras can be mounted in the cabinet as described above with regard to Fig. 3.
  • Each of the USB cameras is coupled to a controller through a USB cable (e.g., a communication link) via a peripheral component interconnect (PCI) card.
  • PCI peripheral component interconnect
  • Each PCI includes a plurality of USB ports (e.g., up to five USB ports). Accordingly, the USB cameras can be coupled to the controller via multiple PCI cards.
  • This disclosure contemplates connecting one, two, three, four, or five USB cameras to a single PCI card.
  • the controller to which the USB cameras are connected is a central processing unit (CPU).
  • a CPU includes at least one or more processing units and memory (see e.g., Fig. 20). CPUs are well known in the art and therefore not described further herein.
  • the cabinet performs a full scan with all USB cameras in less than about 2 seconds, where the full scan includes a computer vision-based analysis for presence/absence of a unit or units of product in the cabinet.
  • the controller to which the USB cameras are connected is a graphics processing unit (GPU).
  • a GPU is specialized device for handing images and graphics and includes at least one or more processing units and memory (see e.g., Fig. 20). GPUs are well known in the art and therefore not described further herein.
  • the cabinet performs a full scan with all USB cameras in less than 1 second, where the full scan includes a computer vision-based analysis for presence/absence of a unit or units of product in the cabinet.
  • the GPU runs frames in a rate adequate for the application suitable for the desired user experience of the system and in this particular non-limiting example at about 50 frames per second.
  • the USB cameras simultaneously capture images and these images are processed by the controller. It should be understood that the number of USB cameras provided above is only an example. This disclosure contemplates providing a cabinet with more than 12 USB cameras (e.g., 13, 14, 15, ... 24 or more USB cameras) or less than 12 USB cameras (e.g., 11, 10, 9, ... 1 USB cameras).
  • the cabinet 100 further includes a controller 106 operably coupled to the at least imaging device 104, where the controller 106 includes a processor and a memory having computerexecutable instructions stored thereon.
  • the HMI 114 includes a computing device (e.g., computing device 700 of Fig. 20).
  • the controller 106 can be implemented using a CPU or a GPU.
  • the controller 106 can be implemented using a single board computer (SBC), one or more microcontrollers (MCU), or combinations thereof.
  • SBC single board computer
  • MCU microcontrollers
  • One suitable SBC is the AAEON MAX-C246 Motherboard SBC from Aaeon Technology Inc. of New Taipei City, Taiwan .
  • the controller 106 is configured to detect activity within the storage area 102a of the housing 102, and control the at least one imaging device 104 to initiate capture one or more images of the product in response to detecting activity within the storage area 102a of the housing 102.
  • the activity detected may be an object (e.g., a user's hand and/or arm or any other part of a user's body or extension thereof) in the storage area 102a and/or a change of state (e.g., addition or removal of product) with the storage area 102a.
  • the cabinet 100 uses computer vision to detect activity within the storage area 102a of the housing 102.
  • the imaging device or devices continuously capture images of the product within the storage area 102b and such images are processed with computer vision methods to detect changes (e.g., restocking or removal of product).
  • the image capture and computer vision methods are triggered in response to activity detection by motion and/or the presence sensors described below.
  • Activity within the storage area 102a of the housing 102 is optionally detected using the at least one imaging device 104.
  • the controller 106 can be configured to receive one or more images captured by the at least one imaging device 104 and analyze the received images to identify an object such as a user's body part and/or product addition/removal.
  • This disclosure contemplates using any known techniques to detect activity from images including, but not limited to, computer vision.
  • activity detection is performed in real time.
  • the cabinet 100 optionally includes a motion sensor 108 configured to detect presence of an object, for example a hand, within the storage area 102a of the housing 102.
  • a motion sensor 108 configured to detect presence of an object, for example a hand, within the storage area 102a of the housing 102.
  • an output of the motion sensor 108 can be used to trigger the computer vision methods described below.
  • the motion sensor 108 is coupled to the controller 106 through one or more communication links.
  • This disclosure contemplates the communication links are any suitable communication link.
  • a communication link may be implemented by any medium that facilitates data exchange including, but not limited to, wired, wireless and optical links. This allows the controller 106 and the motion sensor 108 to exchange data (e.g., sensed signals, control signals, etc.).
  • Example motion sensors include passive infrared (IR) or microwave sensors. Passive IR sensors sense changes in temperature between background and objects (e.g., human body parts). Microwave sensors continuously emit radio waves and detect frequency shift in the reflected waves, which are the result of moving objects. Motion sensors are known in the art and therefore not described in further detail herein. This disclosure contemplates that the motion sensor 108 can be arranged on, within, or adjacent to an external frame of the housing 102. Optionally, the motion sensor 108 is arranged within the storage area 102a. It should be understood that the cabinet may include more than one motion sensor, i.e., a plurality of motion sensors. Optionally, activity detection is performed in real time.
  • the cabinet 100 optionally includes a plurality of presence sensors 110 configured to detect presence of a respective unit of the product in a respective one of the plurality of slots.
  • an output of the presence sensors 110 can be used to trigger the computer vision methods described below.
  • the presence sensors 110 are coupled to the controller 106 through one or more communication links.
  • This disclosure contemplates the communication links are any suitable communication link.
  • a communication link may be implemented by any medium that facilitates data exchange including, but not limited to, wired, wireless and optical links. This allows the controller 106 and the presence sensors 110 to exchange data (e.g., sensed signals, control signals, etc.).
  • activity within the storage area 102a of the housing 102 is detected using the presence sensors 110.
  • a presence sensor can be arranged on, within, or adjacent to a slot.
  • a presence sensor can be a light emitter and a photodetector.
  • Example presence sensors 110 include IR sensors, which include an IR emitter and an IR photodetector.
  • the IR photodetector's electrical properties are variable depending on the intensity of IR light. Accordingly, the presence or absence of a unit of the product can be detected by a change in the IR detector's output voltage. For example, when the unit of product is removed, the IR photodetector senses the IR beam, but when the unit of product is present, the IR beam is interrupted, each state being associated with a different detector output voltage.
  • activity detection is performed in real time.
  • the controller 106 is further configured to extract information from the one or more images of the product captured by the at least one imaging device 104.
  • the extracted information is used to inventory the product.
  • These operations can be initiated in response to detecting activity within the storage area 102a, which can be accomplished using computer vision, motion sensors, presence sensors, or combinations thereof.
  • the controller 106 can be configured to receive images of the product captured by the imaging device 104, analyze the images of the product to extract respective product identifiers associated with respective units of product, and inventory the product, based at least in part, on the extracted information.
  • This disclosure contemplates using any known techniques to analyze the images of the product including, but not limited to, computer vision.
  • image analysis is performed in real time.
  • the step of inventorying the product based, at least in part, on the extracted information can include decoding the respective product identifiers associated with the respective units of the product, and using the respective product identifiers, associating the respective units of the product with the respective slots.
  • Each of the respective product identifiers is a one-dimensional (ID) barcode, a two-dimensional (2D) barcode, a three-dimensional (3D) barcode, a universal product code (UPC), a stock keeping unit (SKU), text, or a graphic.
  • the cabinet 100 optionally includes a plurality of visual indicators 112 configured to indicate respective positions of the respective units of the product within the housing 102.
  • the visual indicators 112 are coupled to the controller 106 through one or more communication links.
  • This disclosure contemplates the communication links are any suitable communication link.
  • a communication link may be implemented by any medium that facilitates data exchange including, but not limited to, wired, wireless and optical links. This allows controller 106 and the visual indicators 112 to exchange data (e.g., control signals, etc.).
  • Each of the visual indicators 112 can be a light emitter (e.g., LED) or a graphical display. Additionally, each of the visual indicators 112 can be arranged on, within, or adjacent to each one of the respective slots.
  • Visual indicators 112 can be used to identify product, for example responsive to a user request, by illumination. Such illumination can be altered by intensity, flashing ON/OFF, etc. Additionally, visual indicators 112 can be used to identify product by expiration date (e.g., the product closest to expiration is identified by flashing light).
  • the cabinet 100 includes a human machine interface (HMI) 114 configured to provide a communication interface between a user and the inventory management cabinet.
  • HMI human machine interface
  • the HMI 114 is coupled to the controller 106 and/or a remote server through one or more communication links.
  • the communication links are any suitable communication link.
  • a communication link may be implemented by any medium that facilitates data exchange including, but not limited to, wired, wireless and optical links. This allows the HMI 114 and the controller 106 and/or remote server to exchange data (e.g., sensed data, control signals, etc.).
  • the HMI 114 includes a computing device (e.g., computing device 700 of Fig. 20).
  • the HMI 114 is a tablet computer.
  • the HMI 114 is a laptop computer, desktop computer, or mobile computing device.
  • the cabinet 100 includes an output device such as a speaker 116.
  • the output device is coupled to the controller 106 through one or more communication links.
  • This disclosure contemplates the communication links are any suitable communication link.
  • a communication link may be implemented by any medium that facilitates data exchange including, but not limited to, wired, wireless and optical links. This allows the output device and the controller 106 to exchange data (e.g., control signals, etc.).
  • the controller 106 is further configured to generate an alarm using the output device. Such alarm may be audible, visual, or combinations thereof.
  • the cabinet includes a power supply, which is optionally arranged in the housing 102.
  • the power supply can be used to provide power to one or more of the electrical components described herein.
  • the power supply can optionally be a battery.
  • the cabinet can be configured to connect to grid power (e.g., standard alternating current (A/C) power delivered to homes/businesses) during normal operation.
  • the power supply can deliver electrical power to the cabinet in response to disruption (e.g., power outages).
  • a modular inventory management system is also described herein.
  • the system includes a first inventory management cabinet and a second inventory management cabinet.
  • This disclosure contemplates that the first and second inventory management cabinets are cabinets as described above.
  • the system includes a human machine interface (HMI) configured to provide a communication interface between a user and the first and second inventory management cabinets.
  • HMI human machine interface
  • a modular system is shown in Fig. 19. It is also envisioned that additional inventory management cabinets may be included in the system.
  • An automated method for inventory management includes detecting activity within a storage area of a housing of an inventory management cabinet; automatically initiating capture one or more images of a product within the storage area of the housing in response to detecting activity within the storage area of the housing; and inventorying the product based, at least in part, using information extracted from the one or more images of the product.
  • the method optionally further includes providing the inventory management cabinet.
  • the inventory management cabinet is a cabinet as described above.
  • an inventory management cabinet 2100 can be operably coupled by one or more networks 2150.
  • the inventory management cabinet 2100 is described in detail herein.
  • the inventory management cabinet 2100 may be the cabinet 100 described with respect to Figs. 1-12 above or the cabinet 2200 described with respect to Figs. 22A-24C below.
  • the human machine interface 2102 may be the HMI 114 described with respect to Figs. 1-12 above.
  • the remote system 2104 can be a computing device (e.g., computing device 700 of Fig. 20) such as a server.
  • the remote system 2104 is a cloud-based system, e.g., one or more computer system resources such as processors and data storage devices that are allocated to serve the needs of the human machine interface 2102 on demand. Cloud-based systems are known in the art and not described in further detail below.
  • the remote system 2104 can include or access a database 2104A.
  • the remote system 2104 can include or access electronic medical records (EMRs) 2104B.
  • EMRs electronic medical records
  • the inventory management cabinet 2100, human machine interface 2102, and remote system 2104 discussed above can be connected by one or more networks 2150. This disclosure contemplates that the networks 2150 are any suitable communication network. The networks can be similar to each other in one or more respects.
  • the networks 2150 can include a local area network (LAN), a wireless local area network (WLAN), a wide area network (WAN), a metropolitan area network (MAN), a virtual private network (VPN), etc., including portions or combinations of any of the above networks.
  • the inventory management cabinet 2100, human machine interface 2102, and remote system 2104 can be coupled to the networks 2150 through one or more communication links.
  • This disclosure contemplates the communication links are any suitable communication link.
  • a communication link may be implemented by any medium that facilitates data exchange including, but not limited to, wired, wireless and optical links.
  • Example communication links include, but are not limited to, a LAN, a WAN, a MAN, Ethernet, the Internet, or any other wired or wireless link such as WiFi, WiMax, 3G, 4G, or 5G.
  • the inventory management cabinet 2100, human machine interface 2102, and remote system 2104 can interact to carry out the inventory and shipment/distribution functionalities as described in U.S. 2019-0311316, the disclosure of which is expressly incorporated herein by reference in its entirety.
  • the remote system 2104 can manage/maintain a database 2104A reflecting the inventory of product (e.g., contact lenses) stored in the inventory management cabinet 2100.
  • the remote system 2104 can receive messages with product inventory updates from the inventory management cabinet 2100.
  • the remote system 2104 can also query the database 2104A in response to requests from the inventory management cabinet 2100 and/or the human machine interface 2102.
  • a user e.g., a healthcare professional such as an eye care professional (ECP)
  • ECP eye care professional
  • the human machine interface 2102 can run an application and/or interface with the inventory management cabinet 2100 and/or the remote system 2104 using a web browser.
  • a controller of the inventory management cabinet can be configured to inventory the product based, at least in part, on the information about the product, and cause one or more of the visual indicators (e.g., visual indicators 112 of Figs. 1-12) that are associated with a desired unit of the product to actuate.
  • the visual indicators e.g., visual indicators 112 of Figs. 1-12
  • An example process is now described.
  • a user e.g., ECP
  • the human machine interface 2102 can transmit the request for the desired unit of the product to the inventory management cabinet 2100 via a network.
  • a controller of the inventory management cabinet 2100 can be configured to receive a request for the desired unit of the product. Additionally, the controller can be further configured to transmit the request for the desired unit of the product over the network to the remote system 2104.
  • the remote system 2104 can include and/or access an inventory database such as database 2104A.
  • the remote system can query the database to determine the position(s) of the desired unit(s) of product within the inventory management cabinet 2100.
  • the remote system can transmit a response to the controller over the network, and the controller can receive the response, which includes position(s) of the desired unit(s) of product within the storage area. It should be understood that such position(s) can include specific slots in the storage area of the cabinet.
  • the controller can be configured to transmit signals to actuate visual indicators to assist the user in identifying the position(s) of the desired unit(s) of product. These visual indicators highlight the locations of the desired units of the product for the benefit of the user. [0069]
  • the user then removes the desired units of the product.
  • activity within the storage area of the cabinet can be detected by the inventory management cabinet 2100, e.g., using the imaging devices, motion sensors, and/or presence sensors. This causes the controller to initiate a computer vision process.
  • the inventory management cabinet 2100 can read/decode the machine-readable labels (e.g., barcodes, UPC, SKU, text, graphics) associated with the units of the product.
  • the respective units of the product can then be associated with respective positions within the storage area.
  • the respective positions for each of the units of product can then be transmitted by the controller to the remote system.
  • the controller can be configured to transmit the updated inventory of the product over the network to the remote system, and the database can be updated accordingly.
  • the inventory management cabinet 2100 can be restocked effortlessly.
  • the user e.g., ECP
  • the controller can initiate the computer vision process.
  • the inventory management cabinet 2100 can read/decode the machine-readable labels (e.g., barcodes, UPC, SKU, text, graphics) associated with the units of the product.
  • the respective units of the product can then be associated with respective positions within the storage area.
  • the respective positions for each of the units of product can then be transmitted by the controller to the remote system.
  • the controller can be configured to transmit the updated inventory of the product over the network to the remote system, and the database can be updated accordingly.
  • the imaging device of the inventory management cabinet 2100 can be a digital camera, which is capable of capturing images of machine readable product identifiers such as a ID barcode, a 2D barcode, a 3D barcode, a UPC, or an SKU.
  • An imaging device is also capable of capturing images of text and/or a graphics, which can serve as machine readable product identifiers.
  • text and/or graphics can include, but are not limited to, brand name, product name, product description, logo, etc.
  • image processing techniques can be used to decode the machine readable product identifiers.
  • the step of inventorying the product based, at least in part, on the information about the product can include receiving images of the product captured by the imaging device, analyzing the images of the product to identify respective product identifiers associated with respective units of the product, decoding the respective product identifiers associated with the respective units of the product. After analyzing/decoding the respective product identifiers, it is possible to associate the respective units of the product with the respective positions within the storage area. This disclosure contemplates performing this association with either the controller and/or the remote system 2104.
  • the step of inventorying the product based, at least in part, on the information about the product further includes cropping a portion of the images of the product.
  • cropping the images it is possible to focus on the portion of the image expected to contain the product identifiers.
  • the cropped portion of the images is analyzed to identify the respective product identifiers associated with the respective units of the product.
  • the controller can be configured to transmit the images of the product over a network to the remote system 2104.
  • the images can be stored by the remote system for back up purposes, or image processing (some or all) can be offloaded from the controller to the remote system.
  • the controller can be configured to store the images of the product in the memory.
  • the images can be stored only temporarily (e.g., to allow for image processing) and then written over to minimize the storage requirements at the inventory management cabinet 2100.
  • the step of inventorying the product based, at least in part, on the information about the product further includes analyzing the images of the product to identify one or more of the respective positions within the storage area associated with a missing, unrecognized, or unreadable product identifier.
  • the controller can be configured to distinguish between missing units of product and units of product having unrecognized/unreadable product identifiers.
  • the former may be restocked, while the latter may be repositioned (e.g., flipped over, turned over, relabeled) to correctly orient the product identifier for reading by the computer vision process.
  • a machine learning algorithm can be used to determine whether one or more of the respective positions within the storage area associated with the missing, unrecognized, or unreadable product identifier contain a unit of the product.
  • the machine learning algorithm can be executed by the controller 109 in some implementations using traditional vision systems (e.g., pattern recognition), while in other implementations the machine learning algorithm can be executed by the remote system (i.e., offloaded from the inventory management cabinet 2100).
  • Machine learning algorithms can be trained using an existing dataset to perform a specific task such as identify missing, unrecognized, or unreadable product identifiers.
  • Machine learning algorithms are known in the art and therefore not described in further detail below.
  • An example machine learning algorithm is TensorFlow, which is an open source machine learning algorithm known in the art.
  • TensorFlow is only one example machine learning algorithm. This disclosure contemplates using other machine learning algorithms including, but not limited to, neural networks, support vector machines, nearest neighbor algorithms, supervised learning algorithms, unsupervised learning algorithms.
  • the step of inventorying the product based, at least in part, on the information about the product further includes analyzing the images of the product to determine, using a machine learning algorithm, a source of each of the respective units of the product.
  • a machine learning algorithm e.g., a computer vision system including an imaging device such as a camera can be used to capture images of both machine readable codes (barcodes, UPC, SKU) and text and graphics, and then imaging processing techniques can be used to decode the product identifiers.
  • a machine learning algorithm can be used to identify machine readable codes associated with different vendors or manufacturers. This allows the inventory management cabinet 2100 to select the appropriate decoding rules. Alternatively or additionally, a machine learning algorithm can be used to identify the source of a unit of product based on text and/or graphics (even in the absence of machine readable codes). This disclosure contemplates that the machine learning algorithm can be executed by the controller in some implementations, while in other implementations the machine learning algorithm can be executed by the remote system (i.e., offloaded from the inventory management cabinet 2100). Machine learning algorithms can be trained using an existing dataset to perform a specific task such as identify the source of units of the product. Machine learning algorithms are known in the art and therefore not described in further detail below. Example machine learning algorithms are provided above.
  • FIG. 22A-24C example inventory management cabinets 2200 according to another implementation are described.
  • the inventory management cabinets of Figs. 22A- 24C use computer vision to inventory product contained in the cabinets as described herein.
  • Fig. 22A illustrates one aspect where the cabinet 2200 includes a plurality of drawers 2202 (i.e., 4 drawers) and dummy storage area 2204.
  • the cabinet dimensions are 1721.50mm (67.8in) height, 600mm (23. Gin) width, and 650mm (25. Gin) depth.
  • the dimensions inside the drawer 2202 are 982mm (38.66in) width and 545mm (21.46in) depth. It should be understood that the configuration
  • each of the imaging devices 2206 is an autofocus digital camera that can capture images of the inside of any one of the four drawers 2202 shown in Fig. 22A.
  • the spacing between the autofocus digital cameras is 491mm (19. Sin). It should be understood that this spacing is provided only as an example and may have another value.
  • the digital cameras do not capture images of the dummy storage area 2204.
  • Fig. 22B illustrates another aspect where the cabinet 2200 includes a plurality of drawers 2202 (i.e., 4 drawers) without a dummy storage area.
  • the cabinet dimensions are 1413.50mm (55.6in) height, 600mm (23.6in) width, and 650mm (25.6in) depth.
  • the dimensions inside the drawer 2202 are 982mm (38.66in) width and 545mm (21.46in) depth. It should be understood that the configuration (e.g., number of drawers) and dimensions are provided only as examples. This disclosure contemplates providing a cabinet with different configurations and/or dimensions.
  • three imaging devices 2206 are mounted at the top of the cabinet 2200.
  • the imaging devices 2206 are arranged to capture information about the product located inside the drawers 2202.
  • the imaging devices 2206 are mounted flush with the top of the cabinet 2200.
  • each of the imaging devices 2206 is an autofocus digital camera that can capture images of the inside of any one of the four drawers 2202 shown in Fig. 22B.
  • the spacing between the autofocus digital cameras is 327mm (12.9in). It should be understood that this spacing is provided only as an example and may have another value.
  • the computer vision methods described herein are triggered by motion sensor(s) (e.g., motion sensor 108 of Figs. 1-12) and/or product sensors (e.g., presence sensors 110 of Figs. 1-12).
  • the cabinets 2200 shown in Figs. 22A-22B can include one or more visual indicators such as LEDs (e.g., visual indicators 112 of Figs. 1-12) to illuminate the location of desired product(s) inside the drawers 2202.
  • Each drawer 2202 can include one or more trays 2210. It should be understood that the number and/or arrangement of trays 2210 within a drawer is provided only as an example. Additionally, dividers 2212 can be arranged inside the trays 2210. The dividers 2212 create slots for holding units of product. As described herein, the product may be surgical implants including, but not limited to, lOLs or orthopedic implants. The dividers 2212 can be created with different dimensions to accommodate different sized product packaging. Using trays 2210 and dividers 2212, it is possible to provide reconfigurable storage.
  • the logical operations described herein with respect to the various figures may be implemented (1) as a sequence of computer implemented acts or program modules (i.e., software) running on a computing device (e.g., the computing device described in Fig. 20), (2) as interconnected machine logic circuits or circuit modules (i.e., hardware) within the computing device and/or (3) a combination of software and hardware of the computing device.
  • a computing device e.g., the computing device described in Fig. 20
  • the logical operations discussed herein are not limited to any specific combination of hardware and software.
  • the implementation is a matter of choice dependent on the performance and other requirements of the computing device. Accordingly, the logical operations described herein are referred to variously as operations, structural devices, acts, or modules.
  • an example computing device 700 upon which the methods described herein may be implemented is illustrated. It should be understood that the example computing device 700 is only one example of a suitable computing environment upon which the methods described herein may be implemented.
  • the computing device 700 can be a well- known computing system including, but not limited to, personal computers, servers, handheld or laptop devices, multiprocessor systems, microprocessor-based systems, network personal computers (PCs), minicomputers, mainframe computers, embedded systems, and/or distributed computing environments including a plurality of any of the above systems or devices.
  • Distributed computing environments enable remote computing devices, which are connected to a communication network or other data transmission medium, to perform various tasks.
  • the program modules, applications, and other data may be stored on local and/or remote computer storage media.
  • computing device 700 typically includes at least one processing unit 706 and system memory 704.
  • system memory 704 may be volatile (such as random access memory (RAM)), nonvolatile (such as read-only memory (ROM), flash memory, etc.), or some combination of the two.
  • RAM random access memory
  • ROM read-only memory
  • flash memory etc.
  • This most basic configuration is illustrated in Fig. 20 by dashed line 702.
  • the processing unit 706 may be a standard programmable processor that performs arithmetic and logic operations necessary for operation of the computing device 700.
  • the computing device 700 may also include a bus or other communication mechanism for communicating information among various components of the computing device 700.
  • Computing device 700 may have additional features/functionality.
  • computing device 700 may include additional storage such as removable storage 708 and nonremovable storage 710 including, but not limited to, magnetic or optical disks or tapes.
  • Computing device 700 may also contain network connection(s) 716 that allow the device to communicate with other devices.
  • Computing device 700 may also have input device(s) 714 such as a keyboard, mouse, touch screen, etc.
  • Output device(s) 712 such as a display, speakers, printer, etc. may also be included.
  • the additional devices may be connected to the bus in order to facilitate communication of data among the components of the computing device 700. All these devices are well known in the art and need not be discussed at length here.
  • the processing unit 706 may be configured to execute program code encoded in tangible, computer-readable media.
  • Tangible, computer-readable media refers to any media that is capable of providing data that causes the computing device 700 (i.e., a machine) to operate in a particular fashion.
  • Various computer-readable media may be utilized to provide instructions to the processing unit 706 for execution.
  • Example tangible, computer-readable media may include, but is not limited to, volatile media, non-volatile media, removable media and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data.
  • System memory 704, removable storage 708, and nonremovable storage 710 are all examples of tangible, computer storage media.
  • Example tangible, computer-readable recording media include, but are not limited to, an integrated circuit (e.g., field- programmable gate array or application-specific IC), a hard disk, an optical disk, a magneto-optical disk, a floppy disk, a magnetic tape, a holographic storage medium, a solid-state device, RAM, ROM, electrically erasable program read-only memory (EEPROM), flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices.
  • an integrated circuit e.g., field- programmable gate array or application-specific IC
  • a hard disk e.g., an optical disk, a magneto-optical disk, a floppy disk, a magnetic tape, a holographic storage medium, a solid-state device
  • RAM random access memory
  • ROM read-only memory
  • EEPROM electrically erasable program read-only memory
  • flash memory or
  • the processing unit 706 may execute program code stored in the system memory 704.
  • the bus may carry data to the system memory 704, from which the processing unit 706 receives and executes instructions.
  • the data received by the system memory 704 may optionally be stored on the removable storage 708 or the non-removable storage 710 before or after execution by the processing unit 706.
  • the computing device In the case of program code execution on programmable computers, the computing device generally includes a processor, a storage medium readable by the processor (including volatile and non-volatile memory and/or storage elements), at least one input device, and at least one output device.
  • One or more programs may implement or utilize the processes described in connection with the presently disclosed subject matter, e.g., through the use of an application programming interface (API), reusable controls, or the like.
  • API application programming interface
  • Such programs may be implemented in a high level procedural or object-oriented programming language to communicate with a computer system.
  • the program(s) can be implemented in assembly or machine language, if desired. In any case, the language may be a compiled or interpreted language and it may be combined with hardware implementations.
  • the example smart inventory management cabinet system is comprised of a SMART CABINET and IOL boxes deployed on customer sites, cloud back-end and client applications (web and local interface).
  • the system serves for identification and selection of consigned IOL box inventory and the cabinet control system software reports it to loT Edge, and it reports the inventory to the cloud in real-time.
  • Events such as IOL box addition or removal by users are tracked by sensors and reconciled with identifying information (e.g., barcode) for proper location and pass on to loT Edge software to manage/mitigate low inventory scenarios. It uses cameras to read the barcodes based on the commands received from loT Edge software through loT Interface.
  • identifying information e.g., barcode
  • the SMART CABINET is an IOL box storage box with SMART connectivity.
  • the SMART CABINET contains the high-end single board computer (SBC) as a main processor (or any appropriately specified PC). Cameras and speakers are connected to SBC.
  • SBC single board computer
  • the system interfaces with local user interface, through a graphical user interface (GUI).
  • GUI graphical user interface
  • the example smart inventory management cabinet system is controlled and monitored through loT Edge device connected with the Cloud. It also has wireless connectivity through Wi-Fi network.
  • the barcode and corresponding slot id will be maintained in local cabinet control system (CCS) software (SW).
  • the ICD (interface control commands) commands are initiated from loT Edge and send to cabinet control system through loT Interface.
  • the CCS sends respective responses to loT Edge for the commands received from loT Edge.
  • CCS sends alert message to loT Edge based on the hardware change events.
  • the CCS SW sends either response / alert message.
  • alert messages are sent to loT edge and the ICD commands received from loT Edge are sent to CCS SW through loT Interface.
  • the CCS will not receive any acknowledgement back from loT Edge.
  • the example smart inventory management cabinet system has the human machine interface (HMI) as user interface.
  • Light emitting diodes (LED) to indicate the slot selection. Cameras are connected through USB port to capture the image and read the IOL box barcode and the LED indication is used to locate the requested IOL box.
  • the camera reads the barcode of the IOL boxes and identify the boxes.
  • the image processing techniques are used for the proper identification.
  • the slot id and corresponding barcode details are maintained in CCS local file.
  • the Cabinet Control System SW is responsible to manage hardware's connected in the cabinet.
  • the CCS SW is connected with below devices as input:
  • Motion Sensor connected with microcontroller unit (MCU) extension board through general purpose input / output (GPIO). Output of motion sensor is communicated through controller area network (CAN) bus.
  • MCU microcontroller unit
  • GPIO general purpose input / output
  • CAN controller area network
  • Presence Sensor connected with MCU extension board through GPIO. Output of presence sensor is communicated through CAN bus.
  • Dual in-line package (DIP) switch is connected in GPIO of IO Expander and MCU gets the switch output through serial peripheral interface (SPI) communication for identifying the MCU ID.
  • SPI serial peripheral interface
  • the ICD commands received from loT Edge are shared to CCS SW through sockets.
  • Internally Command Dispatcher is one of the module in CCS SW and it does the following to execute commands: add the commands into the message queue (first in first out (FIFO) logic); validate received commands; parse the received commands; and send the corresponding events to the respective modules to execute the commands.
  • FIFO first in first out
  • the Camera is connected through the USB 3.0 multi ports adapter.
  • CCS invokes the Image Processing Engine module.
  • This Image Processing Engine module does the following to get barcode results: Cameras are triggered to capture the image; Images are captured in parallel with number of cameras for parallel operation shall be preset; Captured images are processed and barcodes are read; and Scanned barcodes are sent to loT Edge.
  • Motion sensors are connected to the NMI pin of the MCU extension board.
  • the motion sensor observes the user movement and stores the motion state in queue. When the motion is detected, the following are done: Trigger all the MCU extension board from sleep mode to wakeup mode; Turn on the power of all the presence sensors (IR sensors) connected to MCU extension; MCU extension board sends the motion detected message on the CAN bus.
  • Presence sensors are connected to the GPIO pin of the MCU extension board.
  • the MCU extension board identifies the slot ID of IOL box insertion or removal based on the presence sensor (IR sensor) input and sends the corresponding message on CAN bus.
  • the cameras may be constantly streaming in order to detect changes in the field of view.
  • the algorithm will detect, for example, the removal or placement of a package in field of view.
  • the system will discount the product, update the database and send the information to the cloud.
  • the image from the camera covering the area of interest is then passed on to other parts of the algorithm to correct optical aberrations, cropping, enhance image quality and decode information of the cropped area. Once decoded the information may be sent to the cloud to update.
  • LED tube lights are connected in GPIO of IO Expander and controlled by MCU through SPI communication.
  • Main indicator is connected in GPIO of IO Expander and controlled by MCU through SPI communication.
  • the CCS SW is directly communicated to MCU extension board through CAN bus.
  • the Main indicator are connected to MCU extension board through SPI communication.
  • the slot LED is LED light which illuminates with corresponding color on slot ID (or group of slots) of requested IOL box to notify user.
  • ICD commands includes the information of slot LED, color information and optional parameters like LED glow time.
  • the CCS SW plays audio through speaker to give warning about wrong pick up of IOL box.
  • the audio line output of the SBC is connected to the speaker.
  • LED Tube light is used to get better quality of image when camera starts to capture the images for barcode results of IOL box. This light is turned ON/OFF based on the Scan query start/end events.
  • loT Edge SW is the main interface with user and cloud. All hardware's for loT connectivity are managed by loT Edge.
  • the loT Edge is connected to CCS software through an loT interface.
  • the loT interface is using TCP/USB protocol to communicate with loT Edge.
  • ICD interface control commands
  • loT Edge and send to cabinet system.
  • Responses and alerts are received in response to commands sent and as response to hardware change event.
  • CCS SW sends response / alert message.
  • alert messages are to be sent to loT edge.
  • the CCS SW is indirectly connected to LED through the CAN bus.
  • the visual notification is used to locate the requested IOL box with slot or group of slots.
  • To achieve this ICD commands includes the information about slot LED, color information and optional parameters.
  • the CCS SW When the CCS SW receives LED turn ON / OFF commands from loT Interface, the CCS SW triggers the Visual Indicator to send the turn ON/OFF LED message on CAN bus to MCU extension board to turn on the specified LED with given RGB value through Router application.
  • Motion Detector is one of the module in CCS SW.
  • MCU will send the message on CAN bus indicating that the motion status such as motion started, and motion completed.
  • the router application shall receive the CAN message and decode the message and send the message to Motion Detector.
  • the Motion Detector then sends the message to Post Engine to send it to loT Edge through loT Interface.
  • Presence Sensor is connected through the GPIO in MCU extension board.
  • Occupancy Detector is one of the module in CCS SW which sends the IR sensor current status query to Router application upon system startup.
  • MCU firmware checks the presence sensor state changes in a polling method. This state change shall happen due to IOL box movement (insertion / removal change). MCU sends the message on CAN bus to indicate the presence sensor status such as Box inserted / retrieved. On the SBC, the router application receives the CAN message decodes it and send the message to Occupancy Detector.
  • the Buzzer Alarm is responsible to turn ON / OFF the speaker based on the event received from Command Dispatcher. It plays audio(unmute before playing) through speaker to give warning about wrong pick up of IOL box.
  • the audio line output of the SBC is connected to the speaker.
  • FIGs. 18 and 19 an example modular smart inventory management cabinet system integrated with a vision system, cabinet control software, and an loT interface is illustrated.
  • the integrated system handles translates the physical IOL inventory into inventory data with the use of the vision system, which then the cabinet control system uploads to the cloud for meaningful blocks. The blocks of information are then accessible via the web application.
  • a plurality of cameras 1800 are shown. There are 12 cameras 1800 in Fig. 18. It should be understood that this disclosure contemplates providing a smart inventory management cabinet system with more or less than 12 cameras 1800.
  • images captured by the cameras 1800 are timestamped and queued for processing by a trained machine learning (ML) algorithm.
  • ML machine learning
  • the system performs occupancy detection for all of the slots in the cabinet, for example, by analyzing captured images for changes from "empty" to "occupied” status or vice versa. Occupancy detection is performed 2 times per second. It should be understood that the rate of 2 times per second is provided only as an example. This disclosure contemplates performing occupancy detection at a higher or lower rate.
  • Images of slots with changes are then cropped and queued for barcode decoding and/or optical character recognition (OCR).
  • OCR optical character recognition
  • the system performs barcode decoding and/or OCR to determine the serial number, expiration data, model/variant/diopter, etc. of the product packages.
  • information about the occupancy status and product packages obtained at 1804 and 1806 are stored locally by the system, for example, in a database.
  • a remote database is updated such that a web-based dashboard can be provided showing a virtual cabinet status including updates in real time.
  • This model uses either the barcode or OCR to decode the label information. If the barcode cannot be decoded the system will then trigger the OCR. The system will also indicate which box to pick first, if more than one met the locate criteria via blinking the identified lens corresponding LED. [00137] Locate Feature
  • the user can directly locate a product in a cabinet and the cabinet will display its location in the web app and the product location in the cabinet via pick-to-light.
  • An expired product locate can be requested by the user.
  • the system will identify all expired products in the cabinet by illuminating the expired product box red via the RGB LED.
  • Example 1 An inventory management cabinet comprising: a housing defining a storage area, the storage area being configured to receive a product; a plurality of slots arranged within the housing, each of the slots being configured to receive a respective unit of the product; at least one imaging device configured to capture information about the product; and a controller operably coupled to the at least imaging device, the controller comprising a processor and a memory, the memory having computer-executable instructions stored thereon that, when executed by the processor, cause the controller to: detect activity within the storage area of the housing; and control the at least one imaging device to initiate capture of one or more images of the product in response to detecting activity within the storage area of the housing.
  • Example 2 The inventory management cabinet of example 1, wherein activity within the storage area of the housing is detected using the at least one imaging device.
  • Example 3 The inventory management cabinet of example 1 or 2, further comprising a motion sensor configured to detect presence of an object within the storage area of the housing.
  • Example 4 The inventory management cabinet of example 3, wherein activity within the storage area of the housing is detected using the motion sensor or camera comparing changes in live stream of frame images.
  • Example 5 The inventory management cabinet of any one of examples 1-4, further comprising a plurality of presence sensors configured to detect presence of a respective unit of the product in a respective one of the plurality of slots.
  • Example 6 The inventory management cabinet of example 5, wherein activity within the storage area of the housing is detected using the presence sensors.
  • Example 7 The inventory management cabinet of example 5 or 6, wherein each of the presence sensors comprises a light emitter and a photodetector.
  • Example 8 The inventory management cabinet of any one of examples 1-7, wherein the memory has further computer-executable instructions stored thereon that, when executed by the processor, cause the controller to extract information from the one or more images of the product captured by the at least one imaging device.
  • Example 9 The inventory management cabinet of example 8, wherein extracting information from the one or more images of the product captured by the at least one imaging device comprises:
  • Example 11 The inventory management cabinet of example 10, wherein inventorying the product based, at least in part, on the extracted information comprises: decoding the respective product identifiers associated with the respective units of the product; and using the respective product identifiers, associating the respective units of the product with the respective slots.
  • Example 12 The inventory management cabinet of any one of examples 9-
  • each of the respective product identifiers is a one-dimensional (ID) barcode, a two- dimensional (2D) barcode, a three-dimensional (3D) barcode, a universal product code (UPC), a stock keeping unit (SKU), text, or a graphic.
  • ID one-dimensional
  • 2D two- dimensional
  • 3D three-dimensional
  • UPC universal product code
  • SKU stock keeping unit
  • Example 13 The inventory management cabinet of any one of examples 1-
  • each of the imaging devices being configured to capture information about the product located in a respective region of the storage area of the housing.
  • Example 14 The inventory management cabinet of any one of examples 1-
  • Example 15 The inventory management cabinet of example 14, wherein the housing comprises an external frame, and wherein at least one of the visual indicators is arranged on or adjacent to the external frame.
  • Example 16 The inventory management cabinet of example 14, wherein a respective visual indicator is arranged on, within, or adjacent to each one of the respective slots.
  • Example 17 The inventory management cabinet of any one of examples 14- 16, wherein each of the visual indicators is at least one of a light emitter or a graphical display.
  • Example 18 The inventory management cabinet of any one of examples 1-
  • Example 19 The inventory management cabinet of example 18, wherein the memory has further computer-executable instructions stored thereon that, when executed by the processor, cause the controller to generate an alarm signal and transmit the alarm signal to the output device.
  • Example 20 The inventory management cabinet of any one of examples 1-
  • HMI human machine interface
  • Example 21 The inventory management cabinet of any one of examples 1-
  • each of the respective units of the product is a product package.
  • Example 22 The inventory management cabinet of example 21, wherein the product package includes a surgical implant.
  • Example 23 The inventory management cabinet of example 22, wherein the surgical implant is an intraocular lens.
  • Example 24 The inventory management cabinet of example 22, wherein the surgical implant is an orthopedic implant.
  • Example 25 The inventory management cabinet of example 21, wherein the product package includes a surgical tool.
  • Example 26 The inventory management cabinet of any one of examples 1- 25, wherein the memory has further computer-executable instructions stored thereon that, when executed by the processor, cause the controller to transmit an inventory of the product over a network to a remote system.
  • Example 27 The inventory management cabinet of example 26, wherein the remote system comprises a database.
  • Example 28 The inventory management cabinet of any one of examples 1- 27, wherein the memory has further computer-executable instructions stored thereon that, when executed by the processor, cause the controller to receive a request for the desired unit of the product.
  • Example 29 The inventory management cabinet of example 28, wherein the memory has further computer-executable instructions stored thereon that, when executed by the processor, cause the controller to: transmit the request for the desired unit of the product over a network to a remote system; and receive a response from the remote system, the response including a slot where the desired unit of product is located.
  • Example 30 The inventory management cabinet of example 29, wherein the remote system comprises a database.
  • Example 31 A modular inventory management system comprising: a first inventory management cabinet according to any one of examples 1-30; a second inventory management cabinet according to any one of example 1-30; and a human machine interface (HMI) configured to provide a communication interface between a user and the first and second inventory management cabinets.
  • HMI human machine interface
  • Example 32 An automated method for inventory management comprising:
  • detecting activity within a storage area of a housing of an inventory management cabinet detecting activity within a storage area of a housing of an inventory management cabinet; automatically initiating capture of one or more images of a product within the storage area of the housing in response to detecting activity within the storage area of the housing; and inventorying the product based, at least in part, using information extracted from the one or more images of the product.
  • Example 33 The method of example 32, wherein the inventory management cabinet is an inventory management cabinet according any one of examples 1-30.
  • Example 34 The method of example 32 or 33, further comprising providing the inventory management cabinet according any one of examples 1-30.
  • Example 35 An inventory management cabinet comprising: a housing defining a storage area, the storage area being configured to receive a product; a plurality of drawers arranged within the housing, each of the drawers comprising a plurality of slots, each of the slots being configured to receive a respective unit of the product; a plurality of imaging device configured to capture information about the product; and a controller operably coupled to the at least imaging device, the controller comprising a processor and a memory, the memory having computer-executable instructions stored thereon that, when executed by the processor, cause the controller to: detect activity within the storage area of the housing; and control the imaging devices to initiate capture of one or more images of the product in response to detecting activity within the storage area of the housing.

Landscapes

  • Business, Economics & Management (AREA)
  • Economics (AREA)
  • Engineering & Computer Science (AREA)
  • Marketing (AREA)
  • Quality & Reliability (AREA)
  • Finance (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Human Resources & Organizations (AREA)
  • Accounting & Taxation (AREA)
  • Operations Research (AREA)
  • Development Economics (AREA)
  • Strategic Management (AREA)
  • Tourism & Hospitality (AREA)
  • Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)

Abstract

L'invention concerne des armoires de gestion d'inventaire, des systèmes et des procédés associés. Un exemple d'armoire de gestion d'inventaire comprend un boîtier définissant une zone de stockage, la zone de stockage étant conçue pour accueillir un produit, et une pluralité de fentes agencées à l'intérieur du boîtier, chacune des fentes étant conçue pour recevoir une unité respective du produit. L'armoire comprend également au moins un dispositif d'imagerie configuré pour capturer des informations concernant le produit. L'armoire comprend en outre un dispositif de commande couplé de manière fonctionnelle au ou aux dispositifs d'imagerie, le dispositif de commande comprenant un processeur et une mémoire sur laquelle sont stockées des instructions exécutables par ordinateur. Le dispositif de commande est configuré pour détecter une activité à l'intérieur de la zone de stockage du boîtier, et commander le ou les dispositifs d'imagerie pour initier la capture d'une ou de plusieurs images du produit en réponse à la détection d'une activité à l'intérieur de la zone de stockage du boîtier.
PCT/IB2023/054051 2022-04-25 2023-04-20 Armoire de gestion d'inventaire intelligente WO2023209511A1 (fr)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US202263334421P 2022-04-25 2022-04-25
US63/334,421 2022-04-25
US17/965,555 US20230343444A1 (en) 2022-04-25 2022-10-13 Smart inventory management cabinet
US17/965,555 2022-10-13

Publications (1)

Publication Number Publication Date
WO2023209511A1 true WO2023209511A1 (fr) 2023-11-02

Family

ID=86332334

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2023/054051 WO2023209511A1 (fr) 2022-04-25 2023-04-20 Armoire de gestion d'inventaire intelligente

Country Status (1)

Country Link
WO (1) WO2023209511A1 (fr)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6788997B1 (en) * 1998-06-01 2004-09-07 Medselect, Inc. Medical cabinet with adjustable drawers
US20120316987A1 (en) * 2011-06-07 2012-12-13 Deroyal Industries, Inc. Implant inventory management system
US20130070090A1 (en) * 2011-09-16 2013-03-21 Mckesson Automation Inc. Systems, methods and computer program product for monitoring interactions with a medication storage device
WO2013109913A1 (fr) * 2012-01-20 2013-07-25 Medsentry, Inc. Dispositif de stockage de médicaments et procédé
US20160217417A1 (en) * 2015-01-23 2016-07-28 Samsung Electronics Co., Ltd. Object recognition for a storage structure
US20190311316A1 (en) 2017-12-15 2019-10-10 Johnson & Johnson Vision Care, Inc. Distribution and inventory system and methods of using the same
US20200364648A1 (en) 2019-05-13 2020-11-19 Johnson & Johnson Vision Care, Inc. Automated product locker for inventory control
US20200364650A1 (en) 2019-05-13 2020-11-19 Johnson &Johnson Vision Care, Inc. Automated product cabinet for inventory control
US20210304862A1 (en) * 2020-03-30 2021-09-30 Omnicell, Inc. Sensor driven secure dispensing unit

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6788997B1 (en) * 1998-06-01 2004-09-07 Medselect, Inc. Medical cabinet with adjustable drawers
US20120316987A1 (en) * 2011-06-07 2012-12-13 Deroyal Industries, Inc. Implant inventory management system
US20130070090A1 (en) * 2011-09-16 2013-03-21 Mckesson Automation Inc. Systems, methods and computer program product for monitoring interactions with a medication storage device
WO2013109913A1 (fr) * 2012-01-20 2013-07-25 Medsentry, Inc. Dispositif de stockage de médicaments et procédé
US20160217417A1 (en) * 2015-01-23 2016-07-28 Samsung Electronics Co., Ltd. Object recognition for a storage structure
US20190311316A1 (en) 2017-12-15 2019-10-10 Johnson & Johnson Vision Care, Inc. Distribution and inventory system and methods of using the same
US20200364648A1 (en) 2019-05-13 2020-11-19 Johnson & Johnson Vision Care, Inc. Automated product locker for inventory control
US20200364650A1 (en) 2019-05-13 2020-11-19 Johnson &Johnson Vision Care, Inc. Automated product cabinet for inventory control
US20210304862A1 (en) * 2020-03-30 2021-09-30 Omnicell, Inc. Sensor driven secure dispensing unit

Similar Documents

Publication Publication Date Title
EP2633475B1 (fr) Identification et vérification de médicaments
KR20190031431A (ko) 물품의 위치 파악, 식별 및 카운트하는 방법 및 시스템
CN111061890B (zh) 一种标注信息验证的方法、类别确定的方法及装置
CN103988057A (zh) 估算体外血液体积并对外科手术样品计数的系统和方法
US20200364650A1 (en) Automated product cabinet for inventory control
Kejriwal et al. Product counting using images with application to robot-based retail stock assessment
US11886953B2 (en) Computer vision system and method of label detection, reading, and registration of labels on objects
JP6155149B2 (ja) 薬剤ピッキング検査等に適したピッキング薬剤特定システム
KR101289354B1 (ko) 알에프아이디 인식 보정 시스템 및 그 인식 보정 방법
EP3158921A1 (fr) Système de détection de ligne de vue et procédé
JP6820886B2 (ja) 薬剤のラベルおよび／またはパッケージによって、その薬剤を区分けし識別するための方法およびシステム
Falcão et al. Faim: Vision and weight sensing fusion framework for autonomous inventory monitoring in convenience stores
US20230343444A1 (en) Smart inventory management cabinet
WO2023209511A1 (fr) Armoire de gestion d'inventaire intelligente
CA3101733A1 (fr) Casier de produit automatise pour le controle des stocks
WO2021091481A1 (fr) Système d'identification d'objet et d'estimation de quantité de contenu par l'utilisation d'images thermiques et à spectre visible
AU2020281008A1 (en) Automated product cabinet for inventory control
US20230334868A1 (en) Surgical phase recognition with sufficient statistical model
JP2011150425A (ja) リサーチ装置およびリサーチ方法
CN109389341A (zh) 一种无人售货便利店机器视觉识别系统
CN114299388A (zh) 物品信息确定方法、陈列柜以及存储介质
US20230064123A1 (en) Article specification apparatus, article specification method, and non-transitory storage medium
JP2021009537A (ja) 商品期限管理システム
CA3102082A1 (fr) Armoire a produits d'automatisation pour la gestion et l'administration du materiel
Lokhande et al. Study of Computer Vision Applications in Healthcare Industry 4.0

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23723268

Country of ref document: EP

Kind code of ref document: A1