EP4038562A1 - Armoire de produits automatisée pour contrôle d'inventaire - Google Patents

Armoire de produits automatisée pour contrôle d'inventaire

Info

Publication number
EP4038562A1
EP4038562A1 EP20793155.1A EP20793155A EP4038562A1 EP 4038562 A1 EP4038562 A1 EP 4038562A1 EP 20793155 A EP20793155 A EP 20793155A EP 4038562 A1 EP4038562 A1 EP 4038562A1
Authority
EP
European Patent Office
Prior art keywords
product
automated
cabinet
housing
controller
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP20793155.1A
Other languages
German (de)
English (en)
Inventor
Edward R. Kernick
Maile Shimoda
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Johnson and Johnson Vision Care Inc
Original Assignee
Johnson and Johnson Vision Care Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US16/592,315 external-priority patent/US20200364650A1/en
Application filed by Johnson and Johnson Vision Care Inc filed Critical Johnson and Johnson Vision Care Inc
Publication of EP4038562A1 publication Critical patent/EP4038562A1/fr
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/08—Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
    • G06Q10/087—Inventory or stock management, e.g. order filling, procurement or balancing against orders
    • A—HUMAN NECESSITIES
    • A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
    • A47B—TABLES; DESKS; OFFICE FURNITURE; CABINETS; DRAWERS; GENERAL DETAILS OF FURNITURE
    • A47B67/00—Chests; Dressing-tables; Medicine cabinets or the like; Cabinets characterised by the arrangement of drawers
    • A—HUMAN NECESSITIES
    • A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
    • A47B—TABLES; DESKS; OFFICE FURNITURE; CABINETS; DRAWERS; GENERAL DETAILS OF FURNITURE
    • A47B81/00—Cabinets or racks specially adapted for other particular purposes, e.g. for storing guns or skis
    • A—HUMAN NECESSITIES
    • A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
    • A47B—TABLES; DESKS; OFFICE FURNITURE; CABINETS; DRAWERS; GENERAL DETAILS OF FURNITURE
    • A47B88/00—Drawers for tables, cabinets or like furniture; Guides for drawers
    • A47B88/90—Constructional details of drawers
    • A47B88/919—Accessories or additional elements for drawers, e.g. drawer lighting
    • A—HUMAN NECESSITIES
    • A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
    • A47F—SPECIAL FURNITURE, FITTINGS, OR ACCESSORIES FOR SHOPS, STOREHOUSES, BARS, RESTAURANTS OR THE LIKE; PAYING COUNTERS
    • A47F10/00—Furniture or installations specially adapted to particular types of service systems, not otherwise provided for
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B50/00—Containers, covers, furniture or holders specially adapted for surgical or diagnostic appliances or instruments, e.g. sterile covers
    • A61B50/10—Furniture specially adapted for surgical or diagnostic appliances or instruments
    • A61B50/18—Cupboards; Drawers therefor
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/90—Identification means for patients or instruments, e.g. tags
    • A61B90/98—Identification means for patients or instruments, e.g. tags using electromagnetic means, e.g. transponders
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61F—FILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
    • A61F2/00—Filters implantable into blood vessels; Prostheses, i.e. artificial substitutes or replacements for parts of the body; Appliances for connecting them with the body; Devices providing patency to, or preventing collapsing of, tubular structures of the body, e.g. stents
    • A61F2/02—Prostheses implantable into the body
    • A61F2/14—Eye parts, e.g. lenses, corneal implants; Implanting instruments specially adapted therefor; Artificial eyes
    • A61F2/16—Intraocular lenses
    • A61F2/1691—Packages or dispensers for intraocular lenses
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25H—WORKSHOP EQUIPMENT, e.g. FOR MARKING-OUT WORK; STORAGE MEANS FOR WORKSHOPS
    • B25H3/00—Storage means or arrangements for workshops facilitating access to, or handling of, work tools or instruments
    • B25H3/02—Boxes
    • B25H3/021—Boxes comprising a number of connected storage elements
    • B25H3/023—Boxes comprising a number of connected storage elements movable relative to one another for access to their interiors
    • B25H3/028—Boxes comprising a number of connected storage elements movable relative to one another for access to their interiors by sliding extraction from within a common frame
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K19/00—Record carriers for use with machines and with at least a part designed to carry digital markings
    • G06K19/06—Record carriers for use with machines and with at least a part designed to carry digital markings characterised by the kind of the digital marking, e.g. shape, nature, code
    • G06K19/067—Record carriers with conductive marks, printed circuits or semiconductor circuit elements, e.g. credit or identity cards also with resonating or responding marks without active components
    • G06K19/07—Record carriers with conductive marks, printed circuits or semiconductor circuit elements, e.g. credit or identity cards also with resonating or responding marks without active components with integrated circuit chips
    • G06K19/0723—Record carriers with conductive marks, printed circuits or semiconductor circuit elements, e.g. credit or identity cards also with resonating or responding marks without active components with integrated circuit chips the record carrier comprising an arrangement for non-contact communication, e.g. wireless communication circuits on transponder cards, non-contact smart cards or RFIDs
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K7/00—Methods or arrangements for sensing record carriers, e.g. for reading patterns
    • G06K7/10—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
    • G06K7/10009—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation sensing by radiation using wavelengths larger than 0.1 mm, e.g. radio-waves or microwaves
    • G06K7/10297—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation sensing by radiation using wavelengths larger than 0.1 mm, e.g. radio-waves or microwaves arrangements for handling protocols designed for non-contact record carriers such as RFIDs NFCs, e.g. ISO/IEC 14443 and 18092
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K7/00—Methods or arrangements for sensing record carriers, e.g. for reading patterns
    • G06K7/10—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
    • G06K7/14—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation using light without selection of wavelength, e.g. sensing reflected white light
    • G06K7/1404—Methods for optical code recognition
    • G06K7/1408—Methods for optical code recognition the method being specifically adapted for the type of code
    • G06K7/1413—1D bar codes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/20—Image preprocessing
    • G06V10/24—Aligning, centring, orientation detection or correction of the image
    • G06V10/245—Aligning, centring, orientation detection or correction of the image by locating a pattern; Special marks for positioning
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07F—COIN-FREED OR LIKE APPARATUS
    • G07F11/00—Coin-freed apparatus for dispensing, or the like, discrete articles
    • G07F11/62—Coin-freed apparatus for dispensing, or the like, discrete articles in which the articles are stored in compartments in fixed receptacles
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07F—COIN-FREED OR LIKE APPARATUS
    • G07F17/00—Coin-freed apparatus for hiring articles; Coin-freed facilities or services
    • G07F17/0092—Coin-freed apparatus for hiring articles; Coin-freed facilities or services for assembling and dispensing of pharmaceutical articles
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
    • G16H20/10—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to drugs or medications, e.g. for ensuring correct administration to patients
    • G16H20/13—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to drugs or medications, e.g. for ensuring correct administration to patients delivered from dispensers
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/20—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
    • H—ELECTRICITY
    • H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
    • H05K—PRINTED CIRCUITS; CASINGS OR CONSTRUCTIONAL DETAILS OF ELECTRIC APPARATUS; MANUFACTURE OF ASSEMBLAGES OF ELECTRICAL COMPONENTS
    • H05K5/00—Casings, cabinets or drawers for electric apparatus
    • H05K5/02—Details
    • H05K5/0217—Mechanical details of casings
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B50/00—Containers, covers, furniture or holders specially adapted for surgical or diagnostic appliances or instruments, e.g. sterile covers
    • A61B50/10—Furniture specially adapted for surgical or diagnostic appliances or instruments
    • A61B2050/105—Cabinets
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B50/00—Containers, covers, furniture or holders specially adapted for surgical or diagnostic appliances or instruments, e.g. sterile covers
    • A61B50/10—Furniture specially adapted for surgical or diagnostic appliances or instruments
    • A61B50/18—Cupboards; Drawers therefor
    • A61B2050/185—Drawers
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61F—FILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
    • A61F2250/00—Special features of prostheses classified in groups A61F2/00 - A61F2/26 or A61F2/82 or A61F9/00 or A61F11/00 or subgroups thereof
    • A61F2250/0058—Additional features; Implant or prostheses properties not otherwise provided for
    • A61F2250/0085—Identification means; Administration of patients
    • A61F2250/0086—Identification means; Administration of patients with bar code

Definitions

  • the present disclosure relates to automated product lockers and cabinets for ophthalmic lenses, and more particularly to systems to dispense ophthalmic objects, record and track patient information, determine different lenses for patients, and to track and control inventory of ophthalmic lenses in the offices of eye care professionals.
  • ECP eye care professional
  • many different ophthalmic lenses are kept in inventory in order to dispense to a patient that enters the office.
  • a patient will have his or her eyes examined to determine if corrective lenses are necessary and, if so and if the patient desires contact lenses, for example.
  • the ECP will keep many lenses in stock in the office in order to first test whether a specific lens is appropriate and to give the patient a sufficient quantity until a complete order can be sent.
  • many different intraocular lenses are kept in inventory in order to dispense to a patient undergoing surgery.
  • Different stock keeping units, or SKUs need to be segregated by attributes such as refractive power; wear regimen such as daily, weekly, bi-weekly or monthly wear; lens manufacturer; and lens material. This necessarily requires the use of many drawers that are not completely full in order to keep track of what is in inventory and to more easily locate a lens of choice when a physician selects for a patient.
  • intraocular lenses are dispensed from manually stocked and inventoried storage locations.
  • Embodiments of the present disclosure provide devices and methods that address the above clinical needs.
  • the automated product cabinet can include a housing defining a storage area and a face, where the storage area is configured to receive a product.
  • the automated product cabinet can also include a plurality of slots arranged within the housing, where each of the slots is configured to receive a respective unit of the product, and a plurality of visual indicators configured to indicate respective positions of the respective units of the product within the housing.
  • the automated product cabinet can include a scanning bar configured to be slidably repositioned along the face of the housing, and a data capture device attached to the scanning bar and configured to capture information about the product.
  • the automated product cabinet can further include a controller operably coupled to the data capture device. The controller can be configured to inventory the product based, at least in part, on the information about the product, and actuate one or more of the visual indicators that are associated with a desired unit of the product.
  • the automated product cabinet can include a housing defining a storage area configured to receive a product and a plurality of slots arranged within the housing, where each of the slots is configured to receive a respective unit of the product.
  • Each respective unit of the product can include a respective smart tag, where the respective smart tag stores information about each respective unit of the product.
  • the automated product cabinet can also include a plurality of visual indicators configured to indicate respective positions of the respective units of the product within the housing and a controller.
  • the controller can be configured to receive information about the respective units of the product from the respective smart tags, inventory the product based, at least in part, on the information about the respective units of the product, and actuate one or more of the visual indicators that are associated with a desired unit of the product.
  • the system can include a housing defining a storage area configured to receive a product and a plurality of slots arranged within the housing, where each of the slots is configured to receive a respective unit of the product. Additionally, the system can include an imaging device and a projector, each of which is arranged in a spaced apart relationship with respect to the housing, and a controller.
  • the imaging device can be configured to capture information about the product.
  • the controller can be configured to receive information about the product from the imaging device, inventory the product based, at least in part, on the information about the product, and cause the projector to illuminate a respective location of a desired product within the housing.
  • FIGURE 1 is an example operating environment for the implementations described herein.
  • FIGURE 2 is a block diagram of the automated product locker according to implementations described herein.
  • FIGURES 3A-3C are a front view (Fig. 3A), side view (Fig. 3B), and isometric view (Fig. 3C) of the automated product locker according to an implementation described herein
  • FIGURE 4 is an isometric view of the automated product locker according to an implementation described herein.
  • FIGURES 5A-5B illustrate the automated product locker according to an implementation described herein.
  • Fig. 5A is an isometric view illustrating the automated product locker with an enlargement window illustrating the storage area of a drawer.
  • Fig. 5B illustrates an isometric view illustrating a portion of one of the drawers shown in Fig. 5A.
  • FIGURES 6A-6B are a top view (Fig. 6A) and side view (Fig. 6B) of a set of visual indicators 105 according to implementations described herein.
  • FIGURE 7 illustrates an isometric view of the automated product locker according to an implementation described herein.
  • FIGURES 8A-8C are front views of the automated product locker according to implementations described herein. Figs. 8A-8C illustrate different drawer configurations, respectively.
  • FIGURES 9A-9C illustrates example labeling included on product packages.
  • FIGURE 10 illustrates a plurality of product packages, each having a label according to an implementation described herein.
  • FIGURES 11A-11B are isometric views of a portion the automated product locker according to an implementation described herein.
  • Fig. 11A illustrates a view from the front of the automated product locker without the side panel.
  • Fig. 11B illustrates a view from the side of the automated product locker without the side panel.
  • FIGURE 12 is an isometric view of the automated product locker according to an implementation described herein.
  • FIGURES 13A-13D illustrate an example process using the automated product locker according to an implementation described herein.
  • FIGURE 14 is a block diagram of an example computing device.
  • FIGURE 15 is another example operating environment for the implementations described herein.
  • FIGURE 16 is a block diagram of the automated product cabinet according to implementations described herein.
  • FIGURES 17A-17C illustrate the automated product cabinet according to an implementation described herein.
  • Fig. 17A illustrates an isometric view of the automated product cabinet.
  • Fig. 17B illustrates the automated product cabinet of Fig. 17A including a door.
  • Fig. 17C illustrates a front view of the automated product cabinet of Fig. 17A with product stored therein.
  • FIGURES 18A-18D illustrate the automated product cabinet according to another implementation described herein.
  • Fig. 18A illustrates an isometric view of the automated product cabinet.
  • Fig. 18B illustrates the automated product cabinet of Fig. 18A with the scanning bars displacing in a vertical direction.
  • Fig. 18C illustrates a side view of the automated product cabinet of Fig. 18A.
  • Fig. 18D illustrates a front view of the automated product cabinet of Fig. 18A.
  • FIGURES 19A-19D illustrate the automated product cabinet according to another implementation described herein.
  • Fig. 19A illustrates an isometric view of the automated product cabinet.
  • Fig. 19B illustrates the automated product cabinet of Fig. 19A with the scanning bar displacing in a horizontal direction.
  • Fig. 19C illustrates a side view of the automated product cabinet of Fig. 19A.
  • Fig. 19D illustrates a front view of the automated product cabinet of Fig. 19A.
  • FIGURES 20A-20C illustrate the automated product cabinet having different sizes according to implementations described herein.
  • the automated product cabinets of Figs. 20A, 20B, and 20C accommodate 300, 304, and 507 products or product packages, respectively.
  • FIGURES 21A and 21B illustrate a module of slots for use with the automated product cabinets described herein.
  • Fig. 21A shows units of product loaded into the slots, while Fig. 21B shows the empty slots.
  • FIGURE 22 illustrates an example slot for use with the automated product cabinets described herein.
  • FIGURE 23 illustrates the automated product cabinet according to another implementation described herein.
  • FIGURE 24 illustrates an automated product system according to yet another implementation described herein.
  • the term "about” indicates that the value listed may be somewhat altered, as long as the alteration does not result in nonconformance of the process or device. For example, for some elements the term “about” can refer to a variation of ⁇ 0.1%, for other elements, the term “about” can refer to a variation of ⁇ 1% or ⁇ 10%, or any point therein.
  • the term “substantially”, or “substantial”, is equally applicable when used in a negative connotation to refer to the complete or near complete lack of an action, characteristic, property, state, structure, item, or result.
  • a surface that is “substantially” flat would either completely flat, or so nearly flat that the effect would be the same as if it were completely flat.
  • references in the specification to "one embodiment”, “certain embodiments”, some embodiments” or “an embodiment”, indicate that the embodiment(s) described may include a particular feature or characteristic, but every embodiment may not necessarily include the particular feature, structure, or characteristic. Moreover, such phrases are not necessarily referring to the same embodiment. Further, when a particular feature, structure, or characteristic is described in connection with an embodiment, it is submitted that it is within the knowledge of one skilled in the art to affect such feature, structure, or characteristic in connection with other embodiments whether or not explicitly described. For purposes of the description hereinafter, the terms “upper”, “lower”, “right”, “left”, “vertical”, “horizontal”, “top”, “bottom”, and derivatives thereof shall relate to the invention, as it is oriented in the drawing figures.
  • overlying means that a first element, is present on a second element, wherein intervening elements interface between the first element and the second element.
  • intervening elements interface between the first element and the second element.
  • direct contact or “attached to” means that a first element, and a second element, are connected without any intermediary element at the interface of the two elements.
  • references herein to any numerical range expressly includes each numerical value (including fractional numbers and whole numbers) encompassed by that range.
  • reference herein to a range of "at least 50" or “at least about 50” includes whole numbers of 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, etc., and fractional numbers 50.1, 50.2 50.3, 50.4, 50.5, 50.6, 50.7, 50.8, 50.9, etc.
  • reference herein to a range of "less than 50" or “less than about 50” includes whole numbers 49, 48, 47, 46, 45, 44, 43, 42, 41, 40, etc., and fractional numbers 49.9, 49.8, 49.7, 49.6, 49.5, 49.4, 49.3, 49.2, 49.1, 49.0, etc.
  • Automated product storage lockers are described herein. Such automated product lockers can be used to track/inventory product such as contact lenses.
  • the automated product lockers described herein are capable of: (i) keeping track of units of product removed from storage, (ii) informing the user of stocking needs, (iii) automatically placing orders for product, (iv) including storage space for all regularly prescribed lenses, and/or (v) working during power outages.
  • an automated product locker 100 can be operably coupled by one or more networks 200.
  • the automated product locker 100 is described in detail below.
  • the client device 102 can be a computing device (e.g., computing device 700 of Fig. 14) such as a laptop computer, desktop computer, tablet computer, or mobile phone
  • the remote system 104 can be a computing device (e.g., computing device 700 of Fig. 14) such as a server.
  • the remote system 104 is a cloud-based system, e.g., one or more computer system resources such as processors and data storage devices that are allocated to serve the needs of the client device 102 on demand. Cloud-based systems are known in the art and not described in further detail below.
  • the remote system 104 can include or access a database 104A.
  • the remote system 104 can include or access electronic medical records (EM s) 104B.
  • EM s electronic medical records
  • the automated product locker 100, client device 102, and remote system 104 discussed above can be connected by one or more networks 200.
  • This disclosure contemplates that the networks 200 are any suitable communication network.
  • the networks can be similar to each other in one or more respects. Alternatively or additionally, the networks can be different from each other in one or more respects.
  • the networks 200 can include a local area network (LAN), a wireless local area network (WLAN), a wide area network (WAN), a metropolitan area network (MAN), a virtual private network (VPN), etc., including portions or combinations of any of the above networks.
  • the automated product locker 100, client device 102, and remote system 104 can be coupled to the networks
  • a communication link may be implemented by any medium that facilitates data exchange including, but not limited to, wired, wireless and optical links.
  • Example communication links include, but are not limited to, a LAN, a WAN, a MAN, Ethernet, the Internet, or any other wired or wireless link such as WiFi, WiMax, 3G, 4G, or 5G.
  • the automated product locker 100, client device 102, and remote system 104 can interact to carryout the inventory and shipment/distribution functionalities as described in U.S. Ser. No. 16/222,819 filed December 17, 2018, and titled "DISTRIBUTION AND INVENTORY SYSTEM AND METHODS OF USING THE SAME," the disclosure of which is expressly incorporated herein by reference in its entirety.
  • the remote system 104 can manage/maintain a database 104A reflecting the inventory of product (e.g., contact lenses) stored in the automated product locker 100.
  • the remote system 104 can receive messages with product inventory updates from the automated product locker 100.
  • the remote system 104 can also query the database 104A in response to requests from the automated product locker 100 and/or the client device 102.
  • a user e.g., a healthcare professional such as an eye care professional (ECP)
  • ECP eye care professional
  • the client device 102 can run an application and/or interface with the automated product locker 100 and/or the remote system 104 using a web browser.
  • the automated product locker 100 can include a housing 101 and one or more drawers 103. Each of the drawers 103 can define a storage area (e.g., storage area
  • each of the drawers 103 is slidably stowable within the housing 101.
  • a drawer 103 can be withdrawn from the housing 101 (e.g., as shown by Figs. 7, 13B, 13C), for example, to provide access to the product.
  • a drawer 103 can be stowed in the housing 101 (e.g., as shown by Figs. 4, 5A, 13A).
  • the automated product locker 100 can also include a plurality of visual indicators 105 configured to indicate respective positions of respective units of the product within the storage area. Additionally, the automated product locker 100 can include a machine vision system 107 arranged within the housing 101 and configured to capture information about the product. The machine vision system 107 can include a data capture device. As described below, the data capture device can optionally be a barcode scanner or an imaging device. Additionally, the automated product locker 100 can include a controller 109 arranged within the housing 101. The controller 109 can be a computing device (e.g., computing device 700 of Fig. 14). One example controller for use the automated product locker 100 is RASPBERRY PI of the Raspberry Pi Foundation, United Kingdom.
  • the machine vision system 107 and the controller 109 can be operably coupled, for example, through one or more communication links.
  • This disclosure contemplates the communication links are any suitable communication link.
  • the visual indicators 105 and the controller 109 can be operably coupled, for example, thorough one or more communication links.
  • a communication link may be implemented by any medium that facilitates data exchange including, but not limited to, wired, wireless and optical links. This allows the controller 109 to exchange data with the machine vision system 107 and/or the visual indicators 105.
  • the automated product locker 100 can include a power supply 111 arranged in the housing 101.
  • the automated product locker 100 can be configured to connect to grid power (e.g., standard alternating current (A/C) power delivered to homes/businesses) during normal operation.
  • grid power e.g., standard alternating current (A/C) power delivered to homes/businesses
  • A/C standard alternating current
  • the power supply 111 can deliver electrical power to the automated product locker 100 in response to disruption (e.g., power outages).
  • the power supply 111 can optionally be a battery.
  • the automated product locker 100 can include a locking device 113 arranged in the housing 101 and configured to secure the drawer 103.
  • the locking device 113 can be an electronic lock, which secures the drawer 103 with a release mechanism operable with a passcode, keycard, radio-frequency identification (RFID), or biometrics (e.g., authentication).
  • RFID radio-frequency identification
  • biometrics e.g., authentication
  • the client device 102 can send the authentication information to the automated product locker 100 via the networks. Authentication can be performed locally at the automated product locker 100 and/or remotely at a remote system.
  • the locking device 113 can be a mechanical lock, which secures the drawer 103 with a release mechanism operable with a physical key.
  • the automated product locker 100 can be configured to detect movement of the drawer 103.
  • the machine vision system 107 can be initiated in response to movement of the drawer 103.
  • the controller 109 can be configured to detect movement of the drawer 103 using the machine vision system 107.
  • the automated product locker 100 can include a position strip including machine readable code arranged within the drawer 103. The position strip can be arranged along or adjacent to one or more of the partitions (e.g., partitions 400 in Figs. 5A-5B). It should be understood that a machine readable position code can be provided corresponding to each slot in the drawer that receives a unit of product.
  • the machine vision system 107 e.g., an imaging device or barcode scanner
  • the controller 109 can be configured to detect the movement of the drawer 103 based on the same.
  • the automated product locker 100 can further include a position detector
  • the position detector 115 configured to sense a position of the drawer 103 relative to the housing 101.
  • the position detector 115 can be a through-beam photoelectric sensor.
  • a plate with through- holes can be provided in the automated product locker 100.
  • the controller 109 can be configured to track the relative position drawer 103.
  • the automated product locker 100 can include drawer dampeners to stabilize the speed at which the drawers slide into/out of the housing.
  • FIGs. 3A-3C a front view (Fig. 3A), side view (Fig. 3B), and isometric view (Fig. 3C) of the automated product locker 100 according to an implementation described herein are shown.
  • the housing 101 and a plurality of drawers 103 are shown in Figs. 3A-3C.
  • the drawers 103 include four relatively small drawers (e.g., top four drawers) and four relatively larger drawers (e.g., bottom four drawers). Different sized drawers 103 can be provided to accommodate different sized product.
  • the top four drawers may be sized to accommodate one pair (lp) contact lens packages, while the bottom four drawers may be sized to accommodate three pair (3p) or five pair (5p) contact lens packages. It should be understood that the number, sizes, and/or arrangement of the drawers 103 is provided only as an example and that other configurations are possible.
  • the drawers 103 include three relatively small drawers (e.g., top three drawers) and three relatively larger drawers (e.g., bottom three drawers).
  • the drawers 103 can be provided to accommodate different sized product.
  • the top three drawers may be sized to accommodate one pair (lp) contact lens packages, while the bottom three drawers may be sized to accommodate three pair (3p) or five pair (5p) contact lens packages.
  • the number, sizes, and/or arrangement of the drawers 103 is provided only as an example and that other configurations are possible.
  • the automated product locker 100 can also include visual indicators (e.g., visual indicators 105 in Fig. 2).
  • Each of the visual indicators can be a light emitter such as a light emitting diode (LED). It should be understood that light emitters are provided only as an example.
  • the visual indicators can be other elements including, but not limited to, a graphical display.
  • the visual indicators e.g., visual indicators 105 in Fig. 2
  • the controller e.g., controller 109 in Fig. 2).
  • the visual indicators are provided to notify a user (e.g., a health professional such as an eye care professional (ECP)) of the location of a desired product within the automated product locker 100.
  • ECP eye care professional
  • visual indicators can be provided on external surfaces of the automated product locker 100 (e.g., on and/or adjacent to the drawers) and/or inside the storage area of the automated product locker 100 (e.g., adjacent to the product packages).
  • the controller can transmit actuation signals to one or more of the visual indicators to notify the user where a desired product is located (e.g., which drawer and/or the position within the drawer itself).
  • the controller can cause one or more visual indicators on the exterior of the automated product locker 100 to actuate and/or one or more visual indicators within the drawer to actuate.
  • visual indicators may indicate errors, such as by changing colors, blinking, or otherwise changing state to alert the user of a change in status.
  • Visual indicators may also guide the user (e.g., ECP, staff members, employees, third parties, or other users) to an available location within the locker when loading product into the locker.
  • visual indicators may display different images, colors, or other indication to specify to whom guidance is directed.
  • each user of the device could be associated with a particular icon, graphic, or text in the case of a graphical display.
  • particular users could be associated with a given color or blink sequence in the software application operatively associated with the locker so that multiple users could be directed to their desired product simultaneously by following their assigned color on the visual indicators to the correct location within the locker.
  • FIG. 5A is an isometric view illustrating the automated product locker 100 with an enlargement window illustrating the storage area 104 of a drawer 103.
  • the housing 101 and a plurality of drawers 103 are shown in Fig. 5A.
  • the drawers 103 include two relatively small drawers (e.g., top two drawers) and three relatively larger drawers (e.g., bottom three drawers). As discussed above, different sized drawers 103 can be provided to accommodate different sized product.
  • the top two drawers may be sized to accommodate one pair (lp) contact lens packages, while the bottom three drawers may be sized to accommodate three pair (3p) or five pair (5p) contact lens packages.
  • the number, sizes, and/or arrangement of the drawers 103 is provided only as an example and that other configurations are possible.
  • each of the drawers 103 shown in Fig. 5A includes a visual indicator 105 arranged on its external face 103A.
  • the visual indicators 105 are arranged on external faces 103A of the drawers 103 (e.g., on or near the handles of the drawers). It should be understood that the arrangement of the visual indicators 105 shown in Fig. 5A is provided only as an example. As described herein, the visual indicators 105 notify a user of the location of a desired product, so the visual indicators 105 can be placed anywhere on and/or near the drawer in order to highlight (e.g., when actuated) a particular drawer 103 for the benefit of the user.
  • the visual indicators 105 can optionally be provided adjacent to the external face 103A of the drawer 103 as opposed to on the external face 103A of the drawer 103.
  • one of the visual indicators 105 is actuated (e.g. illuminated), i.e. the second visual indicator 105 from the top of the automated product locker 100. This informs the user that the desired product is located in this particular drawer 103.
  • the enlargement window in Fig. 5A illustrates the storage area 104 within the drawer 103. It should be understood that the storage area 104 receives the product. In the examples described herein, the product is contact lenses.
  • the product can optionally be contained in one or more product packages 300 (e.g., a container such as a box, carton, wrapper, etc.).
  • a product package 300 can include one or more contact lenses.
  • the automated product locker 100 can receive a plurality of product packages 300, i.e., a plurality of units of the product.
  • the product packages 300 are arranged in rows side-by-side within the storage area 104.
  • the product packages 300 (sometimes referred to herein as "units of product") are arranged in a single row between partitions.
  • a set of visual indicators 105 can be provided in the storage area 104. A respective visual indicator 105 is provided adjacent to each one of the product packages 300.
  • the respective visual indicators 105 adjacent to two product packages 300 are actuated (e.g. illuminated). This informs the user that the desired product is located in these particular positions within the storage area 104.
  • Fig. 5B illustrates an isometric view illustrating a portion of one of the drawers 103 shown in Fig. 5A.
  • the drawer 103 can further include a plurality of partitions 400 arranged within the storage area 104.
  • the drawer 103 can further include a plurality of trays 420 configured to receive the product, where each of the trays 420 is arranged between adjacent partitions 400.
  • Each of the trays 420 can include a plurality of slots 440 for receiving units of the product (e.g., the product packages 300).
  • a respective set of the visual indicators 105 can be arranged along each of the partitions 400.
  • the visual indicators 105 can be arranged linearly along the partitions 400 such that one visual indicator 105 is arranged adjacent to each slot 440.
  • a set of visual indicators 105 is shown by the dotted box. Accordingly, a visual indicator 105 is arranged adjacent to each side of one of the product packages 300, which highlights for the benefit of the user the specific position of the desired unit of the product when actuated (e.g., illuminated).
  • Figs. 6A-6B a top view (Fig. 6A) and side view (Fig. 6B) of a set of visual indicators 105 according to implementations described herein are shown.
  • the set of visual indicators 105 can be arranged along a partition (e.g., partition 400 in Fig. 5B). In some implementations, the visual indicators 105 are arranged linearly along the partition. In Figs. 6A-6B, the visual indicators 105 are arranged with equal spacing. This is because the slot sizes are the same. This disclosure contemplates that the visual indicators 105 can be arranged with unequal spacing, for example, when the slot sizes are different. In other words, the visual indictors 105 can be sized and/or spaced such that one visual indicator 105 is provided adjacent to each slot. It should be understood that the number, sizes, and/or spacing between the visual indicators 105 is provided only as an example and that other configurations are possible.
  • FIG. 7 an isometric view of the automated product locker 100 according to an implementation described herein is shown.
  • the housing 101 and a plurality of drawers 103 are shown.
  • one of the drawers 103 is withdrawn from the housing 101, which exposes the product to the user.
  • FIG. 8A-8C front views of the automated product locker 100 according to implementations described herein are shown.
  • Figs. 8A-8C illustrate different drawer configurations.
  • Fig. 8A illustrates a configuration with two drawers sized for one pair (lp) contact lens packages, one drawer sized for three pair (3p) contact lens packages, and one drawer sized for five pair (5p) contact lens packages.
  • Fig. 8B illustrates a configuration with six drawers sized for five pair (5p) contact lens packages.
  • Fig. 8C illustrates a configuration with four drawers sized for one pair (lp) contact lens packages, one drawer sized for three pair (3p) contact lens packages, and three drawers sized for five pair (5p) contact lens packages.
  • the machine vision system can capture information about the product.
  • This disclosure contemplates that such information can be associated with the product package and/or the product itself.
  • the product package can include a label such as a barcode (ID, 2D, or 3D), universal product code (UPC), and/or stock keeping unit (SKU).
  • ID, 2D, or 3D universal product code
  • UPC universal product code
  • SKU stock keeping unit
  • the label 500 includes a 2D barcode (e.g., QR code).
  • a label 600 is printed directly on the product package 300 (see Fig. 9C).
  • the label 600 is a UPC.
  • the label can be included on and/or affixed to the product itself (not shown).
  • this disclosure contemplates that the information about the product can be text (e.g., brand name, product name, product description, etc.) and/or graphics (e.g., brand logo, product logo) included on and/or affixed to the product package or the product itself (see Figs. 9B, 9C).
  • each of the product packages stored in the automated product locker 100 can include a label.
  • Fig. 10 illustrates a plurality of product packages 300, each having a label 500.
  • the product packages 300 can be stored inside the automated product lockers described herein, and the machine vision system can capture information about the product by reading/decoding the labels 300.
  • FIGs. 11A-11B isometric views of a portion the automated product locker 100 according to an implementation described herein are shown.
  • the housing 101 and a plurality of drawers 103 are shown in Figs. 11A-11B.
  • Fig. 11A illustrates a view from the front of the automated product locker 100 without the side panel.
  • One of the external drawer faces is transparent in Fig. 11A for visibility.
  • Fig. 11B illustrates a view from the side of the automated product locker 100 without the side panel.
  • Figs. 11A-11B show the machine vision system arranged in the housing 101.
  • the 11A-11B includes a data capture device 107A and a light reflecting device 107B (collectively referred to as the "machine vision system" of Figs. 11A-11B).
  • the data capture device 107A may be an optical device, such as a barcode reader or an imaging device such as a digital camera.
  • One of many suitable cameras includes the E-Consystems model 3CAM_CU135_TC.
  • a digital camera includes a lens, sensor, and image processor. Digital cameras are known in the art and are therefore not described in further detail below.
  • the data capture device may also take the form of radio-frequency devices, such as an RFID scanner or the like. In the example described with regard to Figs. 11A-11B, the data capture device 107A is an imaging device.
  • the light reflecting device 107B can be configured to direct light reflected from at least a portion of the storage area to the data capture device 107A.
  • light reflecting devices include, but are not limited to, mirrors, prisms, lenses, etc.
  • the data capture device 107A and the light reflecting device 107B are arranged at opposite sides of the drawer 103.
  • the light reflecting device 107B is arranged at an angle such that the light reflecting surface is directed downward relative to an axis of the data capture device 107A.
  • the light reflecting surface 107B directs light reflected from a portion of the storage area of the drawer toward the data capture device 107A, which allows the data capture device 107A to capture images of the units of product within the storage area.
  • the characteristics, size, and/or arrangement of the data capture device 107A and light reflecting device 107B depend on the desired image field.
  • This disclosure contemplates that one or more data capture devices 107A and/or one or more light reflecting surfaces 107B can form the machine vision system. As discussed above, this is determined by the desired image field. Additionally, this disclosure contemplates that the machine vision system can include only one or more data capture devices 107A (i.e., without light reflecting surfaces 107B).
  • FIG. 12 an isometric view of the automated product locker 100 according to an implementation described herein is shown.
  • the housing 101 and a plurality of drawers 103 are shown in Fig. 12.
  • Fig. 12 illustrates a view from the front of the automated product locker 100 without the external faces of the drawers 103.
  • the machine vision system of Fig. 12 includes an data capture device 107C.
  • the data capture device 107C can be a barcode scanner. Barcode scanners are capable of reading and outputting printed machine readable codes (e.g., barcodes) to a computing device. Barcode scanners include, but are not limited to, laser scanners, charged coupled device (CCD) scanners, and omnidirectional scanners. Barcode scanners are known in the art and are therefore not described in further detail below.
  • CCD charged coupled device
  • the automated storage locker 100 can include a plurality of drawers and a plurality of machine vision systems.
  • a respective machine vision system e.g., the data capture device 107A/light reflecting device 107B of Figs. 11A-11B or the data capture device 107C of Fig. 12
  • each drawer can have its own machine vision system.
  • the machine vision system 107 can include a single data capture device (e.g., one camera per drawer as shown in Figs. 11A-11B).
  • the controller 109 can be configured to inventory the product based, at least in part, on the information about the product, and cause one or more of the visual indicators 105 that are associated with a desired unit of the product to actuate.
  • a user e.g., ECP
  • the client device 102 can transmit the request for the desired unit of the product to the automated product locker 100 via a network (not shown in Figs. 13A-13D).
  • a controller (not shown in Figs.
  • the automated product locker 100 can be configured to receive a request for the desired unit of the product. Additionally, the controller can be further configured to transmit the request for the desired unit of the product over the network to a remote system (not shown in Figs. 13A-13D).
  • the remote system e.g., remote system 104 in Fig. 1
  • the remote system can include and/or access an inventory database.
  • the remote system can query the database to determine the position(s) of the desired unit(s) of product within the automated product locker 100.
  • the remote system can transmit a response to the controller over the network, and the controller can receive the response, which includes position(s) of the desired unit(s) of product within the storage area.
  • the controller can be configured to transmit signals to actuate visual indicators (not shown in Figs. 13A-13D) to assist the user in identifying the position(s) of the desired unit(s) of product within the drawer 103.
  • the controller can unlock the drawer 103.
  • the open drawer 103 is shown in Figs. 13B and 13C, which also illustrates the visual indicators 105 that have been actuated (e.g., illuminated) by the controller. These visual indicators highlight the locations of the desired units of the product for the benefit of the user.
  • the drawer 103 is returned to the housing.
  • this movement can be detected by the automated product locker 100, e.g., using the machine vision system and/or a position detector.
  • This causes the controller to initiate the machine vision system.
  • the automated product locker 100 can read/decode the machine-readable labels (e.g., barcodes, UPC, SKU, text, graphics) associated with the units of the product.
  • the respective units of the product can then be associated with respective positions within the storage area.
  • the respective positions for each of the units of product can then be transmitted by the controller to the remote system.
  • the controller can be configured to transmit the updated inventory of the product over the network to the remote system, and the database can be updated accordingly.
  • the controller can lock the drawer 103.
  • the automated product locker 100 can be restocked effortlessly.
  • the user e.g., ECP
  • the user can open one or more drawers and restock product by placing the product packages in any empty slots in the storage area.
  • the product packages can instead be placed at random in the storage area.
  • the controller can initiate the machine vision system.
  • the automated product locker 100 can read/decode the machine-readable labels (e.g., barcodes, UPC, SKU, text, graphics) associated with the units of the product.
  • the respective units of the product can then be associated with respective positions within the storage area.
  • the respective positions for each of the units of product can then be transmitted by the controller to the remote system.
  • the controller can be configured to transmit the updated inventory of the product over the network to the remote system, and the database can be updated accordingly.
  • the controller 109 can be configured to provide an alarm in response to a condition of the drawer 103.
  • a host of conditions could serve to trigger an alarm, including product being inserted incorrectly, such as upside down (as recognized by the computer vision system).
  • the controller 109 may provide an alarm in response to the drawer 103 being left open (e.g., ajar) for longer than a preset period of time, e.g., to inform the user.
  • the controller 109 can provide an alarm in response to environmental conditions (e.g., temperature, humidity, etc.) within the storage area.
  • environmental conditions e.g., temperature, humidity, etc.
  • the drawer 103 can include various sensors for detecting the environmental conditions.
  • the data capture device 107C of the machine vision system 107 can be a barcode scanner (see Fig. 12), which is capable of reading and decoding machine readable product identifiers such as a ID barcode, a UPC, or an SKU.
  • the machine readable product identifiers can be affixed to and/or printed directly on the product packages and/or the product itself as described herein. Accordingly, the step of inventorying the product based, at least in part, on the information about the product can include reading respective product identifiers associated with respective units of the product using the barcode scanner, and also decoding the respective product identifiers associated with the respective units of the product.
  • the data capture device 107A of the machine vision system 107 can be an imaging device such as a digital camera (see Figs. 11A-11B), which is capable of capturing images of machine readable product identifiers such as a ID barcode, a 2D barcode, a 3D barcode, a UPC, or an SKU.
  • An imaging device is also capable of capturing images of text and/or a graphics, which can serve as machine readable product identifiers.
  • text and/or graphics can include, but are not limited to, brand name, product name, product description, logo, etc.
  • image processing techniques can be used to decode the machine readable product identifiers.
  • the step of inventorying the product based, at least in part, on the information about the product can include receiving images of the product captured by the imaging device, analyzing the images of the product to identify respective product identifiers associated with respective units of the product, decoding the respective product identifiers associated with the respective units of the product. After analyzing/decoding the respective product identifiers, it is possible to associate the respective units of the product with the respective positions within the storage area. This disclosure contemplates performing this association with either the controller 109 and/or the remote system (e.g., remote system 104 of Fig. 1).
  • the step of inventorying the product based, at least in part, on the information about the product further includes cropping a portion of the images of the product.
  • cropping the images it is possible to focus on the portion of the image expected to contain the product identifiers.
  • the cropped portion of the images is analyzed to identify the respective product identifiers associated with the respective units of the product.
  • the controller 109 can be configured to transmit the images of the product over a network to a remote system (e.g. remote system 104 in Fig. 1).
  • the images can be stored by the remote system for back up purposes, or image processing (some or all) can be offloaded from the controller 109 to the remote system.
  • the controller 109 can be configured to store the images of the product in the memory.
  • the images can be stored only temporarily (e.g., to allow for image processing) and then written over to minimize the storage requirements at the automated product locker 100.
  • the step of inventorying the product based, at least in part, on the information about the product further includes analyzing the images of the product to identify one or more of the respective positions within the storage area associated with a missing, unrecognized, or unreadable product identifier.
  • the controller 109 can be configured to distinguish between missing units of product and units of product having unrecognized/unreadable product identifiers. It should be understood that the former may be restocked, while the latter may be repositioned (e.g., flipped over, turned over, relabeled) to correctly orient the product identifier for reading by the machine vision system.
  • a machine learning algorithm can be used to determine whether one or more of the respective positions within the storage area associated with the missing, unrecognized, or unreadable product identifier contain a unit of the product.
  • the machine learning algorithm can be executed by the controller 109 in some implementations using traditional vision systems (e.g., pattern recognition), while in other implementations the machine learning algorithm can be executed by the remote system (i.e., offloaded from the automated product locker 100).
  • Machine learning algorithms can be trained using an existing dataset to perform a specific task such as identify missing, unrecognized, or unreadable product identifiers. Machine learning algorithms are known in the art and therefore not described in further detail below.
  • TensorFlow An example machine learning algorithm is TensorFlow, which is an open source machine learning algorithm known in the art. TensorFlow is only one example machine learning algorithm. This disclosure contemplates using other machine learning algorithms including, but not limited to, neural networks, support vector machines, nearest neighbor algorithms, supervised learning algorithms, unsupervised learning algorithms.
  • the step of inventorying the product based, at least in part, on the information about the product further includes analyzing the images of the product to determine, using a machine learning algorithm, a source of each of the respective units of the product.
  • a machine learning algorithm e.g., a source of each of the respective units of the product.
  • the automated product locker 100 can be used to store product from different sources (e.g., contact lenses from different manufacturers).
  • the machine vision system 107 including an imaging device such as a camera can be used to capture images of both machine readable codes (barcodes, UPC, SKU) and text and graphics, and then imaging processing techniques can be used to decode the product identifiers.
  • a machine learning algorithm can be used to identify machine readable codes associated with different vendors or manufacturers. This allows the automated product locker 100 to select the appropriate decoding rules. Alternatively or additionally, a machine learning algorithm can be used to identify the source of a unit of product based on text and/or graphics (even in the absence of machine readable codes). This disclosure contemplates that the machine learning algorithm can be executed by the controller 109 in some implementations, while in other implementations the machine learning algorithm can be executed by the remote system (i.e., offloaded from the automated product locker). Machine learning algorithms can be trained using an existing dataset to perform a specific task such as identify the source of units of the product. Machine learning algorithms are known in the art and therefore not described in further detail below. Example machine learning algorithms are provided above.
  • the logical operations described herein with respect to the various figures may be implemented (1) as a sequence of computer implemented acts or program modules (i.e., software) running on a computing device (e.g., the computing device described in Fig. 14), (2) as interconnected machine logic circuits or circuit modules (i.e., hardware) within the computing device and/or (3) a combination of software and hardware of the computing device.
  • a computing device e.g., the computing device described in Fig. 14
  • machine logic circuits or circuit modules i.e., hardware
  • the logical operations discussed herein are not limited to any specific combination of hardware and software. The implementation is a matter of choice dependent on the performance and other requirements of the computing device. Accordingly, the logical operations described herein are referred to variously as operations, structural devices, acts, or modules.
  • an example computing device 700 upon which the methods described herein may be implemented is illustrated. It should be understood that the example computing device 700 is only one example of a suitable computing environment upon which the methods described herein may be implemented.
  • the computing device 700 can be a well-known computing system including, but not limited to, personal computers, servers, handheld or laptop devices, multiprocessor systems, microprocessor-based systems, network personal computers (PCs), minicomputers, mainframe computers, embedded systems, and/or distributed computing environments including a plurality of any of the above systems or devices.
  • Distributed computing environments enable remote computing devices, which are connected to a communication network or other data transmission medium, to perform various tasks.
  • computing device 700 In its most basic configuration, computing device 700 typically includes at least one processing unit 706 and system memory 704. Depending on the exact configuration and type of computing device, system memory 704 may be volatile (such as random access memory (RAM)), non volatile (such as read-only memory (ROM), flash memory, etc.), or some combination of the two. This most basic configuration is illustrated in Fig. 14 by dashed line 702.
  • the processing unit 706 may be a standard programmable processor that performs arithmetic and logic operations necessary for operation of the computing device 700.
  • the computing device 700 may also include a bus or other communication mechanism for communicating information among various components of the computing device 700.
  • Computing device 700 may have additional features/functionality.
  • computing device 700 may include additional storage such as removable storage 708 and non-removable storage 710 including, but not limited to, magnetic or optical disks or tapes.
  • Computing device 700 may also contain network connection(s) 716 that allow the device to communicate with other devices.
  • Computing device 700 may also have input device(s) 714 such as a keyboard, mouse, touch screen, etc.
  • Output device(s) 712 such as a display, speakers, printer, etc. may also be included.
  • the additional devices may be connected to the bus in order to facilitate communication of data among the components of the computing device 700. All these devices are well known in the art and need not be discussed at length here.
  • the processing unit 706 may be configured to execute program code encoded in tangible, computer-readable media.
  • Tangible, computer-readable media refers to any media that is capable of providing data that causes the computing device 700 (i.e., a machine) to operate in a particular fashion.
  • Various computer-readable media may be utilized to provide instructions to the processing unit 706 for execution.
  • Example tangible, computer-readable media may include, but is not limited to, volatile media, non-volatile media, removable media and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data.
  • System memory 704, removable storage 708, and non-removable storage 710 are all examples of tangible, computer storage media.
  • Example tangible, computer-readable recording media include, but are not limited to, an integrated circuit (e.g., field-programmable gate array or application- specific 1C), a hard disk, an optical disk, a magneto-optical disk, a floppy disk, a magnetic tape, a holographic storage medium, a solid-state device, RAM, ROM, electrically erasable program read-only memory (EEPROM), flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices.
  • an integrated circuit e.g., field-programmable gate array or application- specific 1C
  • a hard disk e.g., an optical disk, a magneto-optical disk, a floppy disk, a magnetic tape, a holographic storage medium, a solid-state device
  • RAM random access memory
  • ROM read-only memory
  • EEPROM electrically erasable program read-only memory
  • flash memory or other memory
  • the processing unit 706 may execute program code stored in the system memory 704.
  • the bus may carry data to the system memory 704, from which the processing unit 706 receives and executes instructions.
  • the data received by the system memory 704 may optionally be stored on the removable storage 708 or the non-removable storage 710 before or after execution by the processing unit 706.
  • the computing device In the case of program code execution on programmable computers, the computing device generally includes a processor, a storage medium readable by the processor (including volatile and non-volatile memory and/or storage elements), at least one input device, and at least one output device.
  • One or more programs may implement or utilize the processes described in connection with the presently disclosed subject matter, e.g., through the use of an application programming interface (API), reusable controls, or the like.
  • API application programming interface
  • Such programs may be implemented in a high level procedural or object-oriented programming language to communicate with a computer system.
  • the program(s) can be implemented in assembly or machine language, if desired. In any case, the language may be a compiled or interpreted language and it may be combined with hardware implementations.
  • Automated product cabinets are also described herein. Such automated product cabinets can be used to track/inventory product such as intraocular lenses.
  • An automated product cabinet 1000, a client device 102, and a remote system 104 can be operably coupled by one or more networks 200.
  • the automated product cabinet 1000, client device 102, and remote system 104 can be coupled to the networks 200 through one or more communication links (e.g., any suitable communication links).
  • the client device 102, remote system 104, and network 200 are described above with regard to Fig. 1.
  • the client device 102 and/or remote system 104 can be a computing device (e.g., computing device 700 of Fig. 14).
  • the remote system 104 can include or access a database 104A or EMRs 104B.
  • the networks 200 are any suitable communication network.
  • the automated product cabinet 1000 is described in detail below. This disclosure contemplates that a plurality of automated product cabinet 1000 can be included in the operating environment. For example, a user such as surgeon or ECP can have multiple automated product cabinets 1000 in the office for storing inventory.
  • the automated product cabinet 1000, client device 102, and remote system 104 can interact to carryout the inventory and shipment/distribution functionalities as described in U.S. Ser. No. 16/222,819 filed December 17, 2018, and titled "DISTRIBUTION AND INVENTORY SYSTEM AND METHODS OF USING THE SAME," the disclosure of which is expressly incorporated herein by reference in its entirety.
  • the remote system 104 can manage/maintain a database 104A reflecting the inventory of product (e.g., intraocular lenses) stored in the automated product cabinet 1000. By exchanging messages over the networks 200, the remote system 104 can receive messages with product inventory updates from the automated product cabinet 1000.
  • the remote system 104 can also query the database 104A in response to requests from the automated product cabinet 1000 and/or the client device 102.
  • a user e.g., a healthcare professional such as surgeon or ECP
  • ECP e.g., a healthcare professional
  • the client device 102 can run an application and/or interface with the automated product cabinet 1000 and/or the remote system 104 using a web browser.
  • FIG. 16 a block diagram of the automated product cabinet 1000 according to implementations described herein is shown.
  • Example automated product cabinets 1000 are also illustrated, for example, by Figs. 17A-19D.
  • the automated product cabinet 1000 can include a housing
  • the product stored in the automated product cabinet 1000 is intraocular lenses.
  • the product can optionally be contained in one or more product packages (e.g., a container such as a box, carton, wrapper, etc.).
  • a product package can include one or more intraocular lenses.
  • the automated product cabinet 1000 can receive a plurality of product packages, i.e., a plurality of units of the product, in its storage area.
  • the automated product cabinet 1000 can include a plurality of slots 1003 arranged within the housing 1001, where each of the slots 1003 is configured to receive a respective unit of product. A user can access the storage area and slots 1003 via a face of the housing 1001.
  • the face of the housing 1001 is open to the environment for easy access to the product by the user.
  • the housing 1001 may alternatively be fully or partially closed via a door, drawer, or other covering and may be transparent or opaque as desired.
  • the slots 1003 (and thus the units of product stored therein) can be arranged in rows and/or columns within the storage area (e.g., see Figs. Figs. 17A-19D).
  • the automated product cabinet 1000 can receive products other than intraocular lenses, for example, products including but not limited to other types of ophthalmic lenses and/or surgical tools.
  • the automated product cabinet 1000 can also include a plurality of visual indicators 1005 configured to indicate respective positions of respective units of the product within the housing 1001. Additionally, the automated product cabinet 1000 can include a scanning bar 1007 configured to be slidably repositioned along a face of the housing 1001. The automated product cabinet 1000 can also include an data capture device 1009 attached to the scanning bar 1007 and configured to capture information about the product. As described herein, the data capture device 1009 can be a barcode scanner, which is capable of reading and decoding machine-readable product identifiers such as a ID barcode, a UPC, or an SKU. The machine readable product identifiers can be affixed to and/or printed directly on the product packages and/or the product itself as described herein.
  • the data capture device 1009 can be an imaging device such as a digital camera, which is capable of capturing images of machine-readable product identifiers such as a ID barcode, a 2D barcode, a 3D barcode, a UPC, or an SKU.
  • An imaging device is also capable of capturing images of text and/ora graphics, which can serve as machine readable product identifiers.
  • text and/or graphics can include, but are not limited to, brand name, product name, product description, logo, etc.
  • image processing techniques can be used to decode the machine readable product identifiers.
  • the automated product cabinet 1000 can include a controller 1111.
  • the controller 1111 may optionally be arranged within the housing 1001.
  • the controller 1111 can be a computing device (e.g., computing device 700 of Fig. 14).
  • One example controller for use the automated product cabinet 1000 is RASPBERRY PI of the Raspberry Pi Foundation, United Kingdom.
  • This disclosure contemplates that the data capture device 1009 and the controller 1111 can be operably coupled, for example, through one or more communication links.
  • the visual indicators 1005 and the controller 1111 can be operably coupled, for example, thorough one or more communication links.
  • the communication links are any suitable communication link.
  • a communication link may be implemented by any medium that facilitates data exchange including, but not limited to, wired, wireless and optical links. This allows the controller 1111 to exchange data with the data capture device 1009 and/or the visual indicators 1005.
  • the automated product cabinet 1000 can include a power supply 1113 arranged in the housing 1001.
  • the automated product cabinet 1000 can be configured to connect to grid power (e.g., standard alternating current (A/C) power delivered to homes/businesses) during normal operation.
  • grid power e.g., standard alternating current (A/C) power delivered to homes/businesses
  • A/C standard alternating current
  • the power supply 1113 can deliver electrical power to the automated product cabinet 1000 in response to disruption (e.g., power outages).
  • the power supply 1113 can optionally be a battery.
  • the automated product cabinet 1000 can further include a position detector 1115 configured to sense a position of the scanning bar 1007 relative to the face of the housing 1001.
  • the position detector 1115 can be a through-beam photoelectric sensor.
  • a plate with through-holes can be provided in the automated product cabinet 1000.
  • the controller 1009 can be configured to track the relative position of the scanning bar 1007.
  • a through-beam photoelectric sensor is provided only as an example.
  • the position detector 1115 can be another type of sensor including, but not limited to, a magnetic sensor.
  • FIG. 17A-19D example automated product cabinets 1000 are shown.
  • the automated product cabinet 1000 can include a housing 1001, a plurality of slots 1003, a plurality of visual indicators 1005, and a scanning bar 1007.
  • the housing 1001 defines a face 1002 and a storage area 1004.
  • the user can access the product via the face 1002.
  • the storage area 1004 is configured to receive a product such as intraocular lenses.
  • a first portion of the storage area is labeled with reference number 1004A and also heighted with a dashed box, and a second portion of the storage area is labeled with reference number 1004B and also highlighted with a dashed box.
  • the storage area is collectively referred to herein as "storage area 1004." It should be understood that the storage area 1004 can include more portions (e.g., three, four, etc. portions) or less portions (e.g., one portion) than shown in Figs. 17A-17C. Additionally, each of the slots 1003 is configured to receive a respective unit of the product, each of which can be contained in a product package (e.g., a container such as a box, carton, wrapper, etc.).
  • Figs. 17A and 17B illustrate a perspective view of the automated product cabinet 1000 without product inventory (i.e., without product loaded into the slots 1003).
  • FIG. 17C illustrates a front view of the automated product cabinet with product inventory (i.e., product loaded into the slots 1003).
  • a client device 102 can be stored with and/or attached to the automated product cabinet 1000.
  • the automated product cabinet 1000 can optionally include a door 1006 configured to cover the face 1002 of the housing 1001. This is shown by Fig. 17B.
  • the door 1006 can be a hinged, pivot, or sliding door.
  • the door 1006 can be transparent to allow the user to view the product stored within the automated storage cabinet 1000 when the door 1006 is closed.
  • the automated product cabinet 1000 can also include an data capture device such as barcode scanner or imaging device and a controller (not shown in Figs. 17A-19D).
  • the data capture device can be attached to the scanning bar 1007 such that the data capture device can capture information about the product.
  • the units of product stored within the automated storage cabinet 1000 can be contained within product packages having machine-readable labels (e.g., barcodes,
  • the units of product can have machine-readable labels affixed directly thereon, i.e., as opposed to being contained in product packages having machine-readable labels.
  • the data capture device can therefore be attached to the scanning bar 1007 such that the machine- readable labels are within a field of view of the data capture device.
  • the slots 1003 can be arranged in rows and/or columns within the storage area 1004.
  • the automated product cabinet 1000 can include a plurality of data capture devices attached to the scanning bar 1007, for example, where a respective data capture device corresponds to a single row or single column of the slots 1003 arranged within the housing 1001. Accordingly, as described below, a row or column of slots 1003 can be within the field of view of a respective data capture device as the scanning bar 1007 is slidably repositioned along the face 1002.
  • the size of the automated product cabinet 1000 (e.g., number of rows and/or columns of slots 1003 in the storage area 1004) is provided only as an example. This disclosure contemplates that the size of the automated product cabinet 1000 (e.g., number of rows and/or columns of slots 1003 in the storage area 1004) can be different than that shown in in Figs. 17A-19D. For example, Figs. 20A-20C illustrate different sized automated product cabinets.
  • the scanning bar 1007 can be configured to be slidably repositioned along the face 1002 of the housing 1001 in a first direction and a second direction.
  • This disclosure contemplates that a user can manually reposition the scanning bar 1007 in the first and second directions.
  • the first and second directions are opposing relative directions.
  • the first and second directions can be vertical directions such as up and down, respectively.
  • Fig. 18B the scanning bar 1007 can be secured within a vertical track of the housing 1001 such that the user can manually slide the scanning bar 1007 in the vertical directions.
  • the scanning bar 1007 can be balanced by counterweight that is connected to the scanning bar 1007 using a pulley system. The counterweight and pulley system can be concealed within the housing 1001.
  • the first and second directions can be vertical directions such as left and right, respectively. This is shown by Fig. 19B.
  • the automated product locker can optionally include a plurality of scanning bars 1007A and 1007B (collectively referred to herein as "scanning bars 1007"), where each scanning bar 1007A and 1007B is configured to be slidably repositioned along the face 1002 of the housing 1001.
  • scanning bars 1007 can include one or more data capture devices.
  • the scanning bars 1007 can be fixed in a spaced apart relationship. For example, as shown in Figs.
  • a first scanning bar 1007A can be configured to be slidably repositioned along the face 1002 of the housing 1001 relative to a first portion of the storage area 1004A (e.g., the upper half of the storage area), and a second scanning bar 1007B can be configured to be slidably repositioned along the face 1002 of the housing 1001 relative to a second portion of the storage area 1004B (e.g., the lower half of the storage area).
  • each of the scanning bars 1007 need only traverse half of the face 1002 of the housing 1001. It should be understood that the number of scanning bars 1007 in Figs. 17A-17C (e.g., two) are provided only as an example.
  • the automated storage cabinet 1000 can include more scanning bars (e.g., three, four, etc. scanning bars) or less scanning bars (e.g., one scanning bar) than shown in Figs. 17A-17C. Additionally, it should be understood that the arrangement and/or direction of movement (e.g., up/down) of the scanning bars 1007 in Figs. 17A-17C are provided only as an example. As shown in Figs. 19A-19D, the scanning bars 1007 can be arranged such that the scanning bars move in the left/right directions.
  • the automated product cabinet 1000 includes visual indicators 1005.
  • the visual indicators 1005 are provided to notify a user (e.g., a health professional such as surgeon or ECP) of the location of a desired product within the automated product cabinet 1000.
  • a user e.g., a health professional such as surgeon or ECP
  • Visual indicators are provided to notify a user (e.g., a health professional such as surgeon or ECP) of the location of a desired product within the automated product cabinet 1000.
  • the housing 1001 can include an external frame 1001A, and a visual indicator 1005A can be arranged on or adjacent to the external frame 1001A.
  • Visual indicator 1005A is illuminated in Fig. 17C and can be used to indicate that the desired product is stored within the automated product cabinet 1000. This allows the user to identify the cabinet where the desired product is stored, which can be particularly helpful when product is stored in multiple cabinets.
  • a respective visual indicator 1005B can be arranged on, within, or adjacent to each one of the respective slots 1003. As shown in Fig. 17C, six of the slots 1003 are illuminated by visual indicators 1005B, which can be used to indicate the slots where the desired product is located within the automated product cabinet 1000. This allows a user to identify the exact location of the desired product within the storage area of the automated storage cabinet 1000. It should be understood that the arrangement of the visual indicators 1005 in Fig. 17C is provided only as an example. The visual indicators 1005 notify a user of the location of a desired product, so the visual indicators 1005 can be placed anywhere on and/or near the housing 1001 and/or slots 1003 for the benefit of the user.
  • Each of the visual indicators 1005 can be a light emitter such as a light emitting diode (LED). It should be understood that light emitters are provided only as an example. This disclosure contemplates that the visual indicators can be other elements including, but not limited to, a graphical display. As discussed above, the visual indicators (e.g., visual indicators 1005 in Fig. 16) can be operably coupled to the controller (e.g., controller 1111 in Fig. 16). The controller can transmit actuation signals to one or more of the visual indicators to notify the user where a desired product is located.
  • the controller e.g., controller 1111 in Fig. 16
  • the controller can cause one or more visual indicators 1005 on the exterior of the automated product cabinet 1000 to actuate and/or one or more visual indicators 1005 within the storage area 1004 to actuate.
  • visual indicators may indicate errors, such as by changing colors, blinking, or otherwise changing state to alert the user of a change in status.
  • Visual indicators may also guide the user (e.g., ECP, staff members, employees, third parties, or other users) to an available location within the cabinet when loading product into the cabinet.
  • visual indicators may display different images, colors, or other indication to specify to whom guidance is directed. For example, each user of the cabinet could be associated with a particular icon, graphic, or text in the case of a graphical display.
  • particular users could be associated with a given color or blink sequence in the software application operatively associated with the cabinet so that multiple users could be directed to their desired product simultaneously by following their assigned color on the visual indicators to the correct location within the automated storage cabinet 1000.
  • Figs. 21A-22 slots for accommodating units of product are shown.
  • Figs. 21A and 21B illustrates a plurality of slots 2005 arranged in rows and columns, where each of the slots 2005 accommodates respective unit of product 2010.
  • Fig. 21A shows the units of product 2010 loaded into the slots
  • Fig. 21B shows the empty slots 2005.
  • Figs. 21A and 21B illustrate a module with 8 columns and 10 rows (8 x 10 module).
  • the size of the module e.g., number of rows and/or columns of slots
  • the size of the module e.g., number of rows and/or columns of slots
  • the module shown in Figs. 21A and 21B can be provide in the automated storage cabinets described above with regard to Figs. 17A-19D.
  • one or more of the slots 2005 shown in Figs. 21A and 21B can be configured to accommodate different sized units of the product 2010.
  • different sized slots can accommodate different sized products and/or product packages.
  • a slot 2005 can include an ejection mechanism 2020 and a protruding member 2022.
  • the ejection mechanism 2020 and the protruding member 2022 can be configured to secure a unit of product 2010 located in the slot 2005.
  • the ejection mechanism 2020 can optionally be spring loaded (i.e., including a spring) such that the unit of product 2010 is secured against the protruding member 2022.
  • the unit of product 2010 can be released by disengaging the edge of the unit of product 2010 and the protruding member 2022. This allows the slot 2005 to accommodate units of product having different first linear dimensions such as length.
  • the slot 2005 can include a plurality of opposing elastic members 2024.
  • the opposing elastic members 2024 can be configured to contact opposite sides of a unit of product 2010 located in the slot 2005.
  • the opposing elastic members 2024 can stretch and maintain contact with units of product having different second linear dimensions such as width.
  • the automated product cabinet 1000 can optionally include a slot sensor arranged in one or more of the slots. The slot sensor can be configured to sense the presence of a unit of product.
  • the slot sensor can include a light emitter and a photodetector (e.g., a light curtain).
  • a light curtain includes a transmitter (e.g., light emitter such as infrared light emitter) and receiver (e.g., photoelectric cell(s)).
  • the photodetector sends a signal to the controller, which indicates the position of the object.
  • a plurality of light curtains e.g., spaced apart within the slot
  • This disclosure contemplates using other types of slot sensors to detect the presence of units of product within the slots of the automated product cabinet including, but not limited to, mechanical switches, pressure sensors, or other product present sensors. It should be understood that the number, size, and arrangement of slots 2005 in Figs. 21A-22 are provided only as examples.
  • the controller 1111 can be configured to inventory the product based, at least in part, on the information about the product, and cause one or more of the visual indicators 1005 that are associated with a desired unit of the product to actuate.
  • the controller 1111 can send a signal to one or more of the visual indicators 1005, which actuates the one or more visual indicators 1005.
  • a user e.g., surgeon or ECP
  • enters a request for a desired unit of product using a client device e.g., the client device 102 in Fig. 15.
  • the client device can transmit the request for the desired unit of the product to the automated product cabinet 1000 via a network (e.g., the network 200 in Fig. 15).
  • the controller 1111 can be configured to receive a request for the desired unit of the product. Additionally, the controller 1111 can be further configured to transmit the request for the desired unit of the product over the network to a remote system (e.g., the remote system 104 in Fig. 15). As described herein, the remote system can include and/or access an inventory database. The remote system can query the database to determine the position(s) of the desired unit(s) of product within the automated product cabinet 1000. The remote system can transmit a response to the controller over the network, and the controller 1111 can receive the response, which includes position(s) of the desired unit(s) of product within the storage area. It should be understood that such position(s) can include specific slot(s) 1003 where the desired unit(s) of product are located.
  • the controller 1111 can be configured to transmit signals to actuate visual indicators 1005 to assist the user in identifying the position(s) of the desired unit(s) of product within the automated storage cabinet 1000. This can include actuating visual indicators 1005A and 1005B as shown in Fig. 17C. These visual indicators highlight the locations of the desired units of the product for the benefit of the user.
  • the controller 1111 can be further configured to initiate the data capture device 1009 in response to a movement of the scanning bar 1007. By initiating the data capture device 1009 based on movement, the automated product cabinet 1000 can read/decode the machine-readable labels (e.g., barcodes, UPC, SKU, text, graphics) associated with the units of the product.
  • the machine-readable labels e.g., barcodes, UPC, SKU, text, graphics
  • the respective units of the product can then be associated with respective positions within the storage area.
  • the respective positions for each of the units of product can then be transmitted by the controller 1111 to the remote system.
  • the controller can be configured to transmit the updated inventory of the product over the network to the remote system, and the database can be updated accordingly.
  • the automated product cabinet 1000 can be restocked effortlessly.
  • the user e.g., surgeon or ECP
  • the product packages can instead be placed at random in the storage area.
  • the scanning bar 1007 can be moved, and the automated product cabinet 1000 can read/decode the machine-readable labels (e.g., barcodes, UPC, SKU, text, graphics) associated with the units of the product.
  • the respective units of the product can then be associated with respective positions within the storage area.
  • the respective positions for each of the units of product can then be transmitted by the controller 1111 to the remote system.
  • the controller 1111 can be configured to transmit the updated inventory of the product over the network to the remote system, and the database can be updated accordingly.
  • the data capture device 1009 can be a barcode scanner, which is capable of reading and decoding machine-readable product identifiers such as a ID barcode, a UPC, or an SKU.
  • the machine readable product identifiers can be affixed to and/or printed directly on the product packages and/or the product itself as described herein.
  • the step of inventorying the product based, at least in part, on the information about the product can include reading respective product identifiers associated with respective units of the product using the barcode scanner, and also decoding the respective product identifiers associated with the respective units of the product. After reading/decoding the respective product identifiers, it is possible to associate the respective units of the product with the respective positions within the storage area. This disclosure contemplates performing this association with either the controller 1111 and/or the remote system.
  • the data capture device 1009 can be an imaging device such as a digital camera, which is capable of capturing images of machine-readable product identifiers such as a ID barcode, a 2D barcode, a 3D barcode, a UPC, or an SKU.
  • An imaging device is also capable of capturing images of text and/or a graphics, which can serve as machine readable product identifiers.
  • image processing techniques can be used to decode the machine readable product identifiers.
  • the step of inventorying the product based, at least in part, on the information about the product can include receiving images of the product captured by the imaging device, analyzing the images of the product to identify respective product identifiers associated with respective units of the product, decoding the respective product identifiers associated with the respective units of the product. After analyzing/decoding the respective product identifiers, it is possible to associate the respective units of the product with the respective positions within the storage area. This disclosure contemplates performing this association with either the controller 1111 and/or the remote system.
  • the step of inventorying the product based, at least in part, on the information about the product further includes cropping a portion of the images of the product.
  • cropping the images it is possible to focus on the portion of the image expected to contain the product identifiers.
  • the cropped portion of the images is analyzed to identify the respective product identifiers associated with the respective units of the product.
  • the controller 1111 can be configured to transmit the images of the product over a network to a remote system.
  • the images can be stored by the remote system for back up purposes, or image processing (some or all) can be offloaded from the controller 1111 to the remote system.
  • the controller 1111 can be configured to store the images of the product in the memory.
  • the images can be stored only temporarily (e.g., to allow for image processing) and then written over to minimize the storage requirements at the automated product cabinet 1000.
  • the step of inventorying the product based, at least in part, on the information about the product further includes analyzing the images of the product to identify one or more of the respective positions within the storage area associated with a missing, unrecognized, or unreadable product identifier.
  • the controller 1111 can be configured to distinguish between missing units of product and units of product having unrecognized/unreadable product identifiers. It should be understood that the former may be restocked, while the latter may be repositioned (e.g., flipped over, turned over, relabeled) to correctly orient the product identifier for reading by the data capture device 1009.
  • a machine learning algorithm can be used to determine whether one or more of the respective positions within the storage area associated with the missing, unrecognized, or unreadable product identifier contain a unit of the product.
  • the machine learning algorithm can be executed by the controller 1111 in some implementations using traditional vision systems (e.g., pattern recognition), while in other implementations the machine learning algorithm can be executed by the remote system (i.e., offloaded from the automated product cabinet 1000).
  • Machine learning algorithms can be trained using an existing dataset to perform a specific task such as identify missing, unrecognized, or unreadable product identifiers. Machine learning algorithms are known in the art and therefore not described in further detail below.
  • TensorFlow An example machine learning algorithm is TensorFlow, which is an open source machine learning algorithm known in the art. TensorFlow is only one example machine learning algorithm. This disclosure contemplates using other machine learning algorithms including, but not limited to, neural networks, support vector machines, nearest neighbor algorithms, supervised learning algorithms, unsupervised learning algorithms.
  • the step of inventorying the product based, at least in part, on the information about the product further includes analyzing the images of the product to determine, using a machine learning algorithm, a source of each of the respective units of the product.
  • a machine learning algorithm e.g., a source of each of the respective units of the product.
  • a machine learning algorithm can be used to identify machine readable codes associated with different vendors or manufacturers. This allows the automated product cabinet 1000 to select the appropriate decoding rules. Alternatively or additionally, a machine learning algorithm can be used to identify the source of a unit of product based on text and/or graphics (even in the absence of machine readable codes).
  • the machine learning algorithm can be executed by the controller 1111 in some implementations, while in other implementations the machine learning algorithm can be executed by the remote system (i.e., offloaded from the automated product locker).
  • Machine learning algorithms can be trained using an existing dataset to perform a specific task such as identify the source of units of the product. Machine learning algorithms are known in the art and therefore not described in further detail below. Example machine learning algorithms are provided above.
  • the automated product cabinet 1500 can include a housing 1501 defining a storage area 1504 configured to receive a product and a plurality of slots 1503 arranged within the housing 1501. As described herein, a plurality of units of the product can be arranged in the slots 1503.
  • the product can optionally be contained in one or more product packages (e.g., a container such as a box, carton, wrapper, etc.).
  • Each respective unit of the product can include a respective smart tag.
  • Each smart tag stores information about a respective unit of the product. This disclosure contemplates that the smart tags can be applied to the products and/or the product packages.
  • the respective smart tags can be radiofrequency identification (RFID) tags, ultra high frequency (UHF) tags, or near field communication (NFC) tags.
  • RFID, UHF, or NFC tags are provided only as example smart tags.
  • the smart tags can be any type of tag with memory for storing information, an antenna, and ability to transmit data to the controller.
  • the smart tags are used in lieu of providing an data capture device configured to read machine-readable labels affixed the products and/or product packages.
  • the automated product cabinet 1500 can also include a plurality of visual indicators 1505 configured to indicate respective positions of the respective units of the product within the housing 1501.
  • the visual indicators 1505 can be arranged on or adjacent to the external frame of the housing 1501 and/or on, within, or adjacent to each one of the slots 1503. As described herein , the visual indicators 1505 can be used to indicate where the desired product is stored within the automated product cabinet
  • the automated product cabinet 1500 can also include a controller (e.g., controller 1111 in Fig. 15). In some implementations, the controller may optionally be arranged within the housing
  • the controller 1111 can be operably coupled to the smart tags and/or visual indicators 1505, for example, through one or more communication links.
  • the controller can be configured to receive information about the respective units of the product from the respective smart tags, inventory the product based, at least in part, on the information about the respective units of the product, and cause one or more of the visual indicators 1505 that are associated with a desired unit of the product to actuate.
  • the controller can be further configured to transmit an inventory of the product over a network to a remote system.
  • the remote system can be a database.
  • the controller can be further configured to receive a request for the desired unit of the product.
  • the controller can be further configured to transmit the request for the desired unit of the product over a network to a remote system, and receive a response from the remote system, the response including a slot where the desired unit of product is located.
  • the automated product system 1700 can include a housing 1701 defining a storage area configured to receive a product and a plurality of slots arranged within the housing. As described herein, a plurality of units of the product can be arranged in the slots.
  • the housing 1701, slots, and units of product can be similar to those described above with regard to Figs. 15-23. Additionally, as described herein, the product can optionally be contained in one or more product packages (e.g., a container such as a box, carton, wrapper, etc.).
  • the automated product system 1700 can also include an imaging and projector unit 1703 arranged in a spaced apart relationship with respect to the housing 1701.
  • the imaging and projector unit 1703 can include an imaging device and a projector.
  • the imaging device and the projector are provided in a single housing. In other implementations, the imaging device and the projector are provided in separate housings.
  • the imaging device can be a digital camera, which is capable of capturing images of machine readable product identifiers such as a ID barcode, a 2D barcode, a 3D barcode, a UPC, or an SKU.
  • An imaging device is also capable of capturing images of text and/or a graphics, which can serve as machine readable product identifiers.
  • image processing techniques can be used to decode the machine readable product identifiers.
  • the projector can be a device with a light source and/or one or more lenses and configured to project light rays (e.g., image) onto a surface (e.g., a projection surface).
  • a light source e.g., image
  • a surface e.g., a projection surface
  • the housing 1701 (e.g., a face of the housing 1701) is the projection surface.
  • the projector can be a short-throw or ultra-short-throw projector.
  • Short-throw projectors have a throw ratio less than 1, where the throw ratio is calculated as the distance from projector to surface to the screen size.
  • Short-throw projectors have a throw ratio between about 0.6 and 0.8.
  • Ultra-short-throw projectors have a throw ratio less than about 0.4.
  • Projectors, including short throw projectors are known in the art.
  • Example projectors are EPSON POWERLITE projectors from Seiko Epson Corporation of Suwa, Nagano Prefecture, Japan. In Fig.
  • the automated product system 1700 can include optics 1711 to further reduce the throw ratio.
  • the optics 1711 can include lenses, mirrors, or combinations thereof.
  • the automated product system 1700 can also include a controller (e.g., controller 1111 in Fig. 15).
  • the controller may optionally be arranged within the housing 1701 or within the imaging and projector unit 1703.
  • the controller 1111 can be operably coupled to the imaging and projector unit 1703, for example, through one or more communication links.
  • the communication links are any suitable communication link.
  • the controller can be configured to receive information about the product from the imaging device, inventory the product based, at least in part, on the information about the product, and cause the projector to illuminate a respective location of a desired product within the housing.
  • the projector is used to illuminate (e.g., with light) the locations of desired products and/or product packages stored within the housing 1701.
  • the controller can be further configured to transmit an inventory of the product over a network to a remote system.
  • the remote system can be a database.
  • the controller can be further configured to receive a request for the desired unit of the product.
  • the controller can be further configured to transmit the request for the desired unit of the product over a network to a remote system, and receive a response from the remote system, the response including a slot where the desired unit of product is located.
  • the projector is used in lieu of providing visual indicators for illuminating the locations of the desired products and/or product packages within the system.

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Theoretical Computer Science (AREA)
  • Public Health (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Business, Economics & Management (AREA)
  • Medical Informatics (AREA)
  • Economics (AREA)
  • Biomedical Technology (AREA)
  • Surgery (AREA)
  • Toxicology (AREA)
  • Electromagnetism (AREA)
  • Veterinary Medicine (AREA)
  • Animal Behavior & Ethology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Artificial Intelligence (AREA)
  • Epidemiology (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Primary Health Care (AREA)
  • Operations Research (AREA)
  • Quality & Reliability (AREA)
  • Strategic Management (AREA)
  • Tourism & Hospitality (AREA)
  • Marketing (AREA)
  • Human Resources & Organizations (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Accounting & Taxation (AREA)
  • Finance (AREA)
  • Development Economics (AREA)
  • Molecular Biology (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Ophthalmology & Optometry (AREA)
  • Microelectronics & Electronic Packaging (AREA)
  • Multimedia (AREA)

Abstract

Une armoire de produits automatisée donnée à titre d'exemple comprend un boîtier, délimitant une zone de stockage configurée pour recevoir un produit, et une face. L'armoire comprend une pluralité de casiers, chaque casier étant configuré pour recevoir une unité respective du produit, et une pluralité d'indicateurs visuels configurés pour indiquer des positions des unités du produit. L'armoire comprend une barre de balayage configurée pour être repositionnée par coulissement le long de la face du boîtier, et un dispositif de capture de données fixé à la barre de balayage et configuré pour capturer des informations liées au produit. L'armoire comprend un dispositif de commande couplé de manière fonctionnelle au dispositif de capture de données. Le dispositif de commande est configuré pour inventorier le produit sur la base, au moins en partie, des informations liées au produit, et pour actionner un ou plusieurs des indicateurs visuels qui sont associés à une unité souhaitée du produit.
EP20793155.1A 2019-10-03 2020-10-02 Armoire de produits automatisée pour contrôle d'inventaire Pending EP4038562A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US16/592,315 US20200364650A1 (en) 2019-05-13 2019-10-03 Automated product cabinet for inventory control
PCT/IB2020/059292 WO2021064691A1 (fr) 2019-10-03 2020-10-02 Armoire de produits automatisée pour contrôle d'inventaire

Publications (1)

Publication Number Publication Date
EP4038562A1 true EP4038562A1 (fr) 2022-08-10

Family

ID=72915873

Family Applications (1)

Application Number Title Priority Date Filing Date
EP20793155.1A Pending EP4038562A1 (fr) 2019-10-03 2020-10-02 Armoire de produits automatisée pour contrôle d'inventaire

Country Status (8)

Country Link
EP (1) EP4038562A1 (fr)
JP (1) JP2022551355A (fr)
KR (1) KR20220075176A (fr)
CN (1) CN112930571A (fr)
AU (1) AU2020281008A1 (fr)
IL (1) IL279060A (fr)
MX (1) MX2020012814A (fr)
WO (1) WO2021064691A1 (fr)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12045772B2 (en) 2019-05-13 2024-07-23 Johnson & Johnson Vision Care, Inc. Automated product locker for inventory control
US20230306451A1 (en) * 2022-03-28 2023-09-28 Focal Systems, Inc. Using machine learning to identify substitutions and recommend parameter changes

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050192705A1 (en) * 2003-07-01 2005-09-01 Asteres Inc. Random access and random load dispensing unit
CN100369044C (zh) * 2004-06-29 2008-02-13 刘宝 一种图书定位装置及定位方法
US9147174B2 (en) * 2008-08-08 2015-09-29 Snap-On Incorporated Image-based inventory control system using advanced image recognition
US10242332B2 (en) * 2015-10-12 2019-03-26 Novartis Ag Intraocular lens storage cart and methods
CN205257175U (zh) * 2016-01-05 2016-05-25 国家电网公司 基于升降原理条码识读实现自动盘点的互感器智能周转柜
CN205594642U (zh) * 2016-04-14 2016-09-21 天津百利机械装备集团有限公司中央研究院 一种条码二维自动扫描装置

Also Published As

Publication number Publication date
WO2021064691A1 (fr) 2021-04-08
AU2020281008A1 (en) 2021-04-22
KR20220075176A (ko) 2022-06-07
MX2020012814A (es) 2021-06-23
CN112930571A (zh) 2021-06-08
JP2022551355A (ja) 2022-12-09
IL279060A (en) 2021-04-29

Similar Documents

Publication Publication Date Title
US20200364650A1 (en) Automated product cabinet for inventory control
US12045772B2 (en) Automated product locker for inventory control
US20190236530A1 (en) Product inventorying using image differences
US11361278B2 (en) Optical sensing-based inventory control systems and methods
CN109089082B (zh) 一种基于热特性图像的图像采集系统
US10346590B2 (en) Prescription storage and retrieval system
US12045774B2 (en) Inventory management system
KR20190137855A (ko) 광 섬유 선반 시스템
EP4038562A1 (fr) Armoire de produits automatisée pour contrôle d'inventaire
US20230079018A1 (en) Deep learning-based detection of item sizes for autonomous checkout in a cashier-less shopping store
US12112293B2 (en) Dispensing and tracking system
RU2820492C1 (ru) Автоматизированный шкаф для продуктов с функцией учета запасов
CA3102082A1 (fr) Armoire a produits d'automatisation pour la gestion et l'administration du materiel
US20230343444A1 (en) Smart inventory management cabinet
CN212541486U (zh) 智能售药设备
CN111968307A (zh) 一种智能售药设备的取药方法
US20240257380A1 (en) Systems and methods for detecting support members of product storage structures at product storage facilities
WO2023209511A1 (fr) Armoire de gestion d'inventaire intelligente
US20240265663A1 (en) Systems and methods for recognizing product labels and products located on product storage structures of product storage facilities
ES1305052U (es) Armario de almacenamiento
CN111882771A (zh) 智能售药设备
RU2020138753A (ru) Автоматизированный стеллаж для хранения продуктов с функцией учета запасов

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20201126

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 40076626

Country of ref document: HK