WO2020243230A1 - Systems, apparatuses and methods for capturing images of medical condition management events and related equipment with smartphone and related app that processes images to reduce medical errors - Google Patents

Systems, apparatuses and methods for capturing images of medical condition management events and related equipment with smartphone and related app that processes images to reduce medical errors Download PDF

Info

Publication number
WO2020243230A1
WO2020243230A1 PCT/US2020/034815 US2020034815W WO2020243230A1 WO 2020243230 A1 WO2020243230 A1 WO 2020243230A1 US 2020034815 W US2020034815 W US 2020034815W WO 2020243230 A1 WO2020243230 A1 WO 2020243230A1
Authority
WO
WIPO (PCT)
Prior art keywords
medical
medication
app
portable device
indicia
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2020/034815
Other languages
English (en)
French (fr)
Inventor
Amit Uday Limaye
Elaine Tam
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Becton Dickinson and Co
Original Assignee
Becton Dickinson and Co
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Becton Dickinson and Co filed Critical Becton Dickinson and Co
Priority to CA3138313A priority Critical patent/CA3138313A1/en
Priority to JP2021570827A priority patent/JP7750746B2/ja
Priority to EP20814147.3A priority patent/EP3977403A4/en
Publication of WO2020243230A1 publication Critical patent/WO2020243230A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
    • G16H20/10—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to drugs or medications, e.g. for ensuring correct administration to patients
    • G16H20/17—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to drugs or medications, e.g. for ensuring correct administration to patients delivered via infusion or injection
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/0002—Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/0002—Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network
    • A61B5/0004—Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network characterised by the type of physiological signal transmitted
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/01—Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/02—Detecting, measuring or recording for evaluating the cardiovascular system, e.g. pulse, heart rate, blood pressure or blood flow
    • A61B5/021—Measuring pressure in heart or blood vessels
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/145—Measuring characteristics of blood in vivo, e.g. gas concentration or pH-value ; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid or cerebral tissue
    • A61B5/14532—Measuring characteristics of blood in vivo, e.g. gas concentration or pH-value ; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid or cerebral tissue for measuring glucose, e.g. by tissue impedance measurement
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/145—Measuring characteristics of blood in vivo, e.g. gas concentration or pH-value ; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid or cerebral tissue
    • A61B5/1455—Measuring characteristics of blood in vivo, e.g. gas concentration or pH-value ; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid or cerebral tissue using optical sensors, e.g. spectral photometrical oximeters
    • A61B5/14551—Measuring characteristics of blood in vivo, e.g. gas concentration or pH-value ; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid or cerebral tissue using optical sensors, e.g. spectral photometrical oximeters for measuring blood gases
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • A61B5/6887—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient mounted on external non-worn devices, e.g. non-medical devices
    • A61B5/6898—Portable consumer electronic devices, e.g. music players, telephones, tablet computers
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7271—Specific aspects of physiological measurement analysis
    • A61B5/7282—Event detection, e.g. detecting unique waveforms indicative of a medical condition
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/74—Details of notification to user or communication with user or patient; User input means
    • A61B5/746—Alarms related to a physiological condition, e.g. details of setting alarm thresholds or avoiding false alarms
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M5/00—Devices for bringing media into the body in a subcutaneous, intra-vascular or intramuscular way; Accessories therefor, e.g. filling or cleaning devices, arm-rests
    • A61M5/178—Syringes
    • A61M5/31—Details
    • A61M5/3129—Syringe barrels
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M5/00—Devices for bringing media into the body in a subcutaneous, intra-vascular or intramuscular way; Accessories therefor, e.g. filling or cleaning devices, arm-rests
    • A61M5/178—Syringes
    • A61M5/31—Details
    • A61M5/315—Pistons; Piston-rods; Guiding, blocking or restricting the movement of the rod or piston; Appliances on the rod for facilitating dosing ; Dosing mechanisms
    • A61M5/31565—Administration mechanisms, i.e. constructional features, modes of administering a dose
    • A61M5/31566—Means improving security or handling thereof
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K17/00—Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations
    • G06K17/0022—Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations arrangements or provisions for transferring data to distant stations, e.g. from a sensing device
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/64—Three-dimensional [3D] objects
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02—Alarms for ensuring the safety of persons
    • G08B21/04—Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons
    • G08B21/0438—Sensor means for detecting
    • G08B21/0461—Sensor means for detecting integrated or attached to an item closely associated with the person but not worn by the person, e.g. chair, walking stick, bed sensor
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H10/00—ICT specially adapted for the handling or processing of patient-related medical or healthcare data
    • G16H10/60—ICT specially adapted for the handling or processing of patient-related medical or healthcare data for patient-specific data, e.g. for electronic patient records
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H15/00—ICT specially adapted for medical reports, e.g. generation or transmission thereof
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00—ICT specially adapted for the handling or processing of medical images
    • G16H30/40—ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/20—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/60—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2576/00—Medical imaging apparatus involving image processing or analysis
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M2205/00—General characteristics of the apparatus
    • A61M2205/18—General characteristics of the apparatus with alarm
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M2205/00—General characteristics of the apparatus
    • A61M2205/35—Communication
    • A61M2205/3576—Communication with non implanted data transmission devices, e.g. using external transmitter or receiver
    • A61M2205/3584—Communication with non implanted data transmission devices, e.g. using external transmitter or receiver using modem, internet or Bluetooth®
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M2205/00—General characteristics of the apparatus
    • A61M2205/50—General characteristics of the apparatus with microprocessors or computers
    • A61M2205/502—User interfaces, e.g. screens or keyboards
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M2205/00—General characteristics of the apparatus
    • A61M2205/50—General characteristics of the apparatus with microprocessors or computers
    • A61M2205/52—General characteristics of the apparatus with microprocessors or computers with memories providing a history of measured variating parameters of apparatus or patient
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M2205/00—General characteristics of the apparatus
    • A61M2205/58—Means for facilitating use, e.g. by people with impaired vision
    • A61M2205/581—Means for facilitating use, e.g. by people with impaired vision by audible feedback
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M2205/00—General characteristics of the apparatus
    • A61M2205/58—Means for facilitating use, e.g. by people with impaired vision
    • A61M2205/583—Means for facilitating use, e.g. by people with impaired vision by visual feedback
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M2205/00—General characteristics of the apparatus
    • A61M2205/60—General characteristics of the apparatus with identification means
    • A61M2205/6063—Optical identification systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00—Indexing scheme relating to image or video recognition or understanding
    • G06V2201/03—Recognition of patterns in medical or anatomical images
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02—Alarms for ensuring the safety of persons
    • G08B21/04—Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons
    • G08B21/0438—Sensor means for detecting
    • G08B21/0476—Cameras to detect unsafe condition, e.g. video cameras

Definitions

  • Illustrative embodiments relate generally to using a portable, handheld device such as a smartphone to capture images of medical condition management events involving medical equipment, and related smartphone app that processes the images and interacts with user(s).
  • Illustrative embodiments relate generally to a medical event image capture app that processes images of medical condition management events to reduce medical errors that can be caused by using incompatible injection device and drug, drawing incorrect drug amount into syringe or injection pen prior to delivery, using contaminated or incorrect drug or damaged or incorrect injection supplies, etc.
  • Medication non-adherence is an issue of global importance, particularly with regard to diabetes care. Fifty percent (50%) of all patients do not take their medication as prescribed. Non-adherence directly contributes to hundreds of thousands of deaths and billions of dollars in avoidable medical and related costs.
  • a portable device for capturing images of medical events to reduce medical errors comprises: an imaging device for imaging at least one medical product in use during a medical event; a memory to store images captured by the imaging device and program instructions for processing captured images; a user interface configured to generate an output to a user; and a processor.
  • the processor is adapted to execute the program instructions to analyze a captured image associated with the medical event to detect a characteristic of the medical product selected from the group consisting of an indicia on the medical product, and a designated attribute of the medical product, and to analyze the detected characteristic to determine when a medical error occurs.
  • the medical error corresponds to when the medical product is incompatible with the medical event, mishandled by the user, or malfunctioning.
  • the processor is configured to generate an output to the user via the user interface comprising an alert related to the medical error.
  • the medical device is a medication delivery device having indicia
  • the processor is configured to analyze a captured image of the medication delivery device and detect the indicia, and analyze the or other captured image of the medication delivery device medication and detect an amount of medication indicated for delivery by the medication delivery device.
  • the processor determines the designated amount of medication corresponding to the medication delivery device associated with the indicia detected from the captured image, and generates an alert via the user interface when the detected amount of medication indicated for delivery is determined to be different from the designated amount of medication.
  • the detected amount of medication indicated for delivery corresponds to a marking in the captured image that is associated with at least one of a dose input on an injection pen, or a level indicator on a syringe barrel that is adjacent to fluid level in the syringe.
  • the processor uses an algorithm chosen from a two- dimensional image processing algorithm and a three-dimensional image processing algorithm to analyze the or other captured image and detect the amount of medication indicated for delivery by the medication delivery device.
  • the medical device is a medication delivery device having indicia
  • the processor is configured to analyze a captured image of the medication delivery device and detect the indicia.
  • the processor determines the designated amount of medication corresponding to the medication delivery device associated with the indicia detected from the captured image, and generates an alert via the user interface when a prescribed amount of medication indicated for delivery is determined to be different from the designated amount of medication.
  • the processor is further configured, for example, to analyze the or other captured image of the medication delivery device medication and detect an amount of medication indicated for delivery by the medication delivery device, the detected amount of medication indicated for delivery corresponding to a marking in the captured image that is associated with at least one of a dose input on an injection pen and a level indicator on a syringe barrel that is adjacent to fluid level in the syringe, and generate an alert via the user interface when the prescribed amount of medication indicated for delivery is determined to be different from the detected amount of medication indicated for delivery.
  • the medical device is a medication delivery device
  • the processor is configured to analyze the captured image of the medication delivery device, detect an amount of medication indicated for delivery by the medication delivery device, and store the detected amount of medication indicated for delivery in the memory device.
  • the detected amount of medication indicated for delivery corresponds, for example, to a marking in the captured image that is associated with at least one of a dose input on an injection pen and a level indicator on a syringe barrel that is adjacent to fluid level in the syringe.
  • program instructions comprise at least one of a two-dimensional image processing algorithm and a three-dimensional image processing algorithm used by the processor to analyze the captured image.
  • the processor is configured to analyze at least one captured image to detect a characteristic of the medical product comprising at least one designated attribute of the medical product selected from the group consisting of selected color of medical product, selected dimension of medical product, selected form factor of medical product, presence of safety mechanism on medical product, absence of safety mechanism on medical product as compared with stored image of medical product having safety mechanism, and analyze the detected characteristic to determine whether a medical error lias occurred using previously stored medical product data that is at least one of locally and remotely accessible by the processor, the previously stored medical product data comprising designated specifications for image characteristics of the medical product corresponding to the at least one designated attribute.
  • the medical product is a liquid medication drawn into a syringe
  • the at least one designated attribute of the liquid medication is selected from the group consisting of opaqueness of the liquid medication, presence of bubbles in the liquid medication, presence of particulates in the liquid medication.
  • the previously stored medical product data comprises designated specifications for image characteristics of the at least one designated attribute of the liquid medication.
  • a portable device that is at least one of a mobile phone and a computing device with wireless communications interface
  • the memory is configured to store at least one of an integrated disease management (IDM) app
  • the IDM app comprising an IDM personal app operated by a user who is a patient and/or an IDM professional app operated by a healthcare professional.
  • the processor is further adapted to execute instructions in accordance with the IDM app to operate the portable device in a cloud configuration with a remote IDM system whereby the IDM app transfers data to and receives data from the IDM system during an app session.
  • the processor is further adapted to execute instructions in accordance with the IDM app to transfer the medical event information to the IDM system.
  • a portable device for capturing images of medical events comprises: an imaging device for imaging at least one medical product in use during a medical event; a memory to store images captured by the imaging device and program instructions for processing captured images; a user interface configured to generate an output to a user; and a processor adapted to execute the program instructions to analyze a captured image associated with the medical event to detect a characteristic of the medical product selected from the group consisting of an indicia on the medical product, and a designated attribute of the medical product, store data related to the detected characteristic in the memory, and generate an output to the user via the user interface using the data related to the detected characteristic.
  • the monitor is selected from the group consisting of a pulse oximeter, thermometer, blood pressure monitor, and blood glucose monitor.
  • illustrative embodiments may comprise apparatuses and methods for operating same having one or more of the above aspects, and/or one or more of the features and combinations thereof.
  • the illustrative embodiments may comprise one or more of the features and/or combinations of the above aspects as recited, for example, in the attached claims.
  • FIG. 1 depicts a device with a medical event image capture app and different types of example medication delivery products in accordance with an illustrative
  • FIG. 2 is a block diagram of the device with a medical event image capture app of Fig. 1 in accordance with an illustrative embodiment
  • Figs. 3 A, 3B, 3C, 3D, 3E, 4 A, 4B and 5 each depict the device with a medical event image capture app of Fig. 1 capturing an image of an example medication delivery product in accordance with an illustrative embodiment:
  • Fig. 6 is a flow chart comprising example operations performed by the device with a medical event image capture app of Fig. 1 in accordance with an illustrative embodiment
  • Figs. 7 A, 7B, 7C, 7D, 7E, 7F, 7G and 7H and Figs. 8A, 8B, 8C, 8D and 8E and Figs. 9 A, 9B and 9C illustrate example GUI screens generated by the device with a medical e vent image capture app of Fig. 1 in accordance with an illustrative embodiment
  • Fig. 10 is an example integrated disease management system using the device with a medical event image capture app of Fig. 1 in accordance with an illustrative embodiment.
  • a medical condition management event image capture app 40 is described herein that can be a standalone app on a smartphone 20 or other portable device with camera (e.g., an iPad), or can be provided as an enhancement to a digital health (DH) app for a smartphone or other smart, connected device.
  • a medical condition management event image capture app 40 can be a standalone app on a smartphone 20 or other portable device with camera (e.g., an iPad), or can be provided as an enhancement to a digital health (DH) app for a smartphone or other smart, connected device.
  • DH digital health
  • the medical event image capture app 40 uses an image of indicia 24 on medical products 22, or an image of the medical product 22 (e.g., a camera image of a product 22 with indicia 24 as indicated at 25 in Fig. 7B), to automate access to and/or recording of additional informatics to assist with medical condition management.
  • the additional infonnatics from the captured medical product images are used by different functions of the app 40 to reduce medical errors (e.g., injections of the wrong amount of medication due to medical product misuse or defect).
  • Fig. 1 shows an example smartphone 20 with the medical event image capture app 40 and a plurality of example medical products 22 such as, but not limited to, injection pen needle assemblies and related injection pen products, syringe injection products, and syringe safety injection products (e.g., BD AutoShield DuoTM Pen Needle and BD
  • example medical products 22 such as, but not limited to, injection pen needle assemblies and related injection pen products, syringe injection products, and syringe safety injection products (e.g., BD AutoShield DuoTM Pen Needle and BD
  • SafetyGlideTM 6mm insulin syringe which are designed to help prevent inadvertent needlestick injury during injections, particularly in clinical settings), among others.
  • the products 22 can be provided with different types of indicia 24 that are printed or inscribed directly thereon, or applied indirectly to products 22 using labels comprising the indicia, for example.
  • the indicia 24 can be one or more of alphanumeric text, symbols, different colors, and optically recognized codes such as bar codes, Quick Response (QR) codes, and universal product (UPC) codes, among other types of indicia whose image can be captured via a camera and, in accordance with an aspect of the illustrative embodiments, processed for decoding into related infonnation about the item to which the insignia is applied or related event involving use of the item.
  • QR Quick Response
  • UPC universal product
  • Illustrative embodiments described herein are with reference to diabetes management and injection of insulin, for example. It is to be understood that the indicia, image capture and app processing of images to obtain medical condition management event informatics, and human machine interactions based on those informatics, in accordance with the illustrative embodiments can be used for reducing errors with respect to management or treatment of other medical conditions that require use of various devices and medical condition management procedures such as surgical instruments, blood collection and delivery products, delivery of other medications besides long-acting and short-acting insulins (e.g., drugs related to hormone therapies, GLP-ls, rheumatoid arthritis or Crohn’s disease treatment, and other drugs that require dosing regimens and a certain level of control and monitoring), and so on.
  • drugs related to hormone therapies, GLP-ls, rheumatoid arthritis or Crohn’s disease treatment e.g., drugs related to hormone therapies, GLP-ls, rheumatoid arthritis or Crohn’s disease
  • the illustrative embodiments can be used to reduce medical errors associated with self-injection using other types of medications, correct use of surgical tools for a selected medical procedure, correct use of equipment for IV delivery of medical fluids to patients, and so on.
  • illustrative embodiments described herein are advantageous to a variety different injection applications besides human patient injection events such as veterinary treatments that employ injection regimens.
  • Example embodiments are described herein with respect to diabetes management and related injection products and events. It is to be understood, however, that these example embodiments can be implemented with respect to other types of human and non-human animal medical conditions, medical events and related condition management products. Further, the medical events need not be related to drug administration (e.g., can instead be for surgical instrument preparation). Further, any drug administration application need not be limited to injections. For example, the app 40 can be used for informatics capture and management of an oral medication regimen and/or topical treatment regimen. With regard to diabetes management, diabetes care companies manufacture a very large number of insulin delivery or injection products that are integral to the diabetes therapy of diabetic patients worldwide.
  • injection products are utilized by patients who self-inject and caregivers of diabetic patients, and can include, but are not limited to, injection pens, pen needle assemblies, syringes, different sizes of needles, different types of insulin in different form factors (e.g., vials, pre-filled syringes, cartridges for injections pens).
  • a patient’s injection regimen can require a selected type of syringe, needle and type of insulin such that using the wrong type of insulin or syringe can impact the accuracy of the intended dosage amount.
  • a device 20 with the medical event image capture app 40 (1) provides image capture of medical event device(s) and image processing to determine one or more of medical equipment correctness, accuracy of delivered amount, and medication status, and (2) generates alerts and user guidance via a graphical user interface on a device 20 to reduce medical errors.
  • Fig. 2 is a block diagram depicting an example device 20.
  • the device 20 is referred to as a smartphone, but it is understood that the device 20 can be a dedicated medical management device or other portable, handheld device (e.g., iPad) with an indicia image capture or reader device 28 such as a camera.
  • the device 20 comprises a processor 26, and a memory 36 that can store a medical event image capture app 40 in accordance with an illustrative embodiment, along with other device data, images and apps.
  • the device 20 can have one or more wireless communication interface(s) 38 such as a Bluetooth ® -enabled wireless communications interface and a cellular communications interface, for example.
  • the device 20 can also have different user interfaces such as one or more of a microphone 32, touchscreen 30 or other display device that generates graphical user interface (GUI) screens such as those of the medical event image cap ture app 40, optional keypad or other user input device (not shown), and an audio signal output device (e.g., speaker or buzzer) 34.
  • GUI graphical user interface
  • the medical event image capture app 40 is program code that provides indicia and/or injection product image capture operations, and captured image processing operations.
  • the captured image processing operations can (1) decode or otherwise discern artifacts and related informatics from indicia and other image elements in the captured image, and (2) perform human machine interaction (HMI) operations or other logical operations that alert a user regarding a selected informatic and request input or otherwise educate the user about a related medical event.
  • HMI human machine interaction
  • the image capture operation captures images from the device camera 28.
  • the captured image processing operations can implement a two- dimensional (2D) image and/or or three-dimensional (3D) image processing algorithm to detect selected artifacts from the captured image(s).
  • the captured image processing operations can optionally include a recognition operation such as a QR code reader, bar code or UPC code reader, or optical character recognition (OCR) operation within the app 40.
  • a recognition operation such as a QR code reader, bar code or UPC code reader, or optical character recognition (OCR) operation within the app 40.
  • OCR optical character recognition
  • the HMI or other operations of the medical event image capture app 40 determine how the detected artifacts impact a medical condition management event and generate GUI screens or other HMI outputs (e.g., audible inquiry or message output to the user by the speaker 34) to educate the user or request user input.
  • At least three applications for the medical event image capture app 40 are described with reference to Figs. 3A to 3E, Figs. 4A and 4B, and Fig. 5, respectively, that is, (1) confirmation of correct injection device, (2) dose confirmation, and (3) detection of defective drug, device or improper use.
  • the app 40 can provide only one of these applications, a subset of any two of these applications, or all of these applications.
  • a smartphone 20 having the medical event image capture app 40 is depicted with one or more devices 22 (e.g., a vial of insulin and a syringe) having indicia 24 in an image range 42 of the smartphone camera 28.
  • the app 40 can recognize correct injection device by virtue of image recognition, QR code or other machine-readable code, color of the markings on the syringe or vial, or other distinguishing features.
  • syringes there can be a variety of needle sizes, barrel capacities and scale markings that are unique to a certain type of drug. Examples illustrated with insulin syringes are shown below, but are
  • Some injection products such as those commercially available from Becton, Dickinson and Company or “BD,” already have unique markings that indicate that they should be used with certain types of drags. These unique markings or indicia (e.g., a QR code) can be made readable by the app 40 via the app’s image processing algorithm to ensure that the patient or caregiver is using the correct kind of syringe for the correct insulin and thereby reduce medication errors.
  • BD Becton, Dickinson and Company
  • the app 40 can be programmed to consult locally stored or remotely accessed information comprising tables or other data memory structures for these unique markings 24 related to particular injection products 22 for comparison or other analysis to identify the item 22 in the captured image.
  • these unique markings or indicia 24 can be detected via the app 40 to automatically navigate to user to online education materials (e.g., videos) on injections or other medical condition management skills.
  • the indicia 24 is a QR code
  • the app 40 can have a QR code scanner that converts the indicia 24 to some useful form (such as a standard URL for a website).
  • the form can be a symbol or character that classifies the device (e.g., as belonging to a class of related products as described below), or the decoded QR code can direct the smartphone 20 to the URL of a web-based table via the smartphone's browser to do look-up operations regarding related products.
  • the camera 28 in a smartphone 20 equipped with the app 40 having an integrated indicia reader can scan the image of the QR code or other indicia 24 on an item 22 to display text (e.g., contact infonnation or instructions via a GUI screen 30), or connect to a wireless network (e.g., to a HCP repository), or open a web page in the smartphone's browser.
  • the app 40 can also generate GUI screens or other alerts when medical devices or products 22 appear to be mismatched as illustrated in Fig. 7F.
  • the medical event image capture app 40 can be programmed to detect an alphanumeric indicia 24 (e.g.,“U-500”) in the captured image of an insulin vial and syringe held in front of the camera 28.
  • the app 40 can be programmed to then consult locally stored or remotely accessed information comprising codes or indicia that correspond to respective families of medical produc ts that are compatible when used together for injection of accurate doses (e.g., different sizes of syringes and corresponding types of insulin) such that the app 40 can confirm whether or not the user is using compatible devices from the same family medical devices for effective or accurate dosing.
  • accurate doses e.g., different sizes of syringes and corresponding types of insulin
  • a diabetes care insulin and/or injection supplies manufacturer generally provides indicia (e.g., Stock Keeping Unit (SKU) numbers or other product identifying indicia) on their respective products (e.g., syringes, insulin pens, needle assemblies, insulin vials and cartridges, injection safety products, and the like).
  • indicia e.g., Stock Keeping Unit (SKU) numbers or other product identifying indicia
  • SKU Stock Keeping Unit
  • manufacturers and other injection supplies companies can generate a table of compatible injection products wherein product codes of selected products are linked to a product family that is useful to deliver an injection, and the product family is given a selected code (e.g., alphanumeric nomenclature or other indicia that is machine-readable such as a QR code 24 as shown in Fig. 3B).
  • a selected code e.g., alphanumeric nomenclature or other indicia that is machine-readable such as a QR code 24 as shown in Fig. 3B.
  • the captured image can include image pixels representing items 22 in Fig. 3 A, that is, a vial and a syringe, for example. It is to be understood the images of respective items 22 in Fig. 3 A being used for an injection can be captured separately, although this is less convenient to the user, and/or can be processed separately via the medical event image capture app 40 to identify indicia 24 or other event information such as dose capture or presence of bubbles as described below.
  • the processor 26 can be controlled by the app 40 to process the image pixels representing the captured image items 22 using a 2D and/or 3D image analysis algorithm that is configured to identify one or more indicia 24 on the items 22 such as a product code and/or a product family code per item 22. Once the indicia 24 are parsed from the image pixel data, the indicia 24 are decoded or otherwise identified.
  • a U40 syringe 22 is shown with an example of a QR code 24 that could be put on as a part of the manufacturing process.
  • the QR code reads: 0.3ml xl2.7mm U40.
  • the app 40 recognizes the device 22 and confirms that a correct device 22 is being used, or warns the user if that is not the case. For instance, using a U40 syringe with a UlOO or U500 insulin would result in incorrect dosage of insulin delivered.
  • the indicia 24 can be a particular color on a label, or an alphanumeric product name (e.g., U-500), a product code (e.g., the QR code 24 on the syringe 22 in Fig. 3B), or a product family (i.e., with or without a product code) that is identified in a QR code or other machine-readable code, or a combination of indicia.
  • the product family code can be, for example, a single character or multiple characters, and the characters can be alphanumeric characters or symbols or other indicia.
  • a table of compatible injection products can comprise product families“A,... ,N” and can be locally or remotely stored with respect to the device 20.
  • processor 26 determines that the items 22 are compatible and optimized to give an accurate dose. On the other hand, if processor 26 identifies two or more different product family codes (e.g., a QR code on a vial indicating a product family“A” and a QR code on a syringe indicating a product family“B”), in the image(s) of the captured items 22, then the processor 26 can be operated via the medical event image capture app 40 to generate an alert to the user.
  • product family codes e.g., a QR code on a vial indicating a product family“A” and a QR code on a syringe indicating a product family“B”
  • the processor 26 can generate a GUI screen displayed on the touchscreen 30 that advises the user of the detected item’s 22 incompatibility and optionally recommends a different size syringe from product family“A,” in lieu of the image captured family“B” syringe, for use with the detected vial from family“A”.
  • a BD AutoShield Pen Needle 22 is depicted with an example of a QR code 24 that could be used to help drive better usage methodology.
  • the QR code 24 reads“Best Injection Practices” and triggers a feature within the medical event image capture app 40 to playback local content, or takes the user to a website via the smartphone 20 browser, that demonstrates good injection practice.
  • Similar QR codes can also be used to enable patient education on other medical condition management topics.
  • Example product families in locally or remotely stored tables or other data memory structures accessed via the app 40 can also be defined depending on healthcare setting, that is, a clinical setting wherein a healthcare provider (HCP) delivers an injection to a patient, or a home health setting wherein a patient self-injects or has a home health caretaker or family member deliver the injection to the patient.
  • HCP healthcare provider
  • the medical event image capture app 40 can optionally be configured to generate an alert to a HCP when the captured image of an injection product lacks a selected product family code 24 designated for injection safety products.
  • the alert can be a reminder to a HCP to use an injection safety product (e.g., BD AutoShield Pen Needle or a BD SafetyGlide 6mm insulin syringe) that are designed to help prevent inadvertent needlestick inj ury during injections that can occur in clinical settings.
  • an injection safety product e.g., BD AutoShield Pen Needle or a BD SafetyGlide 6mm insulin syringe
  • the image captured items 22 can be insulin pen injection supplies, versus syringe injection supplies, such as a pen needle 22 with indicia 24 as depicted in Fig. 3D, or a package 22 of pen needles of a selected size and indicia 24 on the package 22 as depicted in Fig. 3E.
  • QR codes 24 on pen injectors 22 can also be leveraged to look at the treatment as a composite of injector and pen needles instead of in isolation of each other.
  • the processor 26 can be programmed in accordance with the medical event image capture app 40 to capture an image of the item 22 and process the image to determine the type of product based on the code 24 and/or color and alphanumeric information on the product label, or based on other physical characteristics of the image captured item 22.
  • the processor 26 can perform a look up operation in a local or remote table of compatible injection products and alert the user (e.g., via a GUI screen on the touchscreen 30) when the product and/or product family code 24 is not compatible wi th the type of injection pen or its insulin, which can be identified in a settings profile in the app 40.
  • the processor 26 can control the smartphone 20 to navigate to a particular URL identified with respect to the item code 24 (e.g., encoded in the QR code 24) to show a video or website of information to better educate the user about optimal injection technique or product 22 usage.
  • the medical event image capture app 40 is configured to process captured images to determine amount of medication to be delivered.
  • dose measurement, dose confirmation and tracking can be a challenge that can be alleviated by functions of the medical event image capture app 40.
  • the app 40 can also be used to ensure that the patient is drawing up the correct dose, particularly in the case of the syringe but also in the case of injection pens.
  • dose confirmation the combination of app 40 fimctions that determine correct device and correct dosage is expected to drive improved compliance to therapy, reduced likelihood of medication errors, and better outcomes for the patient.
  • the item 22 being used for an injection can be placed within the view range 42 of the camera 28.
  • An image is captured that comprises pixels that represent an injection level or delivered amount indicia.
  • the medical event image capture app 40 can be provided with a 2D and/or 3D image processing algorithm configured to discern, for example, a syringe plunger location 44 (Fig. 4B) that corresponds to a drawn amount (i.e., amount to be injected via the syringe 22), or an injection pen dial indicia 44 (Fig. 4A) that corresponds to a dialed amount of medication to be delivered via the injection pen.
  • the medical event image capture app 40 with camera image processing in accordance with illustrative embodiments allows auto dose capture and confirmation of correct dose without requiring a wireless exchange between the device(s) 22 and tiie smartphone 20 and, accordingly, without adding complexity and cost to the injection device(s) 22 such as a pen.
  • the medical event image capture app 40 is configured to process captured images to determine if the device 22 or drug is defective.
  • the app 40 can be used to ensure that the patient is drawing up the correct dose by identifying presence of bubbles and informing the patient of the same.
  • Proper aspiration of a dose of medication into a syringe 22 is a critical step that involves the visual detection of any bubbles in tiie syringe barrel, followed by elimination of the bubbles from the syringe barrel.
  • the app 40 advantageously incorporates an image recognition function wherein it can both detect and quantify the volume of air bubbles in a syringe via captured image processing.
  • this processing can be done with 3D image analysis or a typical 2D project surface area image analysis that is traditionally used in counting features in a variety of scientific fields.
  • a 2D image analysis algorithm can be used to quantify the bubble size as well.
  • the app 40 can generate an alert to advise the user that air bubbles can be detected and need to be removed from the syringe barrel prior to delivery.
  • the alert can be visual or audible which is particularly helpful to visually impaired users.
  • FIG. 5 An example is shown in Fig. 5 wherein the projected 2D image/photograph of a syringe 22 with the air bubbles 46 is obtained via the image capture operation of the app 40, and is analyzed by app image processing and analysis software to recognize the shape and size (and hence volume) of the bubbles 46 using the projected surface area in the 2D image.
  • image processing can have multiple utilities, such as monitoring the effectiveness of patient use method, providing better teaching or training tools, and potentially even tracking accuracy of dose drawn.
  • the medical event image capture app 40 can also employ captured image processing algorithms that detect other attributes of the item 22 such as determining if particulates 48 are in the medication or the medication is opaque and not sufficiently clear (e.g., signifying that the medication has expired or is contaminated), or if a medical device 22 is missing a safety cap or has a bent or broken needle, among other undesirable attributes.
  • the app 40 can generate an al ert to advise the user that an undesirable attribute of the device 22 or medication has been detected to allow the user an opportunity to resolve the issue before an incorrect dose is delivered.
  • This third application of the medical event image capture app 40 is particularly beneficial in clinical settings.
  • the smartphone 20 with app 40 can detect visible contamination (e.g., a pen with expired medication indicated as cloudy or having floating particles).
  • the captured image processing algorithm of the app 40 can be configured to detect opaqueness of the medication, for example, or whether a device is leaking.
  • the captured image processing algorithm can also be configured to determine from a captured image of an injection item 22 whether it is missing a safety feature such as a sterilization cap or other needle stick prevention device and generate an alert to the HCP.
  • a safety feature such as a sterilization cap or other needle stick prevention device
  • the app 40 can detect devices and other supplies used for an injection event for which an image(s) is capture and processed.
  • the processor 26 programmed via the app 40 can advise personal and clinical setting personnel regarding supply levels based on quantity of captured images of used supplies 22 to assist with auto-reordering of supplies.
  • many clinical settings provide HCPs with iPhones or mobile devices for alerts and messaging on when to come to the bedside of a pati ent.
  • the app 40 can be provided to the HCP devices 20 to allow 7 them to capture an image of a medical condition management event and, though processing of the image, gather informatics that assist with auto recording injection data into patients’ electronic records, as well as assist clinical setting administration records regarding billing, inventory management and reordering and care plan compliance and clinical effectiveness.
  • Example image processing algorithms for processing captured images in accordance with illustrative embodiments include, but are not limited to, any of the following image processing and/or image analysis algorithms: image segmentation (e.g., for identification of correct location of boundaries); image representation (e.g., for articulation of an image in the form of pixel maps); detection and recognition (e.g., for recognition of prequantified features); motion estimation (e.g., when using dynamic images); tracking (e.g., for tracking of features that have been identified during detection step(s) of illustrative embodiments); surface and shape estimation (e.g., for bubble detection and volume quantification in accordance with illustrative embodiments); enhancement (e.g., for contrast stretching, noise filtering, histogram modification); restoration (e.g., for editing boundaries, aligning contrast, compensating for exposure); analysis (e.g., for identifying, categorizing, and/or counting features); reconstruction; and data compression.
  • Example platforms that support these example image processing and/or image analysis algorithms include
  • Fig. 6 is a flow chart of example operations of the medical event image capture app 40 in accordance with an illustrated embodiment. It is understood that the app 40 can be provided with all three applications (i.e., (1) correct or compatible device, (2) dose confirmation, and (3) medical de vice 22 and/or drug malfunction) or any two of these three applications, or only one of these applications.
  • a user uses a smartphone 20 camera 28 function to take an image of devices 22 used to implement a medical management event such as an injection (block 50).
  • the app 40’s captured image processing operation determines indicia 24 or, optionally, other attributes of the device(s) 22 (blocks 52 and 54).
  • the app 40 is configured to control the processor 26 to determine related device information (e.g., table or other data structure stored in a local or remote computer memory device) such as whether medical devices 22 detected in the captured image belong to the same product family or are otherwise compatible, or indicate an amount to be delivered, or indicate a malfunction (block 56). If devices 22 in a captured image are not compatible (e.g., part of different product families as described above), the processor 26 will generate alerts or GUI screens to advise the user of potential incorrect dose due to device 22 incompatibility with drug or other user error in drawing medication or misuse of a medical device 22 (block 60).
  • the indicia 24 detected by the app 40’s image processing function can also determine if a QR code or other indicia indicates that the user should receive playback of educational information, as described above (blocks 62 and 64).
  • the processor 26 is controlled by the medical event image capture app 40 to determine if the correct dose amount has been draw n and, if not, to generate alerts or GUI screens to the user (block 66 and 68). If the processor 26 detects a device or drug failure, for example, as described in connection with Fig. 5, the processor 26 will generate alerts or GUI screens to advise the user of the problem (blocks 70 and 72).
  • the medical event data or infonnatics can be stored locally or remotely for access and use by the patient and/or other medical condition management stakeholders (block 76).
  • the medical event data or informatics can be automatically uploaded to a repository for inclusion in a patient’s electronic record, for medical billing, for auto-replenishment of medical supplies 22, and/or care plan compliance tracking, among other uses such as incorporation into an integrated disease management system as described below in connection with Fig. 10.
  • the app 40 can optionally be used with an injection site rotation algorithm as described in commonly owned U.S. Patent No. 10,173,015 (block 78).
  • the injection site rotation algorithm can recommend the next body site injection location, and the injection app 40 can capture an image of an injection event and confirm delivered amount to record the injection.
  • the injection site rotation algorithm can also record the body site injection.
  • Figs. 7 A, 7B, 7C, 7D, 7E, 7F, 7G and 7H are example GUI screens generated on a device 20 by the medical event image capture app 40 to guide the user to draw a correct dose amount (e.g., with a syringe) and to take an image of a QR code or other indicia 24 on the syringe 22, as depicted in Fig. 7A.
  • the captured image is shown in the screen 92 in Fig. 7B.
  • a user is alerted to the presence of detected air bubbles in the screen 94 in Fig. 7C, which were determined using an image processing algorithm on the captured image. After bubbles are eliminated and a correct medication amount is drawn (Fig.
  • Figs. 7F and 7H are confirmation of delivery screens.
  • Figs. 8A, 8B, 8C, 8D and 8E illustrate example GUI screens generated on a device 20 by the app 40 to guide the user in drawing a dose (e.g., with a syringe) wherein no air bubbles are detected, unlike in screens of Figs. 7B through 7D.
  • the app 40 is also useful to log information from other medical devices such as monitors (e.g., blood glucose monitor (BGM), pulse oximeter, thermometer, blood pressure monitor, among others that may not have a wireless communication interface).
  • monitors e.g., blood glucose monitor (BGM), pulse oximeter, thermometer, blood pressure monitor, among others that may not have a wireless communication interface.
  • FIG. 9A, 9B and 9C illustrate example GUI screens generated on a device 20 by the app 40 to capture information 24 from a display of a BGM 22 using photo capture as described herein.
  • Fig. 9A shows a device (e.g., smartphone 20) that captures informatics 24 from the display of a BGM 22 within an image range 42 of the smartphone camera 28.
  • the camera image of the informatics 24 e.g., a glucose reading of 206 mg/dL at 10:43am is indicated at 25 in Fig. 9B.
  • the app 40 logs the information from the camera image into memory on the smartphone 20 and displays it for the user on the smartphone screen 30.
  • Such passive informatics capture and logging using the app 40 makes devices such as monitors that have no wireless communication interface more versatile and cost effective for some users who do not have affordable access to, for example, a continuous glucose monitoring system that logs glucose readings automatically and wirelessly to another device.
  • the app 40 provides these users with an affordable solution to address known challenges they face with blood glucose tracking and transcription errors by providing an option to electronically log data from their monitor screens that reduces the potential for human error.
  • Illustrative embodiments disclose multiple ways of better engaging with the user and leveraging the strengths from both the injection products 22 and the medical event image capture app 40 to enhance user experience.
  • the app 40 is used to both identify specific features and activities, confirm they are as intended, provide confirmation to the user and also enable logging and tracking of information for posterity.
  • the integrated usage of the device(s) 22 and the app 40 are expected to drive better compliance and improved patient outcomes.
  • the combination of correct device 22 detection aid the monitoring and logging of the delivered dose information is expected to provide more accurate data to enable better clinical decision making and reduce potential for medication errors.
  • the app 40 (and device 22 combination functionality) can just as easily be leveraged in other settings (e.g., institutional and alterate sites) and also by caregivers (e.g., nurses, family members, etc.).
  • caregivers e.g., nurses, family members, etc.
  • a diabetes care company can provide a Digital Health (DH) app such as the BD Diabetes Care app, available from Becton Dickinson and Company, that allows patients to maintain improved control on their diabetes treatment regimen.
  • DH Digital Health
  • the BD Diabetes Care app assists patients and/or their caregivers with recording injections, recording blood glucose values or glucose monitoring, recording carbohydrates intake, and logging exercise, all of which impact the patient’s injected insulin needs.
  • the medical event image capture app 40 can also be integrated into a digital health app (e.g., BD Diabetes Care app).
  • a digital health app e.g., BD Diabetes Care app
  • the medical event image capture app 40 and its generated infonnatics can be automatically combined with other digital health app content such as logs of injections, exercise, carbohydrates intake and blood glucose readings to assist the patient and disease management stakeholders in tracking a patient’s compliance with a prescribed disease management regime (e.g., how well the patient is maintaining target blood glucose levels), reordering supplies (e.g., home health supplies such as selfinjection devices and medication, and pharmacy inventory) and auto-shipping of prescribed medications and medical supplies to patients or commercial settings, inventory tracking, billing for medical events captured within clinical settings, and the like.
  • a prescribed disease management regime e.g., how well the patient is maintaining target blood glucose levels
  • reordering supplies e.g., home health supplies such as selfinjection devices and medication, and pharmacy inventory
  • auto-shipping of prescribed medications and medical supplies
  • illustrated embodiments herein provide convenience and other advantages to different categories of users (e.g., self-injection, and caregiver administered injections) in different categories of settings (e.g., in-home setting or other alternate site such as nursing home, long-tenn care facility and rehabilitation facility, as well as clinical/hospital setting).
  • categories of users e.g., self-injection, and caregiver administered injections
  • settings e.g., in-home setting or other alternate site such as nursing home, long-tenn care facility and rehabilitation facility, as well as clinical/hospital setting.
  • the medical event image capture app 40 can be a standalone app that communicates with the user (e.g., patient) or other stakeholders on the user’s medical condition management team such as caregivers (e.g., parents, spouses, school nurses), health care providers, clinical setting administrators, pharmacies, payers (e.g., insurance companies) and medical device suppliers and distributors.
  • caregivers e.g., parents, spouses, school nurses
  • health care providers e.g., health care providers
  • clinical setting administrators e.g., pharmacies, payers (e.g., insurance companies)
  • medical device suppliers and distributors e.g., insurance companies
  • the medical event image capture app 40 can also be integrated into an integrated disease management (IDM) system 150 as shown in Fig. 10 in accordance with an illustrative embodiment.
  • IDM integrated disease management
  • the IDM system 150 is understood to be useful to manage other types of diseases involving collection, analysis and dissemination of information to assist disease stakeholders (e.g., patients, care givers, health care providers, disease management companies, pharmacies, disease management-related product suppliers, insurers and other payers) in management of one or more diseases.
  • the IDM system 150 can be used by many types of people, including, but not limited to, diabetic patients, non-diabetic persons, caregivers, and healthcare professionals or healthcare entities such as disease management companies, pharmacies, disease management-related product suppliers, insurers and other payers.
  • the IDM system 150 can include an interactive interface that is simple, engaging, and that provides a scalable means for users to seek information and support when needed so that they feel more in control of their condition.
  • the IDM system 150 can also comprise or have access to a user database and a content database (not shown). For example, healthcare professionals or related
  • the IDM system 150 is configured to transmit data securely (e.g., encrypted) to a remote server such as a cloud storage server, to perform analysis of received data (e.g., disease management data), to provide feedback to the user (e.g., customized feedback with curated content based on a user ' s data and interface interactions), and send all or a portion of the data and/or curated content to another user device or remote health management access point (e.g., as cloud storage) where the information can be accessed by healthcare stakeholders, such as the patient's physician or other HCP, family member or other caregiver, pharmacist, disease management company, medical supplier or payer. Conversely, alerts, reminders, and interventions can be provided to the user by the user's network, e.g. an
  • User access to the IDM system 150 is via a user device 20 with interactive interface that can be accessible via a web browser or a software application (such as an app for a smartphone or a computer application, for example).
  • the user device 20 can be, but is not limited to, a smartphone, smart watch, tablet, laptop, computer, personal digital assistant (“PDA”), and the like.
  • the user device 20 is a mobile device, such as any mobile device known in the art, including, but not limited to, a smartphone, a tablet computer, or any telecommunication device with computing ability, a mobile device connection module, and preferably an adaptable user interface such as, but not limited to a touchscreen.
  • a user typically uses such a mobile device for various functions such as sending and receiving phone calls, sending and receiving text messages, and/or browsing the internet.
  • the user device 20 communicates with the IDM system via a wireless network and/or a wired network.
  • the IDM system operates in conjunction with an IDM personal app 140 installed on a user device 20 operated by a patient and an IDM professional app downloaded or otherwise installed on a user device 20 operated by professionals such as a clinician 124, a pharmacist 126, a payer 130 and a pharmaceutical company 132.
  • the IDM apps can be operated in a cloud-dependent configuration whereby the mobile device with app transfers data to and receives data from a cloud (e.g., the IDM system) during an app session, for example, or periodically or continuously in the background, or can be operated in a distributed configuration whereby the app functions in a standalone mode and then connects as needed to selectively to the cloud (e.g., the IDM system).
  • a cloud e.g., the IDM system
  • the IDM personal app 140 can show as a single icon on a patient’s device(s) 20.
  • the IDM personal app 140 provides an interface to the IDM system for a patient or a patient’s caregiver for such functions and experiences as viewing dose data, texting with a clinician, adding meal data to the patient’s stored data, importing BG data, and so on.
  • the IDM personal app 140 can incorporate the operations of the medical event image capture app 40 to obtain and store informatics from captured images such as dose amount, event date/time stamps associated with the captured images, products 22 identified via captured images, among other data.
  • the IDM professional app provides an interface to the IDM system for other users such as a clinician 124, pharmacist 126, payer 130,
  • the IDM personal (patient, caregiver) software 140 can comprise one or more apps, for example.
  • the IDM professional (clinicians, pharmacists, etc.) software can be web-based for different user types and provides a separate experience for the patient’s care team providers, payers and pharmacists).
  • the IDM professional app can be programmed to bring in data from patients’ IDM personal apps 140.
  • the user device 20 can be connected to other devices (e.g., via BluetoothTM) such as one or more medication delivery devices (MDDs) 22 (e.g., an insulin injector 22 and/or or a pump indicated at 120), and other devices such as glucose or lifestyle monitoring devices indicated generally at 122.
  • MDDs medication delivery devices
  • the other devices can include, but are not limited to, one or more of a carbohydrate input device or app running on a user's cellphone that allows the patient to input food and drink consumed, a device or related app having an oral medication input element that permits a user to track oral medications ingested, a BGM and/or CGM, and a device or app for inputting wellness data such as user activity level.
  • the IDM personal app 140 once downloaded, allows the user to selectively activate additional functionality such as that associated with respective smart devices such as MDD(s) (e.g., an injection pen 22 app, pump 120 app or other dose capture app).
  • MDD(s) e.g., an injection pen 22 app, pump 120 app or other dose capture app.
  • An MDD app can provide device connectivity and data offload functions, and dose data storage and access functions, dose data to cloud transfer functionality, user profile creation and authentication functionality, connected third party experiences (e.g., interaction between the user and a third party such as a vendor for BG data tracking), and output and analysis of dose data and BGM data.
  • some device data can be sent to the user device 20 with IDM personal app 140 for storage on private cloud, whereas other data (e.g., non-proprietary or unregulated medical device data from devices) can be transmitted to a public cloud 136 by the devices or their vendor 138 for access by the user devices 20.
  • data e.g., non-proprietary or unregulated medical device data from devices
  • the IDM professional app can be selectively configured with different functionality by different stakeholders to include, for example, a patient population management sub-app, and a patient outcomes sub-app, and a data and communication protocols application programming interface (API) to enable transmission of data between users and systems.
  • API application programming interface
  • Some examples are a proprietary cloud or“closed API” that allows users to create accounts and gain direct access to data and functionality through app views, a commercial cloud or“open API” wherein data is passed to another entity (e.g. Glooko) to facilitate use by the end-user (e.g., via an open API), or a hybrid model that simultaneously offers both of the above open and closed API options to utilize proprietary data generated from devices with closed APIs as well as data from devices with open APIs.
  • one or more of the devices 22, 120 and 122 are connected devices that can communicate data (e.g., delivered amounts of medication and blood glucose readings) directly to the IDM system.
  • data e.g., delivered amounts of medication and blood glucose readings
  • MDD connected medication delivery device
  • the IDM system and connected devices e.g., MDDs 12, 120 and other devices 122
  • PWD people with diabetes
  • their care network e.g., health care provider(s), caregiver(s), pharmacist and insurance company
  • This IDM solution transforms data to bring enhanced end user experiences for improved outcomes.
  • This IDM solution can be implemented as a coll ection of products that broadly address needs associated with a specific medical condition such as diabetes, although the IDM solution can be configured to manage different medical conditions.
  • the products can be hardware and/or software that deliver value to a defined group of people such as patients or caregivers, or professional disease management personnel such as health care provider, pharmacist and insurance company.
  • the software products described herein e.g., phone apps or computer applications
  • connection means broadly and encompass direct and indirect connections, couplings, and mountings.
  • connection and variations thereof are not restricted to physical or mechanical connections or couplings.
  • terms such as up, down, bottom, and top are relative, and are employed to aid illustration, but are not limiting.
  • the components of the illustrative devices, systems and methods employed in accordance with the illustrated embodiments can be implemented, at least in part, in digital electronic circuitry, analog electronic circuitry, or in computer hardware, firmware, software, or in combinations of them. These components can be implem ented, for example, as a computer program product such as a computer program, program code or computer instructions tangibly embodied in an information carrier, or in a machine-readable storage device, for execution by, or to control the operation of, data processing apparatus such as a programmable processor, a computer, or multiple computers.
  • a computer program product such as a computer program, program code or computer instructions tangibly embodied in an information carrier, or in a machine-readable storage device, for execution by, or to control the operation of, data processing apparatus such as a programmable processor, a computer, or multiple computers.
  • a computer program can be written in any form of programming language, including compiled or interpreted languages, and it can be deployed in any form, including as a stand-alone program or as a module, component, subroutine, or other unit suitable for use in a computing environment.
  • a computer program can be deployed to be executed on one computer or on multiple computers at one site or distributed across multiple sites and interconnected by a communication network.
  • functional programs, codes, and code segments for accomplishing the illustrative embodiments can be easily construed as within the scope of claims exemplified by the illustrati ve embodiments by programmers skilled in the art to which the illustrative embodiments pertain.
  • Method steps associated with the illustrative embodiments can be performed by one or more programmable processors executing a computer program, code or instructions to perform functions (e.g., by operating on input data and/or generating an output). Method steps can also be performed by, and apparatus of the illustrative embodiments can be implemented as, special purpose logic circuitry, e.g., an FPGA (field programmable gate array) or an ASIC (application-specific integrated circuit), for example.
  • FPGA field programmable gate array
  • ASIC application-specific integrated circuit
  • DSP digital signal processor
  • a general- purpose processor may be a microprocessor, but in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine.
  • a processor may also be implemented as a combination of computing devices, e.g., a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such configuration.
  • processors suitable for the execution of a computer program include, by way of example, both general and special purpose microprocessors, and any one or more processors of any kind of digital computer.
  • a processor will receive instructions and data from a read-only memory or a random access memory or both.
  • the essential elements of a computer are a processor for executing instructions and one or more memory- devices for storing instructions and data.
  • a computer will also include, or be operatively coupled to receive data from or transfer data to, or both, one or more mass storage devices for storing data, e.g., magnetic, magneto-optical disks, or optical disks.
  • Information carriers suitable for embodying computer program instructions and data include all forms of non-volatile memory, including by way of example, semiconductor memory devices, e.g., electrically programmable read-only memory or ROM (EPROM), electrically erasable programmable ROM (EEPROM), flash memory devices, and data storage disks (e.g., magnetic disks, internal hard disks, or removable disks, magneto-optical disks, and CD-ROM and DVD-ROM disks).
  • semiconductor memory devices e.g., electrically programmable read-only memory or ROM (EPROM), electrically erasable programmable ROM (EEPROM), flash memory devices, and data storage disks (e.g., magnetic disks, internal hard disks, or removable disks, magneto-optical disks, and CD-ROM and DVD-ROM disks).
  • EPROM electrically programmable read-only memory
  • EEPROM electrically erasable programmable ROM
  • flash memory devices e.g., electrically erasable
  • a software module may reside in random access memory (RAM), flash memory, ROM, EPROM, EEPROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
  • An exemplary storage medium is coupled to the processor such the processor can read information from, and write information to, the storage medium.
  • the storage medium may be integral to the processor.
  • the processor and the storage medium may reside in an integrated circuit or be implemented as discrete components.
  • Computer-readable non-transitory media includes all types of computer readable media, including magnetic storage media, optical storage media, flash media and solid state storage media.
  • software can be installed in and sold with a central processing imit (CPU) device.
  • the software can be obtained and loaded into the CPU device, including obtaining the software through physical medium or distribution system, including, for example, from a server owned by the software creator or from a server not owned but used by the software creator.
  • the software can be stored on a server for distribution over the Internet, for example.

Landscapes

  • Health & Medical Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Physics & Mathematics (AREA)
  • Medical Informatics (AREA)
  • Biomedical Technology (AREA)
  • Animal Behavior & Ethology (AREA)
  • Veterinary Medicine (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Surgery (AREA)
  • Molecular Biology (AREA)
  • Pathology (AREA)
  • Biophysics (AREA)
  • Primary Health Care (AREA)
  • Epidemiology (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Physiology (AREA)
  • Theoretical Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Vascular Medicine (AREA)
  • Optics & Photonics (AREA)
  • General Business, Economics & Management (AREA)
  • Chemical & Material Sciences (AREA)
  • Medicinal Chemistry (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Cardiology (AREA)
  • Radiology & Medical Imaging (AREA)
  • Hematology (AREA)
  • Emergency Medicine (AREA)
  • Anesthesiology (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Psychiatry (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Signal Processing (AREA)
  • Gerontology & Geriatric Medicine (AREA)
  • Computer Vision & Pattern Recognition (AREA)
PCT/US2020/034815 2019-05-31 2020-05-28 Systems, apparatuses and methods for capturing images of medical condition management events and related equipment with smartphone and related app that processes images to reduce medical errors Ceased WO2020243230A1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CA3138313A CA3138313A1 (en) 2019-05-31 2020-05-28 Systems, apparatuses and methods for capturing images of medical condition management events and related equipment with smartphone and related app that processes images to reduce medical errors
JP2021570827A JP7750746B2 (ja) 2019-05-31 2020-05-28 医学的状態管理イベントの画像をキャプチャするためのシステム、装置、および方法、ならびにスマートフォンおよび医療ミスを減少させるために画像を処理する関連アプリを備えた関連機器
EP20814147.3A EP3977403A4 (en) 2019-05-31 2020-05-28 Systems, apparatuses and methods for capturing images of medical condition management events and related equipment with smartphone and related app that processes images to reduce medical errors

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201962855531P 2019-05-31 2019-05-31
US62/855,531 2019-05-31
US16/883,611 2020-05-26
US16/883,611 US11749393B2 (en) 2019-05-31 2020-05-26 Systems, apparatuses and methods for capturing images of medical condition management events and related equipment with smartphone and related app that processes images to reduce medical errors

Publications (1)

Publication Number Publication Date
WO2020243230A1 true WO2020243230A1 (en) 2020-12-03

Family

ID=73507125

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2020/034815 Ceased WO2020243230A1 (en) 2019-05-31 2020-05-28 Systems, apparatuses and methods for capturing images of medical condition management events and related equipment with smartphone and related app that processes images to reduce medical errors

Country Status (6)

Country Link
US (1) US11749393B2 (https=)
EP (1) EP3977403A4 (https=)
JP (1) JP7750746B2 (https=)
CN (1) CN112017746B (https=)
CA (1) CA3138313A1 (https=)
WO (1) WO2020243230A1 (https=)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021260009A1 (en) * 2020-06-25 2021-12-30 Sanofi Drug delivery device recognition
JP2025094175A (ja) * 2021-03-01 2025-06-24 デカ・プロダクツ・リミテッド・パートナーシップ 送達装置、システム、および方法

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA3183737A1 (en) * 2020-05-19 2021-11-25 Bayer Healthcare Llc System, method, and computer program product for providing quick response (qr) codes for injection systems
US11886950B2 (en) * 2020-08-03 2024-01-30 Healthcare Integrated Technologies Inc. System and method for assessing and verifying the validity of a transaction
WO2022204090A1 (en) * 2021-03-23 2022-09-29 Cell Signaling Technology, Inc. Quick response (qr) code system
US20250242111A1 (en) * 2021-09-09 2025-07-31 Brighter Sight Inc. Method for providing information on dosage of medication for administration using a syringe
CN115205249A (zh) * 2022-07-14 2022-10-18 中国人民解放军空军军医大学 用于胰岛素的漏液检测方法、设备及介质
GB2623937A (en) * 2022-08-24 2024-05-08 Pa Knowledge Ltd System and method
US12491319B2 (en) 2022-09-01 2025-12-09 Retractable Technologies, Inc. Universal dosage verification system and method for medical syringe
US12458761B2 (en) * 2022-09-01 2025-11-04 Retractable Technologies, Inc. Dosage verification system and method for safety syringe
WO2024097579A1 (en) 2022-10-31 2024-05-10 Hill-Rom Services, Inc. Patient support apparatus having a user interface

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120241525A1 (en) * 2011-03-22 2012-09-27 Gregory Borges Displaying a barcode on a display of an infusion pump
US20130110537A1 (en) * 2012-01-19 2013-05-02 Douglas K. Smith Cloud-based Medical Imaging Viewer and Methods for Establishing A Cloud-based Medical Consultation Session
US20130153662A1 (en) * 2011-12-19 2013-06-20 MindTree Limited Barcode Photo-image Processing System
US20150126963A1 (en) * 2013-11-01 2015-05-07 Becton, Dickinson And Company Injection device configured to mate with a mobile device
US20160012205A1 (en) * 2014-07-10 2016-01-14 Companion Medical, Inc. Medicine administering system including injection pen and companion device
US20160324727A1 (en) * 2015-05-06 2016-11-10 Aceage Inc. Medication administration apparatus
US20170056603A1 (en) * 2015-08-28 2017-03-02 Bayer Healthcare Llc System and Method for Syringe Fluid Fill Verification and Image Recognition of Power Injector System Features

Family Cites Families (39)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5902982A (en) 1997-04-04 1999-05-11 National Medical Review Office Inc. Changeable machine readable assaying indicia
US7617132B2 (en) * 2002-11-21 2009-11-10 Kimberly-Clark Worldwide, Inc. RFID system and method for ensuring food safety
CA2625359A1 (en) 2005-10-11 2007-04-19 Blake Podaima Smart medical compliance method and system
US20090198733A1 (en) * 2008-02-01 2009-08-06 Microsoft Corporation Healthcare resource locator
US7918821B2 (en) * 2009-05-05 2011-04-05 Mahurkar Sakharam D Universal safety syringe
US8884752B2 (en) * 2009-05-11 2014-11-11 Tai And Tseng Investments Llc Medication usage monitoring and reminding device and method
US20110082711A1 (en) * 2009-10-06 2011-04-07 Masimo Laboratories, Inc. Personal digital assistant or organizer for monitoring glucose levels
US8818821B2 (en) 2010-01-29 2014-08-26 Medarchiver S.R.L. Digital assistant appliance for assisting an operator in the manual preparation of a liquid pharmaceutical composition in a medical instrument for administering the composition to a patient, and corresponding operating method
BR112013003376A2 (pt) 2010-08-13 2016-07-12 Sanofi Aventis Deutschland sistema de codificação para um dispositivo de administração de fármaco e sistema de administração de fármaco
US20140330579A1 (en) * 2011-03-31 2014-11-06 Healthspot, Inc. Medical Kiosk and Method of Use
DE102012007217A1 (de) * 2012-04-11 2013-10-17 Torsten Schmale IT-Verfahren für den sicheren Umgang mit Sensitiven Daten im Kontext des Cloud Computings
US10157266B2 (en) * 2012-09-06 2018-12-18 Baxter International Inc. Patient information software system including infusion map
EP2962229B1 (en) * 2013-02-27 2021-10-13 Fresenius Vial SAS System and method for providing drug library data to a medical device located within a healthcare environment
US8591463B1 (en) * 2013-03-08 2013-11-26 Teva Pharmaceutical Industries Ltd. Re-useable injector device for syringe
US9317916B1 (en) * 2013-04-12 2016-04-19 Aic Innovations Group, Inc. Apparatus and method for recognition of medication administration indicator
US20150019234A1 (en) * 2013-07-11 2015-01-15 Michele I. Cooper Electronic medical processing, analysis, and storage system and methods thereof
WO2015029020A1 (en) 2013-08-26 2015-03-05 Equashield Medical Ltd. Method and apparatus for monitoring, documenting and assisting with the manual compounding of medications
WO2015062655A1 (en) 2013-10-31 2015-05-07 Rodiera Olive José Javier Device with cameras for monitoring the manual administration of medication
EP3100186B1 (en) * 2014-01-29 2021-05-12 Becton, Dickinson and Company System and method for collection confirmation and sample tracking at the clinical point of use
US20210110897A1 (en) * 2014-03-21 2021-04-15 Ehr Command Center, Llc Dynamic health records visual display system
US20220027629A1 (en) * 2014-05-15 2022-01-27 Fenwal, Inc. Determining characteristic of blood component with handheld camera
US10971260B2 (en) 2014-09-14 2021-04-06 Becton, Dickinson And Company System and method for capturing dose information
KR102245345B1 (ko) * 2014-09-29 2021-04-28 조게닉스 인터내셔널 리미티드 의약품 배포 제어를 위한 제어 시스템
NO2689315T3 (https=) 2014-10-28 2018-04-14
US10650267B2 (en) * 2015-01-20 2020-05-12 Canon Medical Systems Corporation Medical image processing apparatus
AU2016226530A1 (en) 2015-03-02 2017-09-21 Biogen Ma Inc. Drug delivery dose indicator
US11721414B2 (en) * 2015-03-12 2023-08-08 Walmart Apollo, Llc Importing structured prescription records from a prescription label on a medication package
US10058247B2 (en) * 2015-05-20 2018-08-28 Comprehensive Telemedicine Multipurpose diagnostic examination apparatus and system
US10528840B2 (en) * 2015-06-24 2020-01-07 Stryker Corporation Method and system for surgical instrumentation setup and user preferences
RU2018114992A (ru) * 2015-09-23 2019-10-23 Конинклейке Филипс Н.В. Интеллектуальный шприц: мониторинг информации о медицинском вмешательстве
US10643744B2 (en) * 2016-02-22 2020-05-05 West Pharmaceutical Services, Inc. Drug delivery device state recognition
WO2018156928A1 (en) * 2017-02-27 2018-08-30 Applied Logic, Inc. System and method for managing the use of surgical instruments
WO2018166710A1 (en) * 2017-03-15 2018-09-20 Novartis Ag System for use of a pharmaceutical product
US20180293357A1 (en) * 2017-04-10 2018-10-11 International Business Machines Corporation Pill collection visual recognition for automatic compliance to prescriptions
EP3612976A4 (en) * 2017-04-20 2021-01-06 Becton, Dickinson and Company APP FOR A SMARTPHONE FOR DOSE DETECTION AND PROCEDURE
US20190175104A1 (en) * 2017-12-10 2019-06-13 Bela Malik In-situ salivary component collection, concentration, isolation, analytics, and communication system
EP3750169A1 (en) * 2018-02-09 2020-12-16 Gambro Lundia AB Medical data collection devices, systems, and methods
EP3660856A1 (en) 2018-11-28 2020-06-03 Tecpharma Licensing AG Augmented reality for drug delivery devices
WO2020191156A1 (en) * 2019-03-19 2020-09-24 Deka Products Limited Partnership Medical treatment systems, methods, and apparatuses using a plurality of fluid lines

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120241525A1 (en) * 2011-03-22 2012-09-27 Gregory Borges Displaying a barcode on a display of an infusion pump
US20130153662A1 (en) * 2011-12-19 2013-06-20 MindTree Limited Barcode Photo-image Processing System
US20130110537A1 (en) * 2012-01-19 2013-05-02 Douglas K. Smith Cloud-based Medical Imaging Viewer and Methods for Establishing A Cloud-based Medical Consultation Session
US20150126963A1 (en) * 2013-11-01 2015-05-07 Becton, Dickinson And Company Injection device configured to mate with a mobile device
US20160012205A1 (en) * 2014-07-10 2016-01-14 Companion Medical, Inc. Medicine administering system including injection pen and companion device
US20160324727A1 (en) * 2015-05-06 2016-11-10 Aceage Inc. Medication administration apparatus
US20170056603A1 (en) * 2015-08-28 2017-03-02 Bayer Healthcare Llc System and Method for Syringe Fluid Fill Verification and Image Recognition of Power Injector System Features

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3977403A4 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021260009A1 (en) * 2020-06-25 2021-12-30 Sanofi Drug delivery device recognition
JP2025094175A (ja) * 2021-03-01 2025-06-24 デカ・プロダクツ・リミテッド・パートナーシップ 送達装置、システム、および方法
JP7839921B2 (ja) 2021-03-01 2026-04-02 デカ・プロダクツ・リミテッド・パートナーシップ 送達装置、システム、および方法

Also Published As

Publication number Publication date
JP2022534975A (ja) 2022-08-04
US11749393B2 (en) 2023-09-05
CN112017746A (zh) 2020-12-01
US20200381106A1 (en) 2020-12-03
EP3977403A4 (en) 2023-10-25
JP7750746B2 (ja) 2025-10-07
CA3138313A1 (en) 2020-12-03
EP3977403A1 (en) 2022-04-06
CN112017746B (zh) 2025-05-27

Similar Documents

Publication Publication Date Title
US11749393B2 (en) Systems, apparatuses and methods for capturing images of medical condition management events and related equipment with smartphone and related app that processes images to reduce medical errors
US11200965B2 (en) Apparatus and method for recognition of medication administration indicator
JP5047335B2 (ja) 薬剤送達システム
US10910092B2 (en) Insulin pen smart administration and teaching device
JP6784653B2 (ja) 医薬品のラベル付け
JP6619735B2 (ja) データの転送用に構成された注入システム
US20120226447A1 (en) Smart medication waste disposal
US20160038674A1 (en) Infusion System Housing Medication Scanner And User Interface Device Displaying Delivery Data
Johnson et al. Remote patient monitoring in diabetes: how to acquire, manage, and use all of the data
RU2662853C2 (ru) Код для конфигурации устройства по уходу за больным
US20230166044A1 (en) Smart syringe with dose capture and app for smart phone
CN108564999B (zh) 病人护理设备专用的配置输出
JP2002083065A (ja) 医療用携帯型端末器及びこれを用いた医療支援システム
Shastay As U-500 insulin safety concerns mount, it's time to rethink safe use of strengths above u-100
JPWO2021222054A5 (https=)
CN120359574A (zh) 用于验证自动编程请求的设备、系统和方法
MacLeod et al. Educators: Go Mobile & Join the Digital Revolution!
JP2007026408A (ja) 携帯端末等を利用した薬の服用・使用及び疾病の予防・健康維持のための身体運動・習慣等の忘れ・誤り防止及び履歴記録システム
AU2015200504A1 (en) Analyte measurement and management device and associated methods

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20814147

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 3138313

Country of ref document: CA

ENP Entry into the national phase

Ref document number: 2021570827

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2020814147

Country of ref document: EP

Effective date: 20220103