US20210353871A1 - Monitoring system and method - Google Patents
Monitoring system and method Download PDFInfo
- Publication number
- US20210353871A1 US20210353871A1 US17/385,535 US202117385535A US2021353871A1 US 20210353871 A1 US20210353871 A1 US 20210353871A1 US 202117385535 A US202117385535 A US 202117385535A US 2021353871 A1 US2021353871 A1 US 2021353871A1
- Authority
- US
- United States
- Prior art keywords
- mobile device
- dose
- medicament
- supplementary
- insulin
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 35
- 238000000034 method Methods 0.000 title claims description 29
- 239000003814 drug Substances 0.000 claims abstract description 105
- NOESYZHRGYRDHS-UHFFFAOYSA-N insulin Chemical compound N1C(=O)C(NC(=O)C(CCC(N)=O)NC(=O)C(CCC(O)=O)NC(=O)C(C(C)C)NC(=O)C(NC(=O)CN)C(C)CC)CSSCC(C(NC(CO)C(=O)NC(CC(C)C)C(=O)NC(CC=2C=CC(O)=CC=2)C(=O)NC(CCC(N)=O)C(=O)NC(CC(C)C)C(=O)NC(CCC(O)=O)C(=O)NC(CC(N)=O)C(=O)NC(CC=2C=CC(O)=CC=2)C(=O)NC(CSSCC(NC(=O)C(C(C)C)NC(=O)C(CC(C)C)NC(=O)C(CC=2C=CC(O)=CC=2)NC(=O)C(CC(C)C)NC(=O)C(C)NC(=O)C(CCC(O)=O)NC(=O)C(C(C)C)NC(=O)C(CC(C)C)NC(=O)C(CC=2NC=NC=2)NC(=O)C(CO)NC(=O)CNC2=O)C(=O)NCC(=O)NC(CCC(O)=O)C(=O)NC(CCCNC(N)=N)C(=O)NCC(=O)NC(CC=3C=CC=CC=3)C(=O)NC(CC=3C=CC=CC=3)C(=O)NC(CC=3C=CC(O)=CC=3)C(=O)NC(C(C)O)C(=O)N3C(CCC3)C(=O)NC(CCCCN)C(=O)NC(C)C(O)=O)C(=O)NC(CC(N)=O)C(O)=O)=O)NC(=O)C(C(C)CC)NC(=O)C(CO)NC(=O)C(C(C)O)NC(=O)C1CSSCC2NC(=O)C(CC(C)C)NC(=O)C(NC(=O)C(CCC(N)=O)NC(=O)C(CC(N)=O)NC(=O)C(NC(=O)C(N)CC=1C=CC=CC=1)C(C)C)CC1=CN=CN1 NOESYZHRGYRDHS-UHFFFAOYSA-N 0.000 claims description 84
- 238000002347 injection Methods 0.000 claims description 81
- 239000007924 injection Substances 0.000 claims description 81
- 102000004877 Insulin Human genes 0.000 claims description 42
- 108090001061 Insulin Proteins 0.000 claims description 42
- 229940125396 insulin Drugs 0.000 claims description 42
- 238000004891 communication Methods 0.000 claims description 29
- 238000012384 transportation and delivery Methods 0.000 claims description 19
- 230000008569 process Effects 0.000 claims description 15
- 238000012545 processing Methods 0.000 claims description 7
- 230000004044 response Effects 0.000 claims description 7
- 238000007781 pre-processing Methods 0.000 claims description 2
- 230000008878 coupling Effects 0.000 claims 1
- 238000010168 coupling process Methods 0.000 claims 1
- 238000005859 coupling reaction Methods 0.000 claims 1
- 238000012015 optical character recognition Methods 0.000 abstract description 19
- 230000001052 transient effect Effects 0.000 abstract description 4
- 230000005540 biological transmission Effects 0.000 description 12
- 230000000153 supplemental effect Effects 0.000 description 9
- 230000006870 function Effects 0.000 description 5
- 229940127560 insulin pen Drugs 0.000 description 5
- 230000003287 optical effect Effects 0.000 description 4
- 238000012377 drug delivery Methods 0.000 description 3
- 230000013011 mating Effects 0.000 description 3
- 238000003825 pressing Methods 0.000 description 3
- WQZGKKKJIJFFOK-GASJEMHNSA-N Glucose Natural products OC[C@H]1OC(O)[C@H](O)[C@@H](O)[C@@H]1O WQZGKKKJIJFFOK-GASJEMHNSA-N 0.000 description 2
- 239000008280 blood Substances 0.000 description 2
- 210000004369 blood Anatomy 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 239000008103 glucose Substances 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 238000003860 storage Methods 0.000 description 2
- 238000012935 Averaging Methods 0.000 description 1
- 206010067584 Type 1 diabetes mellitus Diseases 0.000 description 1
- 230000004913 activation Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- POIUWJQBRNEFGX-XAMSXPGMSA-N cathelicidin Chemical compound C([C@@H](C(=O)N[C@@H](CCCNC(N)=N)C(=O)N[C@@H](CCCCN)C(=O)N[C@@H](CO)C(=O)N[C@@H](CCCCN)C(=O)N[C@@H](CCC(O)=O)C(=O)N[C@@H](CCCCN)C(=O)N[C@@H]([C@@H](C)CC)C(=O)NCC(=O)N[C@@H](CCCCN)C(=O)N[C@@H](CCC(O)=O)C(=O)N[C@@H](CC=1C=CC=CC=1)C(=O)N[C@@H](CCCCN)C(=O)N[C@@H](CCCNC(N)=N)C(=O)N[C@@H]([C@@H](C)CC)C(=O)N[C@@H](C(C)C)C(=O)N[C@@H](CCC(N)=O)C(=O)N[C@@H](CCCNC(N)=N)C(=O)N[C@@H]([C@@H](C)CC)C(=O)N[C@@H](CCCCN)C(=O)N[C@@H](CC(O)=O)C(=O)N[C@@H](CC=1C=CC=CC=1)C(=O)N[C@@H](CC(C)C)C(=O)N[C@@H](CCCNC(N)=N)C(=O)N[C@@H](CC(N)=O)C(=O)N[C@@H](CC(C)C)C(=O)N[C@@H](C(C)C)C(=O)N1[C@@H](CCC1)C(=O)N[C@@H](CCCNC(N)=N)C(=O)N[C@@H]([C@@H](C)O)C(=O)N[C@@H](CCC(O)=O)C(=O)N[C@@H](CO)C(O)=O)NC(=O)[C@H](CC=1C=CC=CC=1)NC(=O)[C@H](CC(O)=O)NC(=O)CNC(=O)[C@H](CC(C)C)NC(=O)[C@@H](N)CC(C)C)C1=CC=CC=C1 POIUWJQBRNEFGX-XAMSXPGMSA-N 0.000 description 1
- 201000010099 disease Diseases 0.000 description 1
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 1
- 229940079593 drug Drugs 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 229920003229 poly(methyl methacrylate) Polymers 0.000 description 1
- 239000004417 polycarbonate Substances 0.000 description 1
- 229920000515 polycarbonate Polymers 0.000 description 1
- 239000004926 polymethyl methacrylate Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
- 239000010409 thin film Substances 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
- 208000001072 type 2 diabetes mellitus Diseases 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
- G16H40/60—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
- G16H40/67—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for remote operation
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
- A61M5/00—Devices for bringing media into the body in a subcutaneous, intra-vascular or intramuscular way; Accessories therefor, e.g. filling or cleaning devices, arm-rests
- A61M5/178—Syringes
- A61M5/31—Details
- A61M5/315—Pistons; Piston-rods; Guiding, blocking or restricting the movement of the rod or piston; Appliances on the rod for facilitating dosing ; Dosing mechanisms
- A61M5/31533—Dosing mechanisms, i.e. setting a dose
- A61M5/31545—Setting modes for dosing
- A61M5/31548—Mechanically operated dose setting member
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
- G16H20/10—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to drugs or medications, e.g. for ensuring correct administration to patients
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
- G16H20/10—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to drugs or medications, e.g. for ensuring correct administration to patients
- G16H20/17—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to drugs or medications, e.g. for ensuring correct administration to patients delivered via infusion or injection
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
- A61M5/00—Devices for bringing media into the body in a subcutaneous, intra-vascular or intramuscular way; Accessories therefor, e.g. filling or cleaning devices, arm-rests
- A61M5/178—Syringes
- A61M5/31—Details
- A61M2005/3125—Details specific display means, e.g. to indicate dose setting
- A61M2005/3126—Specific display means related to dosing
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
- A61M2205/00—General characteristics of the apparatus
- A61M2205/35—Communication
- A61M2205/3546—Range
- A61M2205/3561—Range local, e.g. within room or hospital
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
- A61M2205/00—General characteristics of the apparatus
- A61M2205/35—Communication
- A61M2205/3576—Communication with non implanted data transmission devices, e.g. using external transmitter or receiver
- A61M2205/3592—Communication with non implanted data transmission devices, e.g. using external transmitter or receiver using telemetric means, e.g. radio or optical transmission
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
- A61M2205/00—General characteristics of the apparatus
- A61M2205/50—General characteristics of the apparatus with microprocessors or computers
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
- A61M2205/00—General characteristics of the apparatus
- A61M2205/50—General characteristics of the apparatus with microprocessors or computers
- A61M2205/502—User interfaces, e.g. screens or keyboards
- A61M2205/505—Touch-screens; Virtual keyboard or keypads; Virtual buttons; Soft keys; Mouse touches
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
- A61M2205/00—General characteristics of the apparatus
- A61M2205/50—General characteristics of the apparatus with microprocessors or computers
- A61M2205/52—General characteristics of the apparatus with microprocessors or computers with memories providing a history of measured variating parameters of apparatus or patient
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
- A61M2205/00—General characteristics of the apparatus
- A61M2205/58—Means for facilitating use, e.g. by people with impaired vision
- A61M2205/581—Means for facilitating use, e.g. by people with impaired vision by audible feedback
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
- A61M2205/00—General characteristics of the apparatus
- A61M2205/58—Means for facilitating use, e.g. by people with impaired vision
- A61M2205/582—Means for facilitating use, e.g. by people with impaired vision by tactile feedback
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
- A61M2205/00—General characteristics of the apparatus
- A61M2205/82—Internal energy supply devices
- A61M2205/8206—Internal energy supply devices battery-operated
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
- A61M5/00—Devices for bringing media into the body in a subcutaneous, intra-vascular or intramuscular way; Accessories therefor, e.g. filling or cleaning devices, arm-rests
- A61M5/178—Syringes
- A61M5/31—Details
- A61M5/315—Pistons; Piston-rods; Guiding, blocking or restricting the movement of the rod or piston; Appliances on the rod for facilitating dosing ; Dosing mechanisms
- A61M5/31533—Dosing mechanisms, i.e. setting a dose
- A61M5/31545—Setting modes for dosing
- A61M5/31548—Mechanically operated dose setting member
- A61M5/3155—Mechanically operated dose setting member by rotational movement of dose setting member, e.g. during setting or filling of a syringe
- A61M5/31553—Mechanically operated dose setting member by rotational movement of dose setting member, e.g. during setting or filling of a syringe without axial movement of dose setting member
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H10/00—ICT specially adapted for the handling or processing of patient-related medical or healthcare data
- G16H10/60—ICT specially adapted for the handling or processing of patient-related medical or healthcare data for patient-specific data, e.g. for electronic patient records
Definitions
- the present disclosure relates to a monitoring system and to a method of operating a monitoring system.
- type-1 and type-2 diabetes can be treated by patients themselves by injection of insulin doses, for example once or several times per day.
- a pre-filled disposable insulin pen can be used as an injection device.
- a re-usable pen may be used.
- a re-usable pen allows replacement of an empty medicament cartridge by a new one. Either pen may come with a set of one-way needles that are replaced before each use.
- the insulin dose to be injected can then for instance be manually selected at the insulin pen by turning a dosage dial and observing the actual dose from a dosage window of the insulin pen.
- the dose is then injected by inserting the needle into a suited skin portion and pressing an injection button of the insulin pen.
- an injection button of the insulin pen To be able to monitor insulin injection, for instance to prevent false handling of the insulin pen or to keep track of the doses already applied or remaining, it is desirable to measure information related to a condition and/or use of the injection device, such as for instance information on the injected insulin type and dose.
- a first aspect of the disclosure provides a monitoring system comprising,
- a first device ( 2 ) configured to
- a system so constructed can provide the advantages of a supplement device that performs OCR and determines delivered dose of medicament but without requiring the hardware needed to perform OCR in the supplemental device. This can reduce the hardware cost of the supplemental device.
- the use of an external device as the second device allows the possibility of a more accurate and reliable OCR process than would be obtainable from OCR recourses that could practically be included in the supplemental device. This is especially the case when the second device compromises a mobile phone such as a smart phone.
- the first device may be configured to transmit the data representing the image of the medicament dosage to the second device in response to a user input on the first device or on the second device. This can allow transfer of the data to the second device when there is a change in the use of the dispensing device (e.g. from dialling to injecting or from injecting to injected) or by user input but without utilising communication resources at other times.
- the first device may be configured to transmit the data representing the image of the medicament dosage to the second device periodically or continually. This can allow the medicament dosage to be identified and displayed as the user is e.g. dialling and/or injecting medicament, although at the cost of increased communication resource utilisation.
- the first device may be configured to capture images of a medicament dosage indicated by the medicament dispensing device and display the images of the medicament dosage periodically or continually. This can allow the user to determine the dialled dose easily and is particularly useful during the dialling and injecting phases of use of the dispensing device.
- the first device may be configured to capture images of a medicament dosage indicated by the medicament dispensing device and display the image of the medicament dosage plural times a second. This can allow the user to determine the dialled dose particularly easily and can allow the user to dial the correct dose and dispense the dose more quickly and efficiently than with other arrangements, and may provide an experience similar to the use of a dispensing device that is not fitted with an external device with a recording facility.
- the first device may be configured to cause a first display after a first user input on the first device and to cause a second display after a second input on the first device. This can allow a user to determine from the display on the first device whether or not a dose set input, the dwell time a dose delivered input and/or no input has been recorded by the first device.
- the non-transient record of dosage information may include a time and/or date information taken from a clock of the first or second device.
- the second device may be a mobile telephone.
- the computer code may comprise a discreet software application.
- the software application may be downloadable, for instance from an application market place or store.
- the computer code when executed by the second device may cause the second device to display the identified medicament dosage.
- a second aspect of the disclosure provides a method of operating a monitoring system, the method comprising,
- a first device ( 2 ):
- FIG. 1 a is an exploded view of a drug delivery device
- FIG. 1 b shows a perspective view of some detail of the drug delivery device of FIG. 1 a;
- FIG. 2 a is an isometric projection of a sensor device or supplementary device according to embodiments of the present disclosure
- FIG. 2 b is an isometric projection of another sensor device or supplementary device according to embodiments of the present disclosure
- FIG. 2 c is an isometric projection of a still further sensor device or supplementary device according to embodiments of the present disclosure
- FIG. 3 is a schematic view of a sensor device as in FIGS. 2 a, b, c attached to a drug delivery device and showing internal components of the sensor device;
- FIG. 4 shows the FIG. 1 a injection device 1 fitted with a FIG. 2 a, b, c, sensor device and wirelessly communicating with a mobile terminal;
- FIG. 5 is a schematic view of the mobile terminal of FIG. 4 and showing internal components of the mobile terminal 100 ;
- FIG. 6 is a flow chart showing operation of the FIGS. 2 a, b, c sensor device or supplementary device according to embodiments of the disclosure.
- FIG. 7 is a flow chart showing operation of the FIG. 4 mobile terminal according to embodiments of the disclosure.
- FIG. 1 a is an exploded view of an injection device 1 , which may for instance represent Sanofi's SolostarTM insulin injection pen.
- the injection device 1 of FIG. 1 a is a pre-filled, disposable injection pen that comprises a housing 10 and contains an insulin container 14 , to which a needle 15 can be affixed.
- the needle is protected by an inner needle cap 16 and an outer needle cap 17 , which in turn can be covered by a cap 18 .
- An insulin dose to be ejected from injection device 1 can be selected by turning the dosage dial 12 , and the selected dose is then displayed via dosage window 13 , for instance in multiples of so-called International Units (IU), wherein one IU is the biological equivalent of about 45.5 micrograms of pure crystalline insulin ( 1/22 mg).
- An example of a selected dose displayed in dosage window 13 may for instance be 30 IUs, as shown in FIG. 1 a . It should be noted that the selected dose may equally well be displayed differently.
- a label (not shown) is provided on the housing 10 .
- the label includes information about the medicament included within the injection device 1 , including information identifying the medicament.
- the dosage dial 12 causes a mechanical clicker to provide haptic and acoustic feedback to a user.
- the numbers displayed in dosage window 13 are present on a sleeve by printing and the sleeve is contained in housing 10 and mechanically interacts with a piston in insulin container 14 .
- the insulin dose displayed in display window 13 will be ejected from injection device 1 .
- the needle 15 of injection device 1 remains for a certain time in the skin portion after the injection button 11 is pushed, a high percentage of the dose is actually injected into the patient's body. Ejection of the insulin dose also causes a mechanical click sound, which is however different from the sounds produced when using dosage dial 12 .
- Injection device 1 may be used for several injection processes until either insulin container 14 is empty or the expiration date of injection device 1 (e.g. 28 days after the first use) is reached.
- injection device 1 before using injection device 1 for the first time, it may be necessary to perform a so-called “prime shot” to remove air from insulin container 14 and needle 15 , for instance by selecting two units of insulin and pressing injection button 11 while holding injection device 1 with the needle 15 upwards.
- a so-called “prime shot” to remove air from insulin container 14 and needle 15 , for instance by selecting two units of insulin and pressing injection button 11 while holding injection device 1 with the needle 15 upwards.
- the ejected doses substantially correspond to the injected doses, so that, for instance when making a proposal for a dose to be injected next, this dose equals the dose that has to ejected by the injection device 1 . Nevertheless, differences (e.g. losses) between the ejected doses and the injected doses may of course be taken into account.
- FIG. 1 b is a close-up of the end of the injection device 1 .
- This Figure shows a locating rib 70 that is located between the dosage window 13 and the dosage dial 12 .
- FIG. 2 a shows an embodiment of a supplementary device 2 to be releasably attached to injection device 1 of FIG. 1 a .
- Supplementary device 2 comprises a housing 20 with a mating unit configured to embrace the housing 10 of injection device 1 of FIG. 1 a , so that supplementary device 2 sits tightly on housing 10 of injection device 1 , but is nevertheless removable from injection device 1 , for instance when injection device 1 is empty and needs to be replaced.
- FIG. 2 a is schematic, and details of the physical arrangement are described below with reference to FIGS. 2 b and 2 c.
- Supplementary device 2 contains optical sensors for gathering information from injection device 1 . As described below, a selected dose (also known as a dialled dose) is displayed via LCD display 21 of supplementary device 2 . The dosage window 13 of injection device 1 is obstructed by supplementary device 2 when attached to injection device 1 .
- Supplementary device 2 further comprises at least one user input transducer or switch 22 , illustrated schematically as a button type switch. These input transducers 22 allow a user to turn on/off supplementary device 2 , to trigger actions (for instance to cause establishment of a connection to or a pairing with another device, and/or to trigger transmission of information from supplementary device 2 to another device), or to confirm something.
- user input transducer or switch 22 illustrated schematically as a button type switch.
- FIG. 2 b is a schematic illustration of a second embodiment of a supplementary device 2 to be releasably attached to injection device 1 of FIG. 1 a .
- Supplementary device 2 comprises a housing 20 with a mating unit configured to embrace the housing 10 of injection device 1 of FIG. 1 a , so that supplementary device 2 sits tightly on housing 10 of injection device 1 , but is nevertheless removable from injection device 1 .
- Supplementary device 2 further comprises three user input transducers, buttons or switches.
- a first button 22 is a power on/off button, via which the supplementary device 2 may for instance be turned on and off.
- a second button 33 is a communications button.
- a third button 34 is a confirm or OK button.
- the buttons 22 , 33 , 34 may take any suitable form. These input buttons 22 , 33 , 34 allow a user to turn on/off supplementary device 2 , to trigger actions (for instance to cause establishment of a connection to or a pairing with another device, to trigger transmission of information from supplementary device 2 to another device), to confirm something, and/or to display information on the LCD display 21 .
- FIG. 2 c is a schematic illustration of a third embodiment of a supplementary device 2 to be releasably attached to injection device 1 of FIG. 1 a .
- Supplementary device 2 comprises a housing 20 with a mating unit configured to embrace the housing 10 of injection device 1 of FIG. 1 a , so that supplementary device 2 sits tightly on housing 10 of injection device 1 , but is nevertheless removable from injection device 1 .
- the dosage window 13 of injection device 1 is obstructed by supplementary device 2 when attached to injection device 1 .
- Supplementary device 2 further comprises a touch-sensitive input transducer 35 . It also comprises a single user input button or switch 22 .
- the button 22 is a power on/off button, via which the supplementary device 2 may for instance be turned on and off.
- the touch sensitive input transducer 35 can be used to trigger actions (for instance to cause establishment of a connection to or a pairing with another device, and/or to trigger transmission of image data information from supplementary device 2 to the mobile device 100 .
- This multi-function touch-sensitive input transducer 35 removes the need for the communications button 33 or a confirm button 34 and simplifies the configuration of the supplementary device 2 .
- Such a multi-function transducer 35 may be mechanical instead of being touch-sensitive.
- the mobile device 100 may display the dose dialled into the injection device 1 . This can allow the user to check the dialled dose calculated by the mobile device 100 against the dose displayed on the LCD display 21 of the supplementary device 2 .
- the mobile device 100 through the medicament administration monitoring application 110 , may allow the user to vary the dialled dose from that calculated by the optical character recognition process. This can allow more accurate recordal of medicament administration.
- the mobile device 100 may alternatively or additionally require the user to confirm the displayed dose, or allow the user to confirm that the displayed dose is the dialled dose.
- FIG. 3 shows a schematic view of the supplementary device 2 of FIG. 2 b or 2 c in a state where it is attached to injection device 1 of FIG. 1 a.
- a processor 24 which may for instance be a microprocessor, a Digital Signal Processor (DSP), Application Specific Integrated Circuit (ASIC), Field Programmable Gate Array (FPGA) or the like.
- DSP Digital Signal Processor
- ASIC Application Specific Integrated Circuit
- FPGA Field Programmable Gate Array
- Processor 24 executes program code (e.g. software or firmware) stored in a program memory 240 , and uses a main memory 241 , for instance to store intermediate results.
- Program memory 240 may for instance be a Read-Only Memory (ROM) or Flash memory, and main memory may for instance be a Random Access Memory (RAM).
- ROM Read-Only Memory
- RAM Random Access Memory
- processor 24 interacts with the first button 22 , via which supplementary device 2 may for instance be turned on and off.
- the second button 33 may be used to trigger establishment of a connection to another device, or to trigger a transmission of information to another device.
- the third button 34 can be used to acknowledge information presented to a user of supplementary device 2 .
- buttons 33 , 34 may be omitted. Instead, one or more capacitive sensors or other touch sensors are provided.
- LCD display 21 is used to display information to a user of supplementary device 2 , for instance on present settings of injection device 1 , or on a next injection to be given. LCD display 21 may also be embodied as a touch-screen display, for instance to receive user input.
- LCD display 21 may also be embodied as a touch-screen display, for instance to receive user input.
- Processor 24 also controls an image capture device 25 that is configured to capture images of the dosage window 13 , in which a currently selected (dialled) dose is displayed (by way of numbers, characters, symbols or glyphs present on the sleeve 19 contained in injection device 1 , which numbers are visible through the dosage window 13 ).
- the image capture device 25 may be a camera of any suitable type.
- Processor 24 also controls one or more light-sources such as light emitting diodes (LEDs) 29 to illuminate the scene that is visible through the dosage window 13 , in which a currently selected dose is displayed.
- a diffuser may be used in front of the light-sources, for instance a diffuser made from a piece of acrylic glass or polycarbonate.
- the optical sensor may comprise a lens system, for instance including two aspheric lenses.
- the magnification ratio image size to object size ratio
- the magnification ratio may be in the range of 0.05 to 0.5.
- Processor 24 controls a wireless unit 28 , which is configured to transmit and/or receive information to/from another device in a wireless fashion. Such transmission may for instance be based on radio transmission or optical transmission.
- the wireless unit 28 is a Bluetooth or Bluetooth Low Energy transceiver.
- wireless unit 28 may be substituted or complemented by a wired unit configured to transmit and/or receive information to/from another device in a wire-bound fashion, for instance via a cable or fibre connection.
- the supplementary device 2 of FIG. 3 is thus capable of capturing information related to a condition and/or use of injection device 1 . This information is displayed on the display 21 for use by the user of the device and some of the information is transmitted wirelessly to another device.
- FIG. 4 shows the supplementary device and injection device 1 being used in conjunction with a mobile device 100 such as a smartphone.
- the mobile device 100 is programmed in a suitable way, for instance by being provided with a suitable software application 110 .
- the system of the supplementary device 2 and the mobile device 100 function to display and record medicament dosage when the injection device 1 is used.
- the supplementary device 2 communicates with the mobile device 100 using a communication interface 28 e.g. Bluetooth.
- the user interacts primarily with the supplementary device 2 .
- the mobile device 100 serves primarily to provide information to the user and to record the user's injection history.
- the supplementary device 2 transmits data representing an image captured by the camera 25 of the scene through the dosage window 13 to the mobile device 100 via a predefined communication channel 111 (see FIG. 4 ).
- the mobile device 100 performs Optical Character Recognition (OCR) processing to identify the selected medicament dosage from the image data received from the supplementary device 2 .
- OCR Optical Character Recognition
- the mobile device 100 may identify the selected dose before and after dispensing, calculate the administered dosage, display the administered dose and makes a record of the administered dosage information.
- a time stamp may be added to the dosage information.
- the camera image taken is stored in the memory 241 of the supplementary device 2 together with a time stamp and information about the drug type.
- the mobile device 100 includes a processor 102 .
- the processor 102 controls operation of the other hardware components of the mobile device 100 .
- the processor 102 and other hardware components may be connected via a system bus (not shown). Each hardware component may be connected to the system bus either directly or via an interface.
- the mobile device 100 comprises a memory 104 , i.e. a working or volatile memory, such as Random Access Memory (RAM), and a non-volatile memory.
- the non-volatile memory stores an operating system 108 and a medicament administration monitoring function 110 , which advantageously is a distinct application, as well as storing data files and associated metadata.
- the medicament administration monitoring application 110 may be provided in the mobile device 100 on manufacture or it may be down loaded into the mobile device 100 by a user, for instance from an application market place or application store.
- the mobile device 100 comprises a display 112 (for instance an LCD, TFT (thin film transistor), OLED (organic light emitting diode), ePaper).
- the display may be a touch sensitive display having a display part 113 and a tactile interface part 114 .
- the mobile device 100 also includes a communications interface 116 , such as a Bluetooth interface.
- the mobile device 100 also houses a battery 118 to power the mobile device 100 by a power supply 119 .
- the processor 102 is configured to send and receive signals to and from the other components in order to control operation of the other components.
- the processor 102 controls the display of content on display 112 and receives signals as a result of user inputs from tactile interface 114 .
- the display 112 may be a resistive touch screen or capacitive touch screen of any kind.
- the display may alternatively not be a touch screen. For instance it may be a liquid crystal display (LCD).
- the mobile device 100 may be a mobile phone, PDA or tablet computer of any kind, or it may be a BGM (blood glucose meter) device. Other standard or optional components of the mobile device 100 , such as transceivers and cameras, are omitted.
- the processor 102 may be an integrated circuit of any kind.
- the processor 102 may access RAM in order to process data and may control the storage of data in memory 104 .
- Memory 104 may be a non-volatile memory of any kind such as a Read Only Memory (ROM), a flash memory and a magnetic drive memory.
- the RAM may be a RAM of any type, for example Static RAM (SRAM), Dynamic RAM (DRAM) or a Flash memory.
- the processor 102 operates under control of the operating system 108 .
- the operating system 108 may comprise code relating to hardware such as the display 112 and communications interface 116 , as well as the basic operation of the mobile device 100 .
- the operating system 108 may also cause activation of other software modules stored in the memory 104 , such as the medicament administration monitoring function 110 .
- FIG. 6 and FIG. 7 are flow charts illustrating operation of the supplementary device 2 and the mobile device 1 a respectively.
- the flow charts illustrate how the supplementary device 2 and the mobile device 100 interact and operate as a system when the injection device 1 is being utilised.
- the steps of FIG. 6 are performed by the processor 24 of the supplementary device 2 under control of the software stored in the memory 240 .
- the operation 600 starts for instance when the supplementary device 2 is turned on or is otherwise activated at 601 .
- the processor 24 controls the camera 25 to capture an image of the current dosage displayed on the number sleeve of the injection device 1 , as is visible through the dosage window 13 of the injection device 1 .
- This image is then caused to be displayed on the LCD display 21 of the supplementary device 2 in a step 603 .
- the image is processed to some degree before display. In particular, the image may be resized so as to fit the LCD display 21 . In the case of the camera having more pixels than the LCD display 21 , resizing involves downscaling the image.
- Downscaling may comprise for instance selecting only some pixels of the captured image for display (and not displaying others), or averaging groups of pixels.
- the image advantageously is displayed in greyscale. This avoids the need for the supplementary device to perform processing of the image to detect boundaries of characters etc. It also reduces the possibility that the displayed image is significantly different from the scene in front of the camera 25 .
- the image may be displayed in black and white (without greyscale), or colour.
- a step 604 it is checked whether a user input, indicating that a required dosage has been set, has been provided for instance by a button press on the supplementary device 2 . If no button press is detected, the operation proceeds to step 614 , where it is determined if the power button 22 has been pressed. On a negative determination, the operation proceeds to step 615 , where it is determined if there is a time out condition. The time out condition occurs when a timer that is reset and started when the supplementary device 2 powers on or when it is detected that the power button 22 has been pressed has expired. A suitable value for the timer may be 60 or 120 seconds. On a negative determination from step 615 , the operation returns to step 602 , where a next image is captured and then displayed at step 603 .
- the supplementary device 2 powers off and the operation ends at step 616 . This helps to minimise power consumption of the supplementary device but without impinging on operation when the user is interacting with the supplementary device 2 or the injection device 1 .
- step 602 causes the supplementary device 2 to remain capturing images and displaying them until either the power button 22 is pressed or the time out condition occurs or until it is determined at step 604 that the confirm or OK button 34 to set dose has been pressed.
- This loop allows the user to set the required dosage by turning the dosage dial 12 on the injection device 1 and reading the image containing the current dosage information displayed on the LCD display 21 .
- the processor 24 turns the supplementary device 2 off. If no power off button 22 press is detected but a timeout is reached in step 615 , the processor 24 turns the supplementary device 2 off.
- a dose set condition is indicated on the display 21 by the processor 24 .
- the processor 24 controls the wireless unit 28 to transmit data representing the image of the currently dialled dose to the mobile device 100 in step 606 for further processing.
- the data representing the image that is transmitted is the whole image, relating to all of the pixels and including a greyscale value for each pixel.
- the transmitted data represents an image and is not indicative of a set dose other than the data being an image of the dose dialled into the injection device 1 at the time the image was captured.
- the image may be compressed in a lossy or lossless manner before transmission time and communication resave initialisation.
- the processor 24 controls the LCD display 21 to display “Administering”.
- the user may be administering (delivering) the dose dialled into the injection device 1 before the confirm or OK button 34 to set dose was detected to be pressed at step 604 .
- Steps 605 and 607 may be performed in the other order, or they may be performed in parallel with one another.
- a step 608 the processor 24 controls the camera to capture an image in front of the camera, which indicates the current dosage as visible in the dosage window 13 . This image is then displayed on the LCD display 21 of the device in a step 609 . Steps 608 and 609 are the same as steps 602 and 603 as described above.
- the user is expected to press a confirm or OK button 34 on the supplementary device 2 to indicate “End dose” to the processor 24 at step 610 .
- the processor 24 at step 610 detects a confirm or OK button 34 press that indicates the “End dose”, it controls the LCD display 21 to display “Complete” in a step 611 .
- the current image is transmitted to the mobile device 100 . Steps 612 and 611 may be performed in the other order, or they may be performed in parallel.
- step 613 it is determined at step 613 whether the power button 22 has been pressed. If it is detected at step 613 that the power button 22 has been pressed, the supplementary device 2 then turns off at step 620 . If not, it returns to step 602 , where the image in front of the camera 25 is captured before being displayed at step 603 . This repeats until the time out condition occurs or the power button 22 is pressed.
- step 610 If no confirm or OK button 34 press is detected in step 610 the operation proceeds to step 617 , where it is determined if the power button 22 has been pressed. On a negative determination, the operation proceeds to step 618 , where it is determined if there is a time out condition.
- the time out condition occurs when a timer that is reset and started when the supplementary device 2 powers on or when it is detected that the power button 22 has been pressed has expired. A suitable value for the timer may be 60 or 120 seconds.
- step 618 On a negative determination from step 618 , the operation returns to step 608 , where a next image is captured and then displayed at step 609 .
- the supplementary device 2 transmits the current image to the mobile device 100 and then powers off ending the operation at step 620 .
- transmitting the current image to the mobile device 100 at this stage i.e. before power off also ensures that the final dosage information is recorded on the mobile device 100 .
- This scenario could arise as a result of the user forgetting to press the confirm or OK button 34 at step 610 to indicate “End dose” to the processor 24 after the injection process is complete.
- FIG. 7 is a flowchart of the method steps that are performed by the mobile device 100 in conjunction with the method steps performed by the supplementary device 2 in FIG. 6 .
- the flowchart 700 starts at step 701 for instance when the supplementary device 2 is turned on or is otherwise activated.
- the mobile device 100 receives the image data. This constitutes image data containing information of the medicament dosage set by the user and sent from the supplementary device 2 .
- the mobile device 100 performs optical character recognition processing on the received data. This can be performed in any suitable way.
- the optical character recognition involves processing the image of the number sleeve that is in the scene in front of the camera 25 of the supplementary device 2 to identify the dose that is dialled into the supplementary device 2 .
- the result is a number that represents the dialled dose, for instance in IU.
- the number may be provided by the optical character recognition process as an integer or it may be between integer numbers if the optical character recognition process is suitably configured.
- the mobile device 100 is controlled by the medicament administration monitoring application to display the identified dialled or set dosage information to the user on the display 113 at step 704 .
- the dialled dosage is displayed to the user on the display 113 along with an indication that it is the dialled dose, not the dispensed dose, that is being displayed.
- the indication may take any suitable form.
- the indication may comprise the word “selected”, “dialled”, or “set”, or any other text form suitable and/or common to indicate to a user that it is the dialled dose, not the dispensed dose that is being displayed.
- the text format comprises also any translation into a language that is being set in the device.
- the indication may comprise an image, such as a pictogram suitable and/or common to indicate to a user that it is the dialled dose, not the dispensed dose that is being displayed.
- the image indication may be provided as alternative or in combination with a text-based indication.
- the mobile device 100 determines whether a delivered dose image has been received from the supplemental device 2 . If no delivered dose image data has been received, the mobile device 100 returns to step 704 , where the dialled dose is again displayed. This repeats until a delivered dose image is received from the supplemental device 2 .
- the mobile device 100 determines at step 705 that it has received delivered dose image data containing information of the final dose after the injection has been administered, it performs optical recognition processing on the delivered dose image data at step 706 , in any suitable way. This results in a number that indicates the dialled dose after injection/delivery.
- the mobile device 100 calculates at step 707 the delivered dose using the dialled and final dose information received from the supplementary device 2 , in particular by subtracting the dose shown after delivery from the dose shown before delivery. Alternatively, if it is detected or assumed that the final dose is zero, this can be omitted.
- the calculated delivered dose information is displayed to the user on the mobile device 100 by the medicament administration monitoring application 110 in a step 708 .
- the delivered dose information is then stored in the memory 104 of the mobile device 100 at step 709 before the operation ends at step 710 .
- the storage of the dose information at step 709 constitutes a record of the medicament administration.
- the record includes the time or time and date of administration, taken from the internal clock of the mobile device 100 , the dose delivered and optionally other information provided by the user such as a blood glucose measurement taken before the medicament delivery, the type of medicament etc. This allows a complete record of the medicament intake of the user to be recorded by the mobile device 100 without requiring the user to enter the dialled, post-delivered or delivered dose.
- the user begins by turning on the supplementary device 2 (which requires one press of the power button 22 ) and opening or initiating the medicament administration monitoring application 110 on the mobile device 100 .
- a communications channel 111 between the supplementary device 2 and the mobile device 100 is established. This can be achieved by the user pressing the communications button 33 on the supplementary device 2 .
- the user may need to interact with the medicament administration monitoring application 110 on the mobile device 100 to allow the connection to be established, or connection may be automatic if the devices have been suitably configured, for instance through Bluetooth pairing.
- a communications link between the supplementary device 2 and the mobile device 100 may be established without requiring any user input, for instance in response to the supplementary device 2 being powered on.
- the receipt by the mobile device 100 of a signal from the supplemental device 2 may cause the mobile device 100 to launch the medicament administration monitoring application 110 on the mobile device 100 .
- the current dosage on the injection device 1 is displayed to the user on the supplementary device 2 LCD display 21 .
- the user can now set the required medicament dosage by turning the dosage dial 12 on the injection device 1 while reading the current dosage reading on the LCD display 21 .
- the supplementary device 2 is displaying the medicament dose on the LCD display 21 .
- the medicament administration monitoring application 110 on the mobile device 100 then displays the dosage set by the user on the mobile device 100 display. The user is now able to double-check that the correct dose has been recognised by the mobile device 100 . However, the user does not need to check the mobile device 100 at this stage.
- the display of the LCD display 21 on the supplementary device 2 then changes to indicate that the dose has been set.
- the user can start to inject the medicament.
- the dosage reading on the LCD display 21 changes as the dose indicated on the part of the number sleeve of the injection device 1 in front of the camera changes.
- the user may press the confirm or OK button 34 again or may allow the timer to timeout.
- the supplementary device 2 LCD display 21 then changes to display “Complete”.
- the supplementary device 2 at this time displays the remaining dosage in the injection device 1 on the LCD display 21 .
- the remaining dose typically is zero but it may be higher if the user did not complete the injection.
- the mobile medicament administration monitoring application 110 displays the administered dose on the mobile device display, and may also display the final dialled dose to allow the user to check that the mobile device 100 has registered the correct final dialled dose.
- the medicament administration monitoring application 110 on the mobile device 100 also displays a message indicating that a record relating to the administered dosage has been created and stored.
- HDR images are captured by the image capturing device 25 in order to contribute to a high contrast of the dosage information so that binarization and OCR calculation in the mobile device 100 is improved.
- the communications button 33 can be omitted from the supplementary device.
- the supplementary device 2 can turn on and automatically establish connection with the mobile device 100 . This simplifies the function of the supplementary device 2 and allows it to have fewer hardware buttons.
- the mobile device 100 may display both the dose dialled into the injection device 1 after delivery and the calculated dose. This can allow the user to check the dialled dose calculated by the mobile device 100 against the dose displayed on the LCD display 21 of the supplementary device 2 .
- the mobile device 100 through the medicament administration monitoring application 110 , may allow the user to vary the dialled dose from that calculated by the optical character recognition process. This can allow the record of medicament administration recorded in the mobile device 100 to be more accurate than otherwise.
- operation may differ.
- image data may be transmitted continually or frequently to the mobile device 100 , and the mobile device may then display the dialled dose as dialling occurs and/or as injecting occurs.
- the user input indicating that the dose has been set may be made on the mobile device 100 instead of on the supplementary device 2 .
- the user can check the dialled dose indicated on the mobile device 100 (which has been subjected to optical character recognition) against the image displayed on the LCD display 21 of the supplementary device 2 .
- the user indicating that the injection has completed may be made on the mobile device 100 instead of the supplemental device 2 .
- both the supplemental device 2 and the mobile device 100 may be configured to receive the dose set user input and/or the injection complete user input, thereby allowing the user more choices for using the system.
- the indication that the dose has been set may be made alternatively or additionally on the mobile device. The same applies to the indication that the dose has been delivered.
- the image data is sent to the mobile device during the dose delivery process.
- the image data may be stored in the memory 241 of the supplementary device 2 and transmitted to the mobile device 100 at a later time, for instance minutes, hours or tens of hours later. Transmission to the mobile device may include images for two or more dose deliveries.
- the supplemental device 2 may include a means for detecting the medicament included in the injection device 1 .
- This may take the form of a colour sensor that is configured to detect the colour of a label on the injection pen, the label colour indicating the type of medicament contained.
Abstract
Description
- This application is a continuation of U.S. patent application Ser. No. 17/138,273, filed Dec. 30, 2020, which is a continuation of U.S. patent application Ser. No. 15/320,156, filed Dec. 19, 2016, which is a U.S. national stage application under 35 USC § 371 of International Application No. PCT/EP2015/064348, filed on Jun. 25, 2015, which claims priority to European Patent Application No. 14174717.0 filed on Jun. 27, 2014, the entire contents of which are incorporated herein by reference.
- The present disclosure relates to a monitoring system and to a method of operating a monitoring system.
- A variety of diseases exist that require regular treatment by injection of a medicament. Such injections can be performed by using injection devices, which are applied either by medical personnel or by patients themselves. As an example, type-1 and type-2 diabetes can be treated by patients themselves by injection of insulin doses, for example once or several times per day. For instance, a pre-filled disposable insulin pen can be used as an injection device. Alternatively, a re-usable pen may be used. A re-usable pen allows replacement of an empty medicament cartridge by a new one. Either pen may come with a set of one-way needles that are replaced before each use. The insulin dose to be injected can then for instance be manually selected at the insulin pen by turning a dosage dial and observing the actual dose from a dosage window of the insulin pen. The dose is then injected by inserting the needle into a suited skin portion and pressing an injection button of the insulin pen. To be able to monitor insulin injection, for instance to prevent false handling of the insulin pen or to keep track of the doses already applied or remaining, it is desirable to measure information related to a condition and/or use of the injection device, such as for instance information on the injected insulin type and dose.
- For a good treatment of insulin it is necessary to keep a diary to document the day, time and amount of insulin dose. Some patients forget to write the information down or cannot remember when and how much insulin they have injected. Therefore, there is a strong need for further support or automation of this process to make it easier for the patient to keep track of his/her diary.
- A first aspect of the disclosure provides a monitoring system comprising,
- a first device (2) configured to
-
- capture an image of a medicament dosage indicated by a medicament dispensing device by an image capturing component of the first device;
- display the image of the medicament dosage on a display (21) of the first device; and
- transmit data representing the image of the medicament dosage to a second device; and computer code that when executed by a second device causes the second device (100) to:
- receive the data representing the image of the medicament dosage sent by the first device (2);
- perform optical character recognition on the data of the medicament dosage thereby to identify the dosage indicated by the medicament dispensing device; and
- make a non-transient record of dosage information based at least in part on the identified medicament dosage.
- A system so constructed can provide the advantages of a supplement device that performs OCR and determines delivered dose of medicament but without requiring the hardware needed to perform OCR in the supplemental device. This can reduce the hardware cost of the supplemental device. Moreover, the use of an external device as the second device allows the possibility of a more accurate and reliable OCR process than would be obtainable from OCR recourses that could practically be included in the supplemental device. This is especially the case when the second device compromises a mobile phone such as a smart phone.
- The first device may be configured to transmit the data representing the image of the medicament dosage to the second device in response to a user input on the first device or on the second device. This can allow transfer of the data to the second device when there is a change in the use of the dispensing device (e.g. from dialling to injecting or from injecting to injected) or by user input but without utilising communication resources at other times.
- The first device may be configured to transmit the data representing the image of the medicament dosage to the second device periodically or continually. This can allow the medicament dosage to be identified and displayed as the user is e.g. dialling and/or injecting medicament, although at the cost of increased communication resource utilisation.
- The first device may be configured to capture images of a medicament dosage indicated by the medicament dispensing device and display the images of the medicament dosage periodically or continually. This can allow the user to determine the dialled dose easily and is particularly useful during the dialling and injecting phases of use of the dispensing device.
- The first device may be configured to capture images of a medicament dosage indicated by the medicament dispensing device and display the image of the medicament dosage plural times a second. This can allow the user to determine the dialled dose particularly easily and can allow the user to dial the correct dose and dispense the dose more quickly and efficiently than with other arrangements, and may provide an experience similar to the use of a dispensing device that is not fitted with an external device with a recording facility.
- The first device may be configured to cause a first display after a first user input on the first device and to cause a second display after a second input on the first device. This can allow a user to determine from the display on the first device whether or not a dose set input, the dwell time a dose delivered input and/or no input has been recorded by the first device.
- The non-transient record of dosage information may include a time and/or date information taken from a clock of the first or second device.
- The second device may be a mobile telephone.
- The computer code may comprise a discreet software application. The software application may be downloadable, for instance from an application market place or store.
- The computer code when executed by the second device may cause the second device to display the identified medicament dosage.
- A second aspect of the disclosure provides a method of operating a monitoring system, the method comprising,
- a first device (2):
-
- capturing an image of a medicament dosage indicated by a medicament dispensing device by an image capturing component of the first device;
- displaying the image of the medicament dosage on a display (21) of the first device; and
- transmitting data representing the image of the medicament dosage to a second device; and
a second device (100): - receiving the data representing the image of the medicament dosage sent by the first device (2);
- performing optical character recognition on the data of the medicament dosage thereby to identify the dosage indicated by the medicament dispensing device; and
- making a non-transient record of dosage information based at least in part on the identified medicament dosage.
- In the Figures:
-
FIG. 1a is an exploded view of a drug delivery device; -
FIG. 1b shows a perspective view of some detail of the drug delivery device ofFIG. 1 a; -
FIG. 2a is an isometric projection of a sensor device or supplementary device according to embodiments of the present disclosure; -
FIG. 2b is an isometric projection of another sensor device or supplementary device according to embodiments of the present disclosure; -
FIG. 2c is an isometric projection of a still further sensor device or supplementary device according to embodiments of the present disclosure; -
FIG. 3 is a schematic view of a sensor device as inFIGS. 2 a, b, c attached to a drug delivery device and showing internal components of the sensor device; -
FIG. 4 shows theFIG. 1a injection device 1 fitted with aFIG. 2 a, b, c, sensor device and wirelessly communicating with a mobile terminal; -
FIG. 5 is a schematic view of the mobile terminal ofFIG. 4 and showing internal components of themobile terminal 100; -
FIG. 6 is a flow chart showing operation of theFIGS. 2 a, b, c sensor device or supplementary device according to embodiments of the disclosure; and -
FIG. 7 is a flow chart showing operation of theFIG. 4 mobile terminal according to embodiments of the disclosure. - In the following, embodiments of the present disclosure will be described with reference to an insulin injection device. The present disclosure is however not limited to such application and may equally well be deployed with injection devices that eject other medicaments, or with other types of medicament administration devices.
-
FIG. 1a is an exploded view of aninjection device 1, which may for instance represent Sanofi's Solostar™ insulin injection pen. - The
injection device 1 ofFIG. 1a is a pre-filled, disposable injection pen that comprises ahousing 10 and contains aninsulin container 14, to which aneedle 15 can be affixed. The needle is protected by aninner needle cap 16 and anouter needle cap 17, which in turn can be covered by acap 18. An insulin dose to be ejected frominjection device 1 can be selected by turning thedosage dial 12, and the selected dose is then displayed viadosage window 13, for instance in multiples of so-called International Units (IU), wherein one IU is the biological equivalent of about 45.5 micrograms of pure crystalline insulin ( 1/22 mg). An example of a selected dose displayed indosage window 13 may for instance be 30 IUs, as shown inFIG. 1a . It should be noted that the selected dose may equally well be displayed differently. A label (not shown) is provided on thehousing 10. The label includes information about the medicament included within theinjection device 1, including information identifying the medicament. - Turning the
dosage dial 12 causes a mechanical clicker to provide haptic and acoustic feedback to a user. The numbers displayed indosage window 13 are present on a sleeve by printing and the sleeve is contained inhousing 10 and mechanically interacts with a piston ininsulin container 14. Whenneedle 15 is stuck into a skin portion of a patient, and theninjection button 11 is pushed, the insulin dose displayed indisplay window 13 will be ejected frominjection device 1. When theneedle 15 ofinjection device 1 remains for a certain time in the skin portion after theinjection button 11 is pushed, a high percentage of the dose is actually injected into the patient's body. Ejection of the insulin dose also causes a mechanical click sound, which is however different from the sounds produced when usingdosage dial 12. -
Injection device 1 may be used for several injection processes until eitherinsulin container 14 is empty or the expiration date of injection device 1 (e.g. 28 days after the first use) is reached. - Furthermore, before using
injection device 1 for the first time, it may be necessary to perform a so-called “prime shot” to remove air frominsulin container 14 andneedle 15, for instance by selecting two units of insulin andpressing injection button 11 while holdinginjection device 1 with theneedle 15 upwards. - For simplicity of presentation, in the following, it will be exemplarily assumed that the ejected doses substantially correspond to the injected doses, so that, for instance when making a proposal for a dose to be injected next, this dose equals the dose that has to ejected by the
injection device 1. Nevertheless, differences (e.g. losses) between the ejected doses and the injected doses may of course be taken into account. -
FIG. 1b is a close-up of the end of theinjection device 1. This Figure shows a locatingrib 70 that is located between thedosage window 13 and thedosage dial 12. -
FIG. 2a shows an embodiment of a supplementary device 2 to be releasably attached toinjection device 1 ofFIG. 1a . Supplementary device 2 comprises ahousing 20 with a mating unit configured to embrace thehousing 10 ofinjection device 1 ofFIG. 1a , so that supplementary device 2 sits tightly onhousing 10 ofinjection device 1, but is nevertheless removable frominjection device 1, for instance wheninjection device 1 is empty and needs to be replaced.FIG. 2a is schematic, and details of the physical arrangement are described below with reference toFIGS. 2b and 2 c. - Supplementary device 2 contains optical sensors for gathering information from
injection device 1. As described below, a selected dose (also known as a dialled dose) is displayed viaLCD display 21 of supplementary device 2. Thedosage window 13 ofinjection device 1 is obstructed by supplementary device 2 when attached toinjection device 1. - Supplementary device 2 further comprises at least one user input transducer or switch 22, illustrated schematically as a button type switch. These
input transducers 22 allow a user to turn on/off supplementary device 2, to trigger actions (for instance to cause establishment of a connection to or a pairing with another device, and/or to trigger transmission of information from supplementary device 2 to another device), or to confirm something. -
FIG. 2b is a schematic illustration of a second embodiment of a supplementary device 2 to be releasably attached toinjection device 1 ofFIG. 1a . Supplementary device 2 comprises ahousing 20 with a mating unit configured to embrace thehousing 10 ofinjection device 1 ofFIG. 1a , so that supplementary device 2 sits tightly onhousing 10 ofinjection device 1, but is nevertheless removable frominjection device 1. - Information is displayed via
LCD display 21 of supplementary device 2. Thedosage window 13 ofinjection device 1 is obstructed by supplementary device 2 when attached toinjection device 1. - Supplementary device 2 further comprises three user input transducers, buttons or switches. A
first button 22 is a power on/off button, via which the supplementary device 2 may for instance be turned on and off. Asecond button 33 is a communications button. Athird button 34 is a confirm or OK button. Thebuttons input buttons LCD display 21. -
FIG. 2c is a schematic illustration of a third embodiment of a supplementary device 2 to be releasably attached toinjection device 1 ofFIG. 1a . Supplementary device 2 comprises ahousing 20 with a mating unit configured to embrace thehousing 10 ofinjection device 1 ofFIG. 1a , so that supplementary device 2 sits tightly onhousing 10 ofinjection device 1, but is nevertheless removable frominjection device 1. - Information is displayed via
LCD display 21 of the supplementary device 2. Thedosage window 13 ofinjection device 1 is obstructed by supplementary device 2 when attached toinjection device 1. - Supplementary device 2 further comprises a touch-
sensitive input transducer 35. It also comprises a single user input button orswitch 22. Thebutton 22 is a power on/off button, via which the supplementary device 2 may for instance be turned on and off. The touchsensitive input transducer 35 can be used to trigger actions (for instance to cause establishment of a connection to or a pairing with another device, and/or to trigger transmission of image data information from supplementary device 2 to themobile device 100. This multi-function touch-sensitive input transducer 35 removes the need for thecommunications button 33 or aconfirm button 34 and simplifies the configuration of the supplementary device 2. Such amulti-function transducer 35 may be mechanical instead of being touch-sensitive. - The
mobile device 100 may display the dose dialled into theinjection device 1. This can allow the user to check the dialled dose calculated by themobile device 100 against the dose displayed on theLCD display 21 of the supplementary device 2. Themobile device 100, through the medicamentadministration monitoring application 110, may allow the user to vary the dialled dose from that calculated by the optical character recognition process. This can allow more accurate recordal of medicament administration. Themobile device 100 may alternatively or additionally require the user to confirm the displayed dose, or allow the user to confirm that the displayed dose is the dialled dose. -
FIG. 3 shows a schematic view of the supplementary device 2 ofFIG. 2b or 2 c in a state where it is attached toinjection device 1 ofFIG. 1 a. - With the
housing 20 of supplementary device 2, a plurality of components is contained. These are controlled by aprocessor 24, which may for instance be a microprocessor, a Digital Signal Processor (DSP), Application Specific Integrated Circuit (ASIC), Field Programmable Gate Array (FPGA) or the like.Processor 24 executes program code (e.g. software or firmware) stored in aprogram memory 240, and uses amain memory 241, for instance to store intermediate results.Program memory 240 may for instance be a Read-Only Memory (ROM) or Flash memory, and main memory may for instance be a Random Access Memory (RAM). - In embodiments such as those shown in
FIG. 2b ,processor 24 interacts with thefirst button 22, via which supplementary device 2 may for instance be turned on and off. Thesecond button 33 may be used to trigger establishment of a connection to another device, or to trigger a transmission of information to another device. Thethird button 34 can be used to acknowledge information presented to a user of supplementary device 2. - In embodiments such as those shown in
FIG. 2c , two of thebuttons -
Processor 24 controls adisplay 21, which is presently embodied as a Liquid Crystal Display (LCD).LCD display 21 is used to display information to a user of supplementary device 2, for instance on present settings ofinjection device 1, or on a next injection to be given.LCD display 21 may also be embodied as a touch-screen display, for instance to receive user input. -
Processor 24 also controls animage capture device 25 that is configured to capture images of thedosage window 13, in which a currently selected (dialled) dose is displayed (by way of numbers, characters, symbols or glyphs present on thesleeve 19 contained ininjection device 1, which numbers are visible through the dosage window 13). Theimage capture device 25 may be a camera of any suitable type. -
Processor 24 also controls one or more light-sources such as light emitting diodes (LEDs) 29 to illuminate the scene that is visible through thedosage window 13, in which a currently selected dose is displayed. A diffuser may be used in front of the light-sources, for instance a diffuser made from a piece of acrylic glass or polycarbonate. Furthermore, the optical sensor may comprise a lens system, for instance including two aspheric lenses. The magnification ratio (image size to object size ratio) may be smaller than 1. The magnification ratio may be in the range of 0.05 to 0.5. -
Processor 24 controls awireless unit 28, which is configured to transmit and/or receive information to/from another device in a wireless fashion. Such transmission may for instance be based on radio transmission or optical transmission. In some embodiments, thewireless unit 28 is a Bluetooth or Bluetooth Low Energy transceiver. Alternatively,wireless unit 28 may be substituted or complemented by a wired unit configured to transmit and/or receive information to/from another device in a wire-bound fashion, for instance via a cable or fibre connection. - The supplementary device 2 of
FIG. 3 is thus capable of capturing information related to a condition and/or use ofinjection device 1. This information is displayed on thedisplay 21 for use by the user of the device and some of the information is transmitted wirelessly to another device. -
FIG. 4 shows the supplementary device andinjection device 1 being used in conjunction with amobile device 100 such as a smartphone. Themobile device 100 is programmed in a suitable way, for instance by being provided with asuitable software application 110. - In brief, the system of the supplementary device 2 and the
mobile device 100 function to display and record medicament dosage when theinjection device 1 is used. The supplementary device 2 communicates with themobile device 100 using acommunication interface 28 e.g. Bluetooth. The user interacts primarily with the supplementary device 2. Themobile device 100 serves primarily to provide information to the user and to record the user's injection history. The supplementary device 2 transmits data representing an image captured by thecamera 25 of the scene through thedosage window 13 to themobile device 100 via a predefined communication channel 111 (seeFIG. 4 ). Themobile device 100 performs Optical Character Recognition (OCR) processing to identify the selected medicament dosage from the image data received from the supplementary device 2. Themobile device 100 may identify the selected dose before and after dispensing, calculate the administered dosage, display the administered dose and makes a record of the administered dosage information. A time stamp may be added to the dosage information. A more detailed explanation of how the system is configured and functions is described below. - The camera image taken is stored in the
memory 241 of the supplementary device 2 together with a time stamp and information about the drug type. - Some of the internal components of the
mobile device 100 are shown inFIG. 5 . Themobile device 100 includes aprocessor 102. Theprocessor 102 controls operation of the other hardware components of themobile device 100. Theprocessor 102 and other hardware components may be connected via a system bus (not shown). Each hardware component may be connected to the system bus either directly or via an interface. - The
mobile device 100 comprises amemory 104, i.e. a working or volatile memory, such as Random Access Memory (RAM), and a non-volatile memory. The non-volatile memory stores anoperating system 108 and a medicamentadministration monitoring function 110, which advantageously is a distinct application, as well as storing data files and associated metadata. The medicamentadministration monitoring application 110 may be provided in themobile device 100 on manufacture or it may be down loaded into themobile device 100 by a user, for instance from an application market place or application store. - The
mobile device 100 comprises a display 112 (for instance an LCD, TFT (thin film transistor), OLED (organic light emitting diode), ePaper). The display may be a touch sensitive display having adisplay part 113 and atactile interface part 114. Themobile device 100 also includes acommunications interface 116, such as a Bluetooth interface. Themobile device 100 also houses abattery 118 to power themobile device 100 by apower supply 119. - The
processor 102 is configured to send and receive signals to and from the other components in order to control operation of the other components. For example, theprocessor 102 controls the display of content ondisplay 112 and receives signals as a result of user inputs fromtactile interface 114. Thedisplay 112 may be a resistive touch screen or capacitive touch screen of any kind. The display may alternatively not be a touch screen. For instance it may be a liquid crystal display (LCD). - The
mobile device 100 may be a mobile phone, PDA or tablet computer of any kind, or it may be a BGM (blood glucose meter) device. Other standard or optional components of themobile device 100, such as transceivers and cameras, are omitted. Theprocessor 102 may be an integrated circuit of any kind. Theprocessor 102 may access RAM in order to process data and may control the storage of data inmemory 104.Memory 104 may be a non-volatile memory of any kind such as a Read Only Memory (ROM), a flash memory and a magnetic drive memory. The RAM may be a RAM of any type, for example Static RAM (SRAM), Dynamic RAM (DRAM) or a Flash memory. - The
processor 102 operates under control of theoperating system 108. Theoperating system 108 may comprise code relating to hardware such as thedisplay 112 andcommunications interface 116, as well as the basic operation of themobile device 100. Theoperating system 108 may also cause activation of other software modules stored in thememory 104, such as the medicamentadministration monitoring function 110. -
FIG. 6 andFIG. 7 are flow charts illustrating operation of the supplementary device 2 and the mobile device 1 a respectively. The flow charts illustrate how the supplementary device 2 and themobile device 100 interact and operate as a system when theinjection device 1 is being utilised. The steps ofFIG. 6 are performed by theprocessor 24 of the supplementary device 2 under control of the software stored in thememory 240. - In
FIG. 6 , theoperation 600 starts for instance when the supplementary device 2 is turned on or is otherwise activated at 601. In astep 602, theprocessor 24 controls thecamera 25 to capture an image of the current dosage displayed on the number sleeve of theinjection device 1, as is visible through thedosage window 13 of theinjection device 1. This image is then caused to be displayed on theLCD display 21 of the supplementary device 2 in astep 603. The image is processed to some degree before display. In particular, the image may be resized so as to fit theLCD display 21. In the case of the camera having more pixels than theLCD display 21, resizing involves downscaling the image. Downscaling may comprise for instance selecting only some pixels of the captured image for display (and not displaying others), or averaging groups of pixels. The image advantageously is displayed in greyscale. This avoids the need for the supplementary device to perform processing of the image to detect boundaries of characters etc. It also reduces the possibility that the displayed image is significantly different from the scene in front of thecamera 25. Alternatively, the image may be displayed in black and white (without greyscale), or colour. - In a
step 604, it is checked whether a user input, indicating that a required dosage has been set, has been provided for instance by a button press on the supplementary device 2. If no button press is detected, the operation proceeds to step 614, where it is determined if thepower button 22 has been pressed. On a negative determination, the operation proceeds to step 615, where it is determined if there is a time out condition. The time out condition occurs when a timer that is reset and started when the supplementary device 2 powers on or when it is detected that thepower button 22 has been pressed has expired. A suitable value for the timer may be 60 or 120 seconds. On a negative determination fromstep 615, the operation returns to step 602, where a next image is captured and then displayed atstep 603. - On a positive determination from
step power button 22, the supplementary device 2 powers off and the operation ends atstep 616. This helps to minimise power consumption of the supplementary device but without impinging on operation when the user is interacting with the supplementary device 2 or theinjection device 1. - The sequence from
step 604 to step 614 to step 615 then to step 602 causes the supplementary device 2 to remain capturing images and displaying them until either thepower button 22 is pressed or the time out condition occurs or until it is determined atstep 604 that the confirm orOK button 34 to set dose has been pressed. This loop allows the user to set the required dosage by turning thedosage dial 12 on theinjection device 1 and reading the image containing the current dosage information displayed on theLCD display 21. Therein, if the power offbutton 22 press is detected instep 614, theprocessor 24 turns the supplementary device 2 off. If no power offbutton 22 press is detected but a timeout is reached instep 615, theprocessor 24 turns the supplementary device 2 off. - When the
processor 24 detects a confirm orOK button 34 press by the user to confirm that a required dosage has been set in 604, at step 605 a dose set condition is indicated on thedisplay 21 by theprocessor 24. Theprocessor 24 then controls thewireless unit 28 to transmit data representing the image of the currently dialled dose to themobile device 100 instep 606 for further processing. Advantageously, the data representing the image that is transmitted is the whole image, relating to all of the pixels and including a greyscale value for each pixel. Alternatively, there may be some pre-processing of the image before transmission. However, no optical character recognition is performed on the image before transmission. The transmitted data represents an image and is not indicative of a set dose other than the data being an image of the dose dialled into theinjection device 1 at the time the image was captured. The image may be compressed in a lossy or lossless manner before transmission time and communication resave initialisation. - In a
step 607, theprocessor 24 controls theLCD display 21 to display “Administering”. At this stage, the user may be administering (delivering) the dose dialled into theinjection device 1 before the confirm orOK button 34 to set dose was detected to be pressed atstep 604. -
Steps - In a
step 608, theprocessor 24 controls the camera to capture an image in front of the camera, which indicates the current dosage as visible in thedosage window 13. This image is then displayed on theLCD display 21 of the device in astep 609.Steps steps - When the injection process is complete, the user is expected to press a confirm or
OK button 34 on the supplementary device 2 to indicate “End dose” to theprocessor 24 atstep 610. If theprocessor 24 atstep 610 detects a confirm orOK button 34 press that indicates the “End dose”, it controls theLCD display 21 to display “Complete” in astep 611. In astep 612, the current image is transmitted to themobile device 100.Steps - Next it is determined at
step 613 whether thepower button 22 has been pressed. If it is detected atstep 613 that thepower button 22 has been pressed, the supplementary device 2 then turns off atstep 620. If not, it returns to step 602, where the image in front of thecamera 25 is captured before being displayed atstep 603. This repeats until the time out condition occurs or thepower button 22 is pressed. - If no confirm or
OK button 34 press is detected instep 610 the operation proceeds to step 617, where it is determined if thepower button 22 has been pressed. On a negative determination, the operation proceeds to step 618, where it is determined if there is a time out condition. The time out condition occurs when a timer that is reset and started when the supplementary device 2 powers on or when it is detected that thepower button 22 has been pressed has expired. A suitable value for the timer may be 60 or 120 seconds. On a negative determination fromstep 618, the operation returns to step 608, where a next image is captured and then displayed atstep 609. - On a positive determination from
step power button 22 or the time out condition has occurred, the supplementary device 2 transmits the current image to themobile device 100 and then powers off ending the operation atstep 620. This helps to minimise power consumption of the supplementary device 2 but without impinging on operation when the user is interacting with the supplementary device 2. Further, transmitting the current image to themobile device 100 at this stage i.e. before power off also ensures that the final dosage information is recorded on themobile device 100. This scenario could arise as a result of the user forgetting to press the confirm orOK button 34 atstep 610 to indicate “End dose” to theprocessor 24 after the injection process is complete. -
FIG. 7 is a flowchart of the method steps that are performed by themobile device 100 in conjunction with the method steps performed by the supplementary device 2 inFIG. 6 . In FIG. 7, theflowchart 700 starts atstep 701 for instance when the supplementary device 2 is turned on or is otherwise activated. Following transmission of the image data instep 606 ofFIG. 6 , instep 702 themobile device 100 receives the image data. This constitutes image data containing information of the medicament dosage set by the user and sent from the supplementary device 2. Instep 703, themobile device 100 performs optical character recognition processing on the received data. This can be performed in any suitable way. The optical character recognition involves processing the image of the number sleeve that is in the scene in front of thecamera 25 of the supplementary device 2 to identify the dose that is dialled into the supplementary device 2. The result is a number that represents the dialled dose, for instance in IU. The number may be provided by the optical character recognition process as an integer or it may be between integer numbers if the optical character recognition process is suitably configured. - After the dialled dose has been determined through the optical character recognition process, the
mobile device 100 is controlled by the medicament administration monitoring application to display the identified dialled or set dosage information to the user on thedisplay 113 atstep 704. The dialled dosage is displayed to the user on thedisplay 113 along with an indication that it is the dialled dose, not the dispensed dose, that is being displayed. The indication may take any suitable form. For example, the indication may comprise the word “selected”, “dialled”, or “set”, or any other text form suitable and/or common to indicate to a user that it is the dialled dose, not the dispensed dose that is being displayed. The text format comprises also any translation into a language that is being set in the device. The indication may comprise an image, such as a pictogram suitable and/or common to indicate to a user that it is the dialled dose, not the dispensed dose that is being displayed. The image indication may be provided as alternative or in combination with a text-based indication. - At
step 705, themobile device 100 determines whether a delivered dose image has been received from the supplemental device 2. If no delivered dose image data has been received, themobile device 100 returns to step 704, where the dialled dose is again displayed. This repeats until a delivered dose image is received from the supplemental device 2. - If the
mobile device 100 determines atstep 705 that it has received delivered dose image data containing information of the final dose after the injection has been administered, it performs optical recognition processing on the delivered dose image data atstep 706, in any suitable way. This results in a number that indicates the dialled dose after injection/delivery. Themobile device 100 then calculates atstep 707 the delivered dose using the dialled and final dose information received from the supplementary device 2, in particular by subtracting the dose shown after delivery from the dose shown before delivery. Alternatively, if it is detected or assumed that the final dose is zero, this can be omitted. The calculated delivered dose information is displayed to the user on themobile device 100 by the medicamentadministration monitoring application 110 in astep 708. The delivered dose information is then stored in thememory 104 of themobile device 100 atstep 709 before the operation ends atstep 710. - The storage of the dose information at
step 709 constitutes a record of the medicament administration. The record includes the time or time and date of administration, taken from the internal clock of themobile device 100, the dose delivered and optionally other information provided by the user such as a blood glucose measurement taken before the medicament delivery, the type of medicament etc. This allows a complete record of the medicament intake of the user to be recorded by themobile device 100 without requiring the user to enter the dialled, post-delivered or delivered dose. - Operation of the system will now be described from the users perspective.
- The user begins by turning on the supplementary device 2 (which requires one press of the power button 22) and opening or initiating the medicament
administration monitoring application 110 on themobile device 100. Next, acommunications channel 111 between the supplementary device 2 and themobile device 100 is established. This can be achieved by the user pressing thecommunications button 33 on the supplementary device 2. In this case, the user may need to interact with the medicamentadministration monitoring application 110 on themobile device 100 to allow the connection to be established, or connection may be automatic if the devices have been suitably configured, for instance through Bluetooth pairing. Alternatively, a communications link between the supplementary device 2 and themobile device 100 may be established without requiring any user input, for instance in response to the supplementary device 2 being powered on. The receipt by themobile device 100 of a signal from the supplemental device 2 may cause themobile device 100 to launch the medicamentadministration monitoring application 110 on themobile device 100. - When turned on, the current dosage on the
injection device 1 is displayed to the user on the supplementary device 2LCD display 21. The user can now set the required medicament dosage by turning thedosage dial 12 on theinjection device 1 while reading the current dosage reading on theLCD display 21. - When the required medicament dosage is set, the user presses the confirm or
OK button 34 on the supplementary device 2. At this time, the supplementary device 2 is displaying the medicament dose on theLCD display 21. The medicamentadministration monitoring application 110 on themobile device 100 then displays the dosage set by the user on themobile device 100 display. The user is now able to double-check that the correct dose has been recognised by themobile device 100. However, the user does not need to check themobile device 100 at this stage. - After a short time, the display of the
LCD display 21 on the supplementary device 2 then changes to indicate that the dose has been set. Before or after this change in display, the user can start to inject the medicament. As the medicament is administered, the dosage reading on theLCD display 21 changes as the dose indicated on the part of the number sleeve of theinjection device 1 in front of the camera changes. When the injection process is complete, the user may press the confirm orOK button 34 again or may allow the timer to timeout. The supplementary device 2LCD display 21 then changes to display “Complete”. The supplementary device 2 at this time displays the remaining dosage in theinjection device 1 on theLCD display 21. The remaining dose typically is zero but it may be higher if the user did not complete the injection. - Next, the mobile medicament
administration monitoring application 110 displays the administered dose on the mobile device display, and may also display the final dialled dose to allow the user to check that themobile device 100 has registered the correct final dialled dose. The medicamentadministration monitoring application 110 on themobile device 100 also displays a message indicating that a record relating to the administered dosage has been created and stored. - Further, advantageously HDR images are captured by the
image capturing device 25 in order to contribute to a high contrast of the dosage information so that binarization and OCR calculation in themobile device 100 is improved. - The scope of the disclosure is not limited to the above-described embodiments and various alternatives will be envisaged by the skilled person. Further alternatives will now be described.
- In
FIG. 2b , thecommunications button 33 can be omitted from the supplementary device. When thepower button 22 is pressed, the supplementary device 2 can turn on and automatically establish connection with themobile device 100. This simplifies the function of the supplementary device 2 and allows it to have fewer hardware buttons. - At
step 608, themobile device 100 may display both the dose dialled into theinjection device 1 after delivery and the calculated dose. This can allow the user to check the dialled dose calculated by themobile device 100 against the dose displayed on theLCD display 21 of the supplementary device 2. Themobile device 100, through the medicamentadministration monitoring application 110, may allow the user to vary the dialled dose from that calculated by the optical character recognition process. This can allow the record of medicament administration recorded in themobile device 100 to be more accurate than otherwise. - Instead of transmitting image data only in response to a user input on the supplementary device 2, operation may differ. For instance, image data may be transmitted continually or frequently to the
mobile device 100, and the mobile device may then display the dialled dose as dialling occurs and/or as injecting occurs. In this case, the user input indicating that the dose has been set may be made on themobile device 100 instead of on the supplementary device 2. In this case, the user can check the dialled dose indicated on the mobile device 100 (which has been subjected to optical character recognition) against the image displayed on theLCD display 21 of the supplementary device 2. Similarly, the user indicating that the injection has completed may be made on themobile device 100 instead of the supplemental device 2. Alternatively, both the supplemental device 2 and themobile device 100 may be configured to receive the dose set user input and/or the injection complete user input, thereby allowing the user more choices for using the system. - The indication that the dose has been set may be made alternatively or additionally on the mobile device. The same applies to the indication that the dose has been delivered. In the above, the image data is sent to the mobile device during the dose delivery process.
- Alternatively, the image data may be stored in the
memory 241 of the supplementary device 2 and transmitted to themobile device 100 at a later time, for instance minutes, hours or tens of hours later. Transmission to the mobile device may include images for two or more dose deliveries. - The supplemental device 2 may include a means for detecting the medicament included in the
injection device 1. This may take the form of a colour sensor that is configured to detect the colour of a label on the injection pen, the label colour indicating the type of medicament contained.
Claims (30)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US17/385,535 US20210353871A1 (en) | 2014-06-27 | 2021-07-26 | Monitoring system and method |
Applications Claiming Priority (6)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP14174717.0 | 2014-06-27 | ||
EP14174717 | 2014-06-27 | ||
PCT/EP2015/064348 WO2015197749A1 (en) | 2014-06-27 | 2015-06-25 | A monitoring system and method |
US201615320156A | 2016-12-19 | 2016-12-19 | |
US17/138,273 US20210330889A1 (en) | 2014-06-27 | 2020-12-30 | Monitoring system and method |
US17/385,535 US20210353871A1 (en) | 2014-06-27 | 2021-07-26 | Monitoring system and method |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/138,273 Continuation US20210330889A1 (en) | 2014-06-27 | 2020-12-30 | Monitoring system and method |
Publications (1)
Publication Number | Publication Date |
---|---|
US20210353871A1 true US20210353871A1 (en) | 2021-11-18 |
Family
ID=51257258
Family Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/320,156 Active 2036-03-31 US10909217B2 (en) | 2014-06-27 | 2015-06-25 | Monitoring system and method |
US17/138,273 Pending US20210330889A1 (en) | 2014-06-27 | 2020-12-30 | Monitoring system and method |
US17/385,535 Pending US20210353871A1 (en) | 2014-06-27 | 2021-07-26 | Monitoring system and method |
Family Applications Before (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/320,156 Active 2036-03-31 US10909217B2 (en) | 2014-06-27 | 2015-06-25 | Monitoring system and method |
US17/138,273 Pending US20210330889A1 (en) | 2014-06-27 | 2020-12-30 | Monitoring system and method |
Country Status (7)
Country | Link |
---|---|
US (3) | US10909217B2 (en) |
EP (1) | EP3161693B1 (en) |
JP (1) | JP6736482B2 (en) |
CN (1) | CN106687961B (en) |
DK (1) | DK3161693T3 (en) |
TW (1) | TW201613658A (en) |
WO (1) | WO2015197749A1 (en) |
Families Citing this family (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10864327B2 (en) | 2016-01-29 | 2020-12-15 | Companion Medical, Inc. | Automatic medication delivery tracking |
EP3448457B1 (en) * | 2016-04-28 | 2024-01-17 | Embecta Corp. | Smart medication delivery devices for providing users with delivery infomatics and methods of using same |
US11464447B2 (en) | 2016-06-30 | 2022-10-11 | Novo Nordisk A/S | Regimen adherence measure for insulin treatment based on glucose measurements and insulin pen data |
CN109789281A (en) * | 2016-10-14 | 2019-05-21 | 艾斯曲尔医疗公司 | For the casing member of medicament delivery device, the auxiliary unit for being attached to casing member and including the medicament delivery device of casing member |
EP3612976A4 (en) * | 2017-04-20 | 2021-01-06 | Becton, Dickinson and Company | Smartphone app for dose capture and method |
US20190053985A1 (en) * | 2017-08-17 | 2019-02-21 | Qualcomm Incorporated | Expiration date indicator for hypodermic needle devices |
CN111630609A (en) | 2017-11-15 | 2020-09-04 | 赛诺菲 | System and method for supporting use of an injection device |
TWI672017B (en) * | 2017-11-16 | 2019-09-11 | 緯創資通股份有限公司 | Monitoring apparatus, monitoring system and monitoring method |
EP3724891A1 (en) | 2017-12-12 | 2020-10-21 | Bigfoot Biomedical, Inc. | Medicine injection and disease management systems, devices, and methods |
US10987464B2 (en) | 2017-12-12 | 2021-04-27 | Bigfoot Biomedical, Inc. | Pen cap for insulin injection pens and associated methods and systems |
US11077243B2 (en) | 2017-12-12 | 2021-08-03 | Bigfoot Biomedical, Inc. | Devices, systems, and methods for estimating active medication from injections |
US11116899B2 (en) | 2017-12-12 | 2021-09-14 | Bigfoot Biomedical, Inc. | User interface for diabetes management systems and devices |
US11464459B2 (en) | 2017-12-12 | 2022-10-11 | Bigfoot Biomedical, Inc. | User interface for diabetes management systems including flash glucose monitor |
JP2020103621A (en) * | 2018-12-27 | 2020-07-09 | 之博 矢萩 | Medical agent-holding molded body, syringe, and medical agent holding container |
CA3160698A1 (en) * | 2019-02-27 | 2020-09-03 | Jay Mark FRIEDLANDER | Medication delivery device with sensing system |
US11948671B2 (en) | 2019-04-11 | 2024-04-02 | Medtronic Minimed, Inc. | Intelligent accessories for medicine dispensing device |
EP4029025A1 (en) | 2019-09-10 | 2022-07-20 | Sanofi | A monitoring system and method |
US20230033566A1 (en) * | 2019-10-28 | 2023-02-02 | Sanofi | Auxiliary Device and Reminder System for a Drug Delivery Device |
WO2022191603A1 (en) * | 2021-03-09 | 2022-09-15 | 주식회사 엘지화학 | System for managing drug administration, and operation method thereof |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20140140530A1 (en) * | 2012-11-19 | 2014-05-22 | Glenn Gomes-Casseres | Proximity Based Wireless Audio Connection |
US20150126963A1 (en) * | 2013-11-01 | 2015-05-07 | Becton, Dickinson And Company | Injection device configured to mate with a mobile device |
US20150296167A1 (en) * | 2014-04-09 | 2015-10-15 | Alibaba Group Holding Limited | Method and system for communication |
US20150365738A1 (en) * | 2014-01-09 | 2015-12-17 | Rick Purvis | Telemetry arrangements for implantable devices |
US20170032211A1 (en) * | 2014-01-24 | 2017-02-02 | Sanofi-Aventis Deutschland Gmbh | Supplemental device for attachment to an injection device for recording and displaying a dose value set by the user using optical character recognition (ocr) |
US20170136178A1 (en) * | 2007-12-31 | 2017-05-18 | Deka Products Limited Partnership | Wearable pump assembly |
Family Cites Families (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8808228B2 (en) * | 2004-02-26 | 2014-08-19 | Dexcom, Inc. | Integrated medicament delivery device for use with continuous analyte sensor |
US8648716B2 (en) * | 2005-10-07 | 2014-02-11 | Barcoding, Inc. | Apparatus, method, device and computer program product for audibly communicating medicine identity, dosage and intake instruction |
CA2700169A1 (en) | 2007-09-18 | 2009-03-26 | Telexmedica Ab | Method and system for providing remote healthcare |
US20100286612A1 (en) * | 2009-05-06 | 2010-11-11 | William Cirillo | Medication injection supervisor device |
US8394053B2 (en) * | 2009-11-06 | 2013-03-12 | Crisi Medical Systems, Inc. | Medication injection site and data collection system |
JP2013521832A (en) * | 2010-03-15 | 2013-06-13 | ヒューズ,ジョン | Drug injection monitoring device |
TW201808357A (en) | 2010-03-22 | 2018-03-16 | 賽諾菲阿凡提斯德意志有限公司 | Device, method, system and computer program for drtermining information related to a medical device |
US20130191140A1 (en) * | 2010-09-29 | 2013-07-25 | Caring In Place Inc. | Caregiver processes and systems |
EP2729201A1 (en) | 2011-07-07 | 2014-05-14 | Novo Nordisk A/S | Drug delivery injection pen with add-on dose capturing and display module |
JP6305939B2 (en) * | 2012-02-13 | 2018-04-04 | サノフィ−アベンティス・ドイチュラント・ゲゼルシャフト・ミット・ベシュレンクテル・ハフツング | Auxiliary device attached to injection device |
US8822847B2 (en) * | 2012-03-11 | 2014-09-02 | Monique S. Vidal | Digital scale able to measure human weight and determine suitable dosage of a medicament |
KR20130140301A (en) * | 2012-06-14 | 2013-12-24 | 삼성전자주식회사 | Device for measuring dose in injector |
EP2911717B1 (en) * | 2012-10-23 | 2019-05-22 | Insuline Medical Ltd. | Drug dispensing-tracking device, system and method |
US20140155827A1 (en) * | 2012-12-03 | 2014-06-05 | Mylan, Inc. | Medicament information system and method |
ES2799305T3 (en) * | 2013-03-15 | 2020-12-16 | Becton Dickinson Co | Smart adapter for infusion devices |
CN106456884A (en) * | 2014-03-14 | 2017-02-22 | 卡贝欧洲有限公司 | A monitoring device |
-
2015
- 2015-06-25 EP EP15732218.1A patent/EP3161693B1/en active Active
- 2015-06-25 CN CN201580045408.3A patent/CN106687961B/en active Active
- 2015-06-25 JP JP2016575575A patent/JP6736482B2/en active Active
- 2015-06-25 US US15/320,156 patent/US10909217B2/en active Active
- 2015-06-25 DK DK15732218.1T patent/DK3161693T3/en active
- 2015-06-25 WO PCT/EP2015/064348 patent/WO2015197749A1/en active Application Filing
- 2015-06-25 TW TW104120427A patent/TW201613658A/en unknown
-
2020
- 2020-12-30 US US17/138,273 patent/US20210330889A1/en active Pending
-
2021
- 2021-07-26 US US17/385,535 patent/US20210353871A1/en active Pending
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20170136178A1 (en) * | 2007-12-31 | 2017-05-18 | Deka Products Limited Partnership | Wearable pump assembly |
US20140140530A1 (en) * | 2012-11-19 | 2014-05-22 | Glenn Gomes-Casseres | Proximity Based Wireless Audio Connection |
US20150126963A1 (en) * | 2013-11-01 | 2015-05-07 | Becton, Dickinson And Company | Injection device configured to mate with a mobile device |
US20150365738A1 (en) * | 2014-01-09 | 2015-12-17 | Rick Purvis | Telemetry arrangements for implantable devices |
US20170032211A1 (en) * | 2014-01-24 | 2017-02-02 | Sanofi-Aventis Deutschland Gmbh | Supplemental device for attachment to an injection device for recording and displaying a dose value set by the user using optical character recognition (ocr) |
US20150296167A1 (en) * | 2014-04-09 | 2015-10-15 | Alibaba Group Holding Limited | Method and system for communication |
Also Published As
Publication number | Publication date |
---|---|
CN106687961A (en) | 2017-05-17 |
DK3161693T3 (en) | 2021-07-12 |
WO2015197749A1 (en) | 2015-12-30 |
US10909217B2 (en) | 2021-02-02 |
US20170132392A1 (en) | 2017-05-11 |
JP6736482B2 (en) | 2020-08-05 |
EP3161693B1 (en) | 2021-04-14 |
US20210330889A1 (en) | 2021-10-28 |
EP3161693A1 (en) | 2017-05-03 |
CN106687961B (en) | 2021-06-11 |
JP2017524427A (en) | 2017-08-31 |
TW201613658A (en) | 2016-04-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20210353871A1 (en) | Monitoring system and method | |
US11623046B2 (en) | Apparatus for recording information concerning the use of an injection device | |
EP3258993B1 (en) | Supplemental device for removable attachment to a medicament injection device | |
JP2014531254A (en) | Medical system configured to collect and transfer data | |
US10518034B2 (en) | Apparatus for capturing and processing images | |
WO2014111336A1 (en) | Pen-type drug injection device and electronic add-on monitoring module for monitoring and logging dose setting and administration |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STPP | Information on status: patent application and granting procedure in general |
Free format text: SPECIAL NEW |
|
AS | Assignment |
Owner name: SANOFI-AVENTIS DEUTSCHLAND GMBH, GERMANY Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:GERKEN, TILL;REEL/FRAME:057918/0437 Effective date: 20150717 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: ADVISORY ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: ADVISORY ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |