AU2021102001A4 - AI and IoT enabled Smart Medicine Box - Google Patents

Abstract

"Al and IoT enabled Smart Medicine Box" Exemplary aspects of the present disclosure are directed towards Al and IoT enabled Smart Medicine Box, consisting of a medicine box 101 with a plurality of compartments 101a, a plurality of Medicin Monitoring Device (MMD) 102 and microcontroller set up 103. Where in Medicine Monitoring Device (MMD) 102 constitutes, a strain-gauge 102b, Peltier-module 102c, heat-sink 102d, temperature-sensor 101e, camera 101f and micro-fan 102g. Further, Microcontroller 103a can execute a related Machine Learning Algorithm (MLA) to identify the type of medicine and provide a specific temperature to it using Peltier-module 102c. Similarly, Microcontroller 103a uses a related Machine Learning Algorithm (MLA) to predict the type of medicine, quantity, usage frequency, medicine reminder, specific temperature, and alert the user for replenishing medicine through the Internet things (IoT) communication protocol. FIG 1 Sheet 1 of 5 102f CAMERA 101 /--------------/ 102 102e I /i ea 100AIlandlIoT enabled Smart Medicine Box

Description

Sheet 1 of 5

102f

CAMERA

101

/--------------/

102

102e

I /i

ea

100AIlandlIoT enabled Smart Medicine Box

1. TITLE OF THE INVENTION: " Al and IoT enabled Smart Medicine Box"

2. PREAMBLE TO THE DESCRIPTION

The following specification particularly describes the invention and the manner in which it is to be performed

3. DESCRIPTION

TECHNICAL FIELD

[0001] The present disclosure generally relates to the medicine pill management system, particularly detecting type, frequency of usage, and quantity existing in a medicine container.

BACKGROUND

[0002] Globalization had made the elderly look for themselves, and in the wake of the pandemic, home isolation became prevalent for mild and moderate infections. The pandemic also made familiarity with telemedicine to everyone, and it is playing a vital role for people in home isolation. Peoples under home isolation or home quarantine need frequent medication and supervision, which is a very complicated and tedious job to the health assistants who are monitoring them.

[0003] Though several alarm systems and mechanisms are in place, they have their disadvantages to monitor the persons kept under home isolation or home quarantine. Most of the designs are either stand-alone or work through a Cloud platform.

[0004] Numerous prior arts have made attempts to automate medicine reminder and storing mechanisms but layed their own disadvantages over the path.

[0005] Similarly, several prior art disclosures have ascertained the best devices and practices for patient and medicine monitering systems by using RFID, WiFi, GPRS, some type of sensors, etc.

Page 1 of 12

[0006] Articles in the prior art W02017121309A1 discloses a smart medicine box, comprising a box body (1) and a lid (2) connected to the upper part of the box body (1), a continuous medicine bag (3) being arranged inside the box body (1) and being used together with same, the continuous medicine bag (3) being a point cut-off type, one side of the box body (1) being provided with a medicine dispensing opening (4), and a probe head (5), a PCB (6), and a power source (7) being arranged on the lid (2), the probe head (5) being arranged near to the side provided with the medicine dispensing opening (4) on the box body (1), and a probe area (8) used together with the probe head (5) being arranged on the medicine bag (3). The present smart medicine box has the following advantage: medicine bag tracking can be implemented according to a specific medicine plan by means of packaging the medicine taken by the patient each time.

[0007] In the prior art US9311452B2 with title Electronic pill box and medication reminder and compliance system incorporating same disclosed an invention containing a pill box and electronic device; or a pill box, electronic device and remote server. The pill box includes several detachable dosettes, each divided into several chambers having a door. A two-color LED is disposed beneath each chamber and is activated when a specific reminder time is reached. The LED initially illuminates the associated chamber with a green light but changes to a flashing red light if the door is not opened within a preset time. A switch engaged with the door deactivates the LED when the door is opened. The electronic device communicates with the pill box and alerts the patient when it is time to take medication. A remote server which communicates with both the pill box and electronic device can be programmed to control the reminder schedule and monitor the patient's compliance with a prescribed medication regimen.

[0008] Another Prior art CN202314323U explained invention relates to convenient medicine box, which is used to-be-taken medicine tablets for one day or several days are intensively sub-packaged and placed so as to simplify each medicine-taking process, so that the convenient medicine box is especially suitable for being used for dispensing medicines for patients by nurses, and also suitable for being used by old people or children taking medicines.

Page 2 of 12

[0009] Similar prior art US5020037A - invention discloses an alarm pill box (11) has an alarm cancelled by the opening of a lid (12) to provide access to at least one medication compartment (16,17). An electronic memory is responsive to the cancellation of the alarm and records each cancellation. An associated indicator display (23) provides a visual indication of each record. Additionally, or alternatively, timer adjustment controls are inactive to adjust instant or alarm times when the lid (12) is closed, thereby requiring the lid (12) to be open in order to adjust the times.

[0010] In Prior art with CN107480851A title A kind of intelligent health management system based on endowment robot emphasized on kind of intelligent health management system based on endowment robot, including endowment robot, remote terminal and Cloud Server, endowment robot includes alarm set and the detection means being connected with each other, alarm set is according to default medical scheme, path planning is opened with locomotive function and old man is found based on face recognition technology and sound source location technology, and is linked up by interactive voice technology and old man and reports reminded contents.

[0011] CN206684755U discloses a system kind of medication monitoring management system based on RFID technique, including intelligent medicine box, data management platform and intelligent terminal, intelligent medicine box includes medicine -chest casing and inside is provided with least one accommodating chamber, closing medicine bottle is provided with accommodating chamber, the bottom of closing medicine bottle is provided with the first RFID label tag, the bottom of medicine-chest casing is provided with RFID reader and the single-chip microcomputer with communication interface, is electrically connected between RFID reader and single-chip microcompute.

[0012] An prior art document CN106790236A discloses system for The embodiment of the present invention is optimized to the therapeutic regimen of patient according to patient medication information and daily schedule information, audited, help patient on time, according to quantity, reasonably medication, for drug combination taboo, artificial medicine thing service is provided situations such as patient misses medicine. beam identifying feature of said reflected illumination detected

Page 3 of 12

[0013] Another prior art document W02017185795Al describes a pill-taking reminder device and method for a patient with heart disease. The device comprises a pillbox body (1) and a pillbox lid (2). The pillbox body (1) comprises an electronic lock (10), a first pill groove (11), a second pill groove (12), a third pill groove (13), a first indicator lamp (14), a second indicator lamp (15), a third indicator lamp (16), and a pulse sensor (17). The pill-taking reminder device for a patient with heart disease is able to remind a patient to take appropriate pills and remind the patient of dosage information according to the current heart rate of the patient.

[0014] Another prior art document CN205451188U discloses an invention which has the advantages of being scientific and reasonable in structure, the safe convenient timely prevent disease of operation can be for the individual health care suggestion effects such as prompt facility, recording time of taking medicine through mobile terminal, are fit for the scheme of individual characteristic, improve health health care doctor's level.

[0015] Referring to another document, CN105708701A discloses a method which has the advantages that when the patient takes medicine every time, the medicines in the second medicine box are all got out and taken, so that the patient with unclear consciousness can be enabled to get medicines and take medicines accurately, and the phenomena of not getting all medicines, taking fewer medicines and taking more medicines are prevented.

[0016] US20170087059A1 document titled Pill management and health monitoring system discloses a system and method for the dispensing of medication in the form of pills and also to monitor health parameters is disclosed. The system comprises a modular system having a main control module; a plurality of pill dispensing modules in communication with the main control module; and optionally sensors to measure health parameters in communication with the main control module. The main control module can store information and also can communicate information over a communications network. .

[0017] CN205321523U, presented an invention the utility model discloses the structure can satisfy household medicine box's storage medicine well and deposit small -size medical instrument's function, is provided with the trick lock simultaneously and can protects child can not contact the medicine well, be equipped with the time alarm device and can remind old

Page 4 of 12 man's application medicine well, and sterilizing installation wherein can guarantee the security of medicine well.

[0018] In an eraly document CN205145126U, titled Choker portable intelligent medicine box is small and exquisite, can hang on the neck as the necklace, and when the medicine box sent the pronunciation warning, the old person closely, very conveniently heard and takes medicine on time, has improved patient's compliance, three little medicine box adopts different colours, in order early in, late medicine, easily difference of splendid attire respectively. .

[0019] In a prior document by Stefan Oniga, titled Advanced Medication Dispenser disclosed a smart medication container is "smart" as it holds the medication dispensing parameters for the drugs it contains: dispensing time and date and name. Based on this information, the actual dispensing is done.

[0020] In an invention stated in a document by Wissam Antoun et al., titled Smart Medicine Dispenser system is to help the patients, primarily seniors, take their medications on time in an easy way without the possibility of missing pills, also reduce the risk of over or under dosing accidentally. Not taking medications correctly can have serious consequences such as delayed recovery, illness and even death. The smart medicine dispenser (SMD) could solve such problems by informing and alerting the patients to take the appropriate dose at the right time. Also, it provides direct communication between the patients and the caregivers as it will immediately notify the caregiver in case the patient missed his/her pill. In addition, SMD provides the user with a touch interface available as an application on their smartphone, allowing them to manage and control pill schedules and usage data remotely.

[0021] The present invention provides an effective medication management system in coordination with a machine learning algorithm implemented in a single-chip low-cost microcontroller.

[0022] The present invention addresses the shortcomings mentioned above of the prior art.

Page 5 of 12

[0023] All publications herein are incorporated by reference to the same extent as if each publication or patent application were specifically and individually indicated to be incorporated by reference. Where a definition or use of a term in an incorporated reference is inconsistent or contrary to the definition of that term provided herein, the definition of that term provided herein applies, and the definition of that term in the reference does not apply.

SUMMARY

[0024] The following presents a simplified summary of the disclosure in order to provide a basic understanding of the reader. This summary is not an extensive overview of the disclosure, and it does not identify key/critical elements of the invention or delineate the scope of the invention. Its sole purpose is to present some concepts disclosed herein in a simplified form as a prelude to the more detailed description that is presented later.

[0025] Exemplary embodiments of the present disclosure are directed towards the Al and IoT enabled Smart Medicine Box

[0026] An exemplary object of the present disclosure is directed towards the integration of microcontroller 103a with camera 102f to read the bar code of medicine kept in each compartment.

[0027] Another exemplary aspect of the present disclosure directed towards the structure of medicine container wherein the container consists of a plurality of compartments with a single lid. Sigle lid comprises of camera 102f situated within specific height to capture medicine bar code in all compartment.

[0028] Another exemplary object of the present disclosure is directed towards the integration of microcontroller 103a with strain gauge 102b and MLA(Machine Learning Algorithm) for identifying medicine quantity in each compartment.

[0029] Another exemplary object of the present disclosure is directed towards a system that automatically detects the type of medicine and sets the temperature of the compartment.

Page 6 of 12

[0030] Another exemplary aspect of the present disclosure directed towards the integration of microcontroller 103a with a plurality of Peltier module 102c and corresponding MLA for producing the required temperature in the individual compartment.

[0031] An exemplary aspect of the present subject matter is directed towards the integration of microcontroller 103a with camera 102f for identifying the registered user and intimate the user for unauthorized usage.

[0032] An exemplary aspect of the present subject matter is directed towards the use of microcontroller 103a with camera 102f and corresponding MLA for identifying the user and their medicine usage frequency.

[0033] An exemplary aspect of the present subject matter is directed towards the implementation of a user reminder system based on usage frequency.

[0034] Another exemplary aspect of the present disclosure is directed towards intimation of the user about medicine in each compartment, medicine depletion, the temperature in each compartment, unauthorized access, medicine reminder in Blynk Mobile App 104.

[0034] Another exemplary aspect of the present disclosure is directed towards the integration of microcontroller 103a with the Blynk Mobile App 104 through communication media 105. Wherein communication media 105 is WiFi Mesh Network, Low Energy Bluetooth (BLE) or Radio Frequency (RF).

Brief Description of the Drawings

[0036] In the following, numerous specific details are set forth to provide a thorough description of various embodiments. Certain embodiments may be practiced without these specific details or with some variations in detail. In some instances, certain features are described in less detail so as not to obscure other aspects. The level of detail associated with each of the elements or features should not be construed to qualify the novelty or importance of one feature over the others.

Page 7 of 12

[0037] FIG.1 is a diagram depicting Al and IoT enabled Smart Medicine Box, according to an exemplary embodiment of the present disclosure.

[0038] FIG. 2 is a Block diagram 102 for the Control Circuit Layout Of Medicine Monitoring Device (MMD) according to an exemplary embodiment of the present disclosure.

[0039] FIG. 3 is a flow chart 300 depicting the process executed in Medicine Monitoring Device (MMD) for maintaining temperature in each compartment.

[0040] FIG. 4 is a flow chart 400 depicting the process executed in Medicine Monitoring Device (MMD) for monitoring the quantity of medicine, according to an exemplary embodiment of the present disclosure.

[0041] FIG. 5 is a flow chart 500 depicting the process of execution by microcontroller 102b for medicine reminder.

Detailed Description of Example Embodiments

[0042] It is to be understood that the present disclosure is not limited in its application to the details of construction and the arrangement of components outlined in the following description or illustrated in the drawings. The present disclosure is capable of other embodiments and of being practiced or of being carried out in various ways. Also, it is to be understood that the phraseology and terminology used herein is for the purpose of description and should not be regarded as limiting.

[0043] The use of "including", "comprising" or "having" and variations thereof herein is meant to encompass the items listed thereafter and equivalents thereof as well as additional items. The terms "a" and "an" herein do not denote a limitation of quantity, but rather denote the presence of at least one of the referenced item. Further, the use of terms "first", "second", and "third", and the like, herein do not denote any order, quantity, or importance, but rather are used to distinguish one element from another.

Page 8 of 12

[0044] Referring to FIG. 1 is a diagram depicting an Al and IoT enabled Smart Medicine Box consisting of a medicine box 101 with a plurality of compartments and each compartment contains Medicine Monitoring Device (MMD) 102 connected to microcontroller 103a. The function of MMD, along with microcontroller 103a to identify the medicines in each of the compartments in a container with the help of camera 102f and concerned Machine Learning Algorithm (MLA). The microcontroller 103a reads the bar code of the medicine present in each container and stores the data along with compartment ID. The microcontroller 103a capable of executing MLA, and not only determines the medicine in each compartment of the container but also capable of identifying the exact temperature for particular medicine in each compartment.

[0045] Further to it, based on the predicted temperature of each compartment, microcontrollers 103a regulates on/off time of the concerned Peltier module 102c of that compartment. The on and off time depends on the temperature either set by the user or predicted temperature by concerned MLA. Once the temperature reach set value, then the microcontroller 103a turn off the supply to the concerned Peltier module 102c vice versa if the temperature decreases. The integration of microcontroller 103a with the plurality of strain gauge 102b, to determine usage of medicine, the quantity of medicine in each compartment.

[0046] In accordance with a non-limiting exemplary embodiment of the present subject matter, FIG. 2 is a representation of the Control Circuit Layout Of Medicine Monitoring Device (MMD). As depicted in the drawings of FIG 2, microcontroller 103a connected to MMD 102 consists of, camera module 102f, strain gauge 102b, Peltier module 102c, temperature sensor 102e, micro fan 102g and heat sink 102d. The microcontroller 103a is a single-chip microcontroller with Long Range (LoRa) WiFi-enabled and capable of interacting with other WiFi devices through LoRa communication, specifically in the WiFi Mesh network eliminating the necessity of routers and other gateways. Microcontroller 103a detects the user by camera 102f. Microcontroller 103a compares the stored picture with the operator, and if found any discrepancy, it alerts the user in Blynk Mobile App 104 through communication media 105. If authenticated the user, microcontroller 103a monitors the plurality of strain gauges 102b present in each compartment of the container. The change in the plurality of strain gauges 102b values after one day of usage fed to concerned MLA to predict 1) quantity of medicine available and used 2) determine the usage frequency.

Page 9 of 12

Parameters determined, transmitted to the user through communication media 105 to display and send an alert in Blynk Mobile App 104.

[0047] Referring to FIG 3 is a flow chart 300 depicting the Process executed for maintaining temperature in each compartment by Medicine Monitoring Device (MMD). The first step starts at 301, wherein microcontroller 103b acquire medicine information by reading the barcode/name label on the medicine through camera 102f. Computed the name of the medicine, the microcontroller 103a goes to next step 302, wherein microcontroller 103a ascertain which medicine kept in which compartment of the container. The camera 102f identifies the exact positioning of the medicine, and then microcontroller 103a assigns and saves the ID of the compartment to a particular medicine. In the next step 303, microcontroller 103a feed the data to the concerned Machine Learning Algorithm (MLA) to predict the temperature maintained in a particular compartment. The temperature is varied by turn on/off the supply to Peltier module in each compartment. The temperature of the compartment set as per step 303. In next step 304, if the user specifies the temperature in Blybk Mobile App 104 then, microcontroller 103a feed the set temperature value to concerned MLA to determine the on/off states for regulating power supply to Peltier Module 102c. Microcontroller 103a in step 305 selects the temperature predicted from step 303 in the absence of user-set value in step 304. The temperature maintained with the same value until the end of step 305. In step 306, if strain gauge value read either zero or low, then microcontroller 103a switch of power supply to that particular compartments Peltier Module 102b.

[0048] In accordance with a non-limiting exemplary embodiment of the present subject matter, FIG. 4 is a flow chart 400 depicting the process executed for monitoring quantity of medicine. The process starts at 401, where the microcontroller 103a through camera 102f acquire medicine information by reading the barcode/name label on the medicine. After Computing the name of the medicine, the microcontroller 103a goes to next step 402 wherein microcontroller 103a ascertain which medicine kept in which compartment of the container. In this step, the camera 102f identifies the exact positioning of the medicine, and then microcontroller 103a assigns and saves the ID of the compartment to a particular medicine. In consequent step 403, the values from strain gauge placed under each compartment before and after use ( Usage of the container means camera 102f capturing a

Page 10 of 12 black picture and user image) fed to Machine Learning Algorithm to ascertain the quantity in each compartment. Generally, form each compartment the set of strain gauge values with compartment ID, time stamping, normalized and cleansed data is aggregated to match the MLA data input format and this data is fed to MLA.

[0049] Further, the flow chart 400 continues to step 404; microcontroller 103a labels the quantity of medicine present in each compartment based on the predicted data in step 403. In step 405, microcontroller 103a update the data and intimate the user in Blynk Mobile App 104 through communication media 105. Blynk Mobile App consists of GUI where in all the compartments temperature and medicine quantity displayed. In the subsequent step 406, if microcontroller 103a concludes from step 405, that medicine depleted or strain gauge reads low value intimate the user in Blynk Mobile App 104 through communication Media 105 about low medicine levels in the relevant compartment and go to step 301 and continue the process.

[0050] According to a non-limiting exemplary embodiment of the present disclosure, FIG.5 is a flow chart 500 depicting the process of execution by Microcontroller 103a for setting Medicine reminder. Where the process starts at 501, the microcontroller 103a acquire the medicine quantity present in each compartment by calling in data from Blynk Mobile App 104. After computing the name of the medicine and quantity in each compartment, the microcontroller 103a goes to next step 502. The next step, 502 commences immediately after the user access the container. Wherein the microcontroller 103a acquires user image through camera 102f and starts execution of process 400. At the end of step 502, microcontroller 103a gets information about the user and the quantity of medicine in each compartment.

[0051] Further to step 503, data acquired in step 502 fed to concerned MLA wherein the concerned MLA trained to predict the usage of medicine by the particular user whose picture is captured. By the end of step 503, MLA predicts the usage of particular medicines at a particular time by a particular user. In step 504, microcontroller updates the Blynk Mobile App 104 through communication media 105 and sets reminder in Blynk Mobile App 104 so that the user gets medicine reminders.

Page 11 of 12

[0052] In an embodiment, the microcontroller 103 consists of Rasberry Pi 4 103a, which is a single chip processer capable of executing machine learning algorithms (MLA), parallel processing, and multi tasking. It can store the memory in an SD Card 103b and seamlessly connect to WiFi and other networks. It also consists of BLE 103b and RF 103c external dongles for providing communication network 105 for the Medicine container with a user interface.

[0053] In an embodiment, machine learning algorithms (MLA) created for identifying user, identifying medicine, estimating the quantity, estimating the temperature for medicine, estimating the on/off period of Peltier Modules 102c, estimating the medicine usage and frequency. All the MLAs trained with 20 -80 ratio and fed the data with compartment ID, Time-stamping along with medicine details. Random Forest model is trained for the above purposes, and weights adjusted in real-time so that accurate prediction can be achieved.

[0054] In another embodiment, the temperature in any compartment controlled by powering on and off the Peltier module 102c. Based on predicted on and off time ( Process 300) microcontroller turn on the Peltier module 102c and once compartment reached the set value it turns off the supply. The temperature values are measured by temperature sensor 102e.

Page 12 of 12

Claims (1)

1. STATEMENT OF CLAIMS We Claim: 1. An Al and IoT enabled Smart Medicine Box: Consisting of Medicine box with a plurality of compartments covered with single lid 101 and plurality of Medicine Monitoring Device (MMD) 102 along with microcontroller 103a; and Medicine Monitoring Device (MMD) 102 is the integration of strain gauge 102b, Peltier module 102c, heat sink 102d, temperature sensor 101e, camera 101f and micro fan 102g; and 2. The device as claimed in claim 1 , integration of microcontroller 103a and camera by executing relevant machine learning algorithm (MLA) identifies the type of medicine by the ways of name or barcode and temperature required for the medicine in a particular compartment.

   3. The device as claimed in claim 1 , microcontroller 103a in cor-ordination with strain gauge and relevant machine learning algorithm (MLA) identifies the quantity of the medicine present in each compartment; and

   4. The device as claimed in claim 1 , wherein a microcontroller 103a can set medicine reminder in Blynk Mobile App based on user frequency of usage. Wherein user frequency of usage is predicted by a relevant machine learning algorithm.

   Sheet 1 of 5 18 Apr 2021

   102f

   CAMERA 2021102001

   101

   102

   102e

   103

   100 AI and IoT enabled Smart Medicine Box

   Sheet 2 of 5 18 Apr 2021

   MEDICINE MONITORING DEVICE

   RELAY 102c 103 102b GROUP 102h 2021102001

   MICROCONT- ROLLER

   102e 102g

   102f

   103b FIG 2 CONTROL CIRCUIT LAYOUT MEDICINE MONITORING DEVICE (MMD) 102

   Sheet 3 of 5 18 Apr 2021

   Acquire medicine information by reading barcode/name label on the medicine through camera 102f 301

   Assign the compartment number where medicine is placed. 302 2021102001

   Feed the data to Machine Learning Algorithm to ascertain the 303 temperature and power to be amintained for Peltier module in each compartment based on the medicine in it.

   Acquire temperature set by the user from Blynk Mobile App 104. 304 Obtain the power required to maintain the temperature by considering predicted output of concerned Machine Learning Algorithm. Supply the predicted power in step 303 in absence of 304 or step 305 304 itself to Peltier module in each compartment based on the medicine present in it.

   When medicine depletes or strain guage reads low value go to 306 step 301 and continue the process

   FIG 3 300 Process executed for maintaining temperature in each compartment

   Sheet 4 of 5 18 Apr 2021

   Acquire medicine information by reading barcode/name label on the medicine through camera 102f 401

   Read compartment number(ID) as Assigned in step 302 where medicine is placed. 402 2021102001

   Feed the strain Gauge data to Machine Learning Algorithm to 403 ascertain the quantity in each compartment.

   404 Lable the quantity of medicine present in each compartment.

   405 Update the data in Blynk Mobile App 104 and intimate the user When or strain gauge reads normal value go to step 401

   When medicine depletes or strain gauge reads low value intimate 406 the user in Blynk Mobile App 104 and go to step 301 and continue the process

   FIG 4 400 Process executed for monitoring quantity of medicine

   Sheet 5 of 5 18 Apr 2021

   Acquire the medicine quantity present in each compartement by acquiring data from Blynk Mobile App 104. 501

   Acqueir the image of user and the medicine quantity after every use by user by executing process 400. 502 2021102001

   Feed the data from all above steps to Machine Learning Algorithm 503 to ascertain the usage frequency of medicine in each compartment.

   Send Medicine reminder based on the predicetd usage frequency to 504 the user in Blynk Mobile App 104 through communication media 105.

   505 Go to step 501 and continue the process

   FIG 5

   500 Process executed for setting up of Medicine reminder