JP6338454B2 - Dosing trail management terminal, dosing trail management system, and dosing trail management method - Google Patents

Description

  The present invention relates to a medication trail management terminal, a medication trail management system, and a medication trail management method.

Until now, various systems and software have been proposed for medication management. With the spread of smartphones in particular, various types of applications aimed at self-management of medications have been put into practical use. In addition, there is a system that manages by taking out a medicine from a medicine box or a portable pill case as a taking history.
In either method, it is necessary for the patient to be truly cooperative in order to record an accurate dosing history. If the drug is not actually taken or left untreated, the system will not It cannot be detected.
Thus, it is not easy to leave evidence that a particular patient himself has indeed taken the drug. Under the present circumstances, for example, there is no other way to rely on a method in which, for example, a doctor or nurse is present at the time of taking in a hospital and confirms that he / she is drinking correctly.
To deal with such problems, Non-Patent Document 1 combines an intelligent drug case (iMec) with a ubiquitous sensor, and uses the built-in camera to photograph and process the image of the drug in iMec, thereby determining the type of drug and amount of drug taken. A recognition method is used.

Satoshi Nakauchi, Takuo Suzuki, “Medication Confirmation System for Watching Users” [online], Graduate School of Systems and Information Engineering, University of Tsukuba, [Search May 15, 2014], Internet <URL: http: // hri.iit.tsukuba.ac.jp/publications/2009-14787.pdf>

  However, if there is simply information about the state of the drug before and after taking it, it cannot be said that there is sufficient evidence capacity that the user took it correctly, and it is necessary to manage the taking operation as a trail such as a final start image is there.

  Accordingly, an object of the present invention made in view of such a point is to provide a dose trail management terminal, a dose trail management system, and a dose trail management method capable of accurately recording a dose history.

In order to solve the above problems, the taking trail management terminal according to the present invention is:
An object recognition tracking unit for recognizing a medicine taken based on image data acquired from an image sensor;
A user identification unit for recognizing a user based on the image data;
A trail sequence management unit for authenticating that the medicine to be taken has been taken correctly,
The trail sequence management unit
Preparations of medication types and doses to be taken are prepared,
The user recognized by the user identification unit matches the person to be taken,
In the image data continuously acquired from the start of taking, the user does not leave the imaging range by the image sensor, and a person other than the user does not enter the imaging range by the image sensor, and the medicine is imaged. When it meets the conditions that it is not lost from the range, it starts detecting the dose,
Based on the image data, the drug to be taken is reduced by a certain amount or more, and by recognizing that the medicine has entered the user's mouth, detecting the user's taking, further, by confirming that there are no residual drug by taking the user, and wherein all of the drug to be the taking subject have rows determination that has been taken by the user, performs the authentication To do.

In addition, in order to solve the above problems, a dosage trail management system according to the present invention is:
A dosage trail management system comprising the above-described dosage trail management terminal, a server, and a doctor terminal, wherein the authenticated data can be transmitted to the doctor terminal based on the consent of the user. And

Moreover, in order to solve the above-mentioned problem, according to the present invention, a dosage trail management method,
A dosage trail management method using a dosage trail management terminal,
The taking trail management terminal is
Recognizing a drug based on image data acquired from an image sensor , detecting that a drug of the type to be taken and a drug of a dose amount have been prepared;
Recognizing a user based on the image data;
Consistent with previous SL user taking the subject, and, in continuously the acquired image data from the dosing initiation, the user does not leave the imaging range by the image sensor, the non-user person Checking the condition that the imaging sensor does not enter the imaging range and the medicine is not lost from the imaging range;
Based on the image data, the drug to be taken is reduced by a certain amount or more, and by recognizing that the medicine has entered the user's mouth, detecting the user's taking, Further, by confirming that there is no remaining medicine by taking the user, it is determined that all the medicines to be taken are taken by the user, and that the medicine to be taken is correctly taken. Performing the authenticating step.

  ADVANTAGE OF THE INVENTION According to this invention, the taking trail management terminal which can record a dosing history correctly, a taking trail management system, and a taking trail management method can be provided.

1 is a schematic configuration diagram of a medication trail management system according to an embodiment of the present invention. It is a block diagram which shows the structure of the user terminal (dosing trail management terminal) which concerns on one Embodiment of this invention. 1 schematically shows an image sensor connected to a user terminal according to an embodiment of the present invention. It is a flowchart which shows the medication trail management method which concerns on one Embodiment of this invention.

  Hereinafter, embodiments according to the present invention will be described with reference to the drawings. In the present embodiment, it is assumed that the user has agreed in advance to take a medicine according to a certain procedure and leave the record as a trail.

  FIG. 1 is a configuration diagram of a dosage trail management system 400 according to an embodiment of the present invention. A medication trail management system 400 shown in FIG. 1 includes a user terminal 100 (a medication trail management terminal), a server 200, and a doctor terminal 300, which are connected by, for example, the Internet 20 and can transmit and receive information to and from each other. it can.

  The user terminal 100 is a terminal installed at a user's home or the like, and is used by connecting sensors such as the image sensor 10 and the biometric authentication device 11. The user terminal 100 includes a functional unit that performs various processes based on image data from the image sensor 10 and the like.

  The server 200 receives the trail sequence data generated by integrating the identification information of the specific user, the drug recognition result and the tracking state in the user terminal 100, and stores and manages the trail sequence data. In addition to the user's medication history data, the server 200 transmits the medication trail information and the like in the trail sequence data to the doctor terminal 300 when the user consents.

  The doctor terminal 300 is a terminal installed in a hospital or the like where a user consults. The doctor can refer to the user's medication history data using the doctor terminal 300. In addition, it is possible to browse the trail information for taking under user consent (authentication). The medication history data includes two types, a medication confirmation record that is a record of medication taken according to the procedure and a loss record that is a record of medication that could not be taken. When a user takes a medicine in accordance with a certain procedure, the medicine is automatically confirmed by the system and stored in the server 200 together with image data and various recognition information. The doctor refers to the confirmation record mainly as a record of taking the medicine, which is useful for diagnosis and the like. When there is a time when there is a problem in medication compliance, the loss record can be confirmed, or detailed trail data such as image data can be referred to with the consent of the user.

  Next, the configuration of the user terminal 100 will be described in detail.

  FIG. 2 shows a configuration of the user terminal 100 according to an embodiment. The user terminal 100 includes a trail sequence management unit 1, an object recognition tracking unit 2, a user identification unit 3, a transmission / reception unit 4, a dose database 5, a user database 6, a drug database 7, and a dispensing database 8. Prepare. In FIG. 2, the image sensor 10, the biometric authentication device 11, the user notification device 12, the Internet 20, and the server 200 that are used in connection with the user terminal 100 are shown together.

  The trail sequence management unit 1 manages the entire process, creates the trail data by linking the actual taking action of the user and the result of the image recognition, and instructs each functional unit as necessary. The trail sequence management unit 1 displays identification information of a specific user from the user identification unit 3, a drug recognition result from the object recognition tracking unit 2, a tracking state, and the like generated based on image data generated in real time. Integrate and generate trail sequence data. The generated trail sequence data is encrypted and then sent to the server 200 as appropriate via the transmission / reception unit 4 and stored in the server 200. In addition, medication history data of each medicine recognized at the same time is generated and stored in the medication database 5 in the user terminal 100 and also transmitted to the server 200. The medication history data includes two types: a medication confirmation record that is a record of medication taken according to the procedure, and a loss record that is a record of medication that could not be taken.

  Also, the trail sequence management unit 1 notifies the user of various information during each operation. This is called user notification. The user notification is performed by the trail sequence management unit 1 controlling the user notification device 12.

  The object recognition and tracking unit 2 recognizes and tracks medicines, taking dishes, water cups, humans, and the like based on data from the image sensor. Drug recognition is performed by collation with drug model data. For drugs that need to be handled by this system, drug data including three-dimensional model data is registered in the drug database 7 in advance. In addition, the user registers, in advance, a dedicated serving plate to be used and a cup for drinking water when taking the medicine. Thereby, the accuracy of object recognition from image data can be improved.

  The recognized medicine is automatically tracked by the object recognition tracking unit 2 using the photographed image until it is determined that it has been taken orally or lost. If the tracking is interrupted, it is determined that it has been lost unless it is recognized again within a fixed time.

  Information on the drug recognized by the object recognition tracking unit 2 is notified to the trail sequence management unit 1 as a drug recognition result. The drug recognition result is a list of a set of a drug ID representing a type of a specific drug and an approximate score representing how close the type of drug is to the image recognition result. The approximate score is, for example, 100 when the maximum value is 100, and the score decreases depending on the degree of matching and the shooting state. With a certain value (for example, 90) or more as a condition for listing, drugs corresponding to 90 or more are all listed as pairs of drug IDs and approximate scores as described above. Although it is determined that the medicine with the highest score is recognized, information on medicines below the second score is also recorded as part of the trail data.

  The object recognition tracking unit 2 recognizes a taking dish and monitors whether or not a medicine is placed thereon. It is assumed that the drug recognition is mainly performed on the taking plate in order to increase the recognition accuracy. Although it is assumed that the dosing plate is used while it is placed, it may be lifted or moved. However, a warning is presented by the user notification device 12 when the user is out of the shooting area.

  The object recognition tracking unit 2 recognizes a water cup and monitors the amount of water. A warning is presented if the patient is out of the imaging area after completing the drug preparation. The object recognition tracking unit 2 may determine that the dosing procedure has been started by constantly monitoring the cup with the image sensor 10 and detecting an increase in the amount of water.

  The object recognition tracking unit 2 recognizes and tracks a person in the image. The posture of the person recognized in the image is constantly checked to determine whether the hand, torso and head are completely within the image.

  The object recognition tracking unit 2 continues to track the drug on the image as described above, but may temporarily enter the blind spot when the user holds the drug in his / her hand. If the dead angle is within a certain time, it is recognized as a blind spot state, not lost, and can be maintained until the same medicine is recognized by the object recognition tracking unit 2 again. When the same medicine is not recognized before and after the blind spot state, it is determined that the medicine recognized before the blind spot state is lost. These states are managed for all medicines recognized by the object recognition tracking unit 2. If several drugs enter the blind spot state at the same time, replacement may occur. The replacement of the same type of drug is not strictly controlled. Such state information is notified to the object recognition tracking unit 2 as needed.

  The user identification unit 3 identifies the user of the user terminal 100 based on the image data from the image sensor 10 and / or the data from the biometric authentication device 11. The user identification unit 3 collates output data from the image sensor 10 with face identification data registered in advance, for example, and identifies whether the user is a specific user. When it is determined that the user is a specific user registered in advance in the user database 6, the user ID is notified to the trail sequence management unit 1 together with the determined time of the image frame. In the trail sequence management unit 1, trail sequence data is generated from the user identification information specified by the user identification unit 3, encrypted, and then sent to the server 200 as appropriate via the transmission / reception unit 4.

  The transmission / reception unit 4 is a data transmission / reception interface for performing information communication with the server 200 or the like via the Internet 20.

  The medication database 5 stores the medication history data of each recognized drug that is created when the trail sequence management unit 1 creates the trail sequence data. The medication history data includes a loss record, which is a record of a medicine that could not be confirmed, in addition to a medication confirmation record, which is a record of a medicine taken according to the procedure.

  The user database 6 is a storage unit for registering information about a specific user in advance. Information stored in the user database 6 can include face information, fingerprint information, voiceprint information, vein information, iris information, and the like.

  The drug database 7 stores information on each drug provided from a pharmaceutical company or the like via the Internet 20 or the like. Each drug is managed by a unique drug ID for each individual dispensing unit, including the dosage form. In addition to information such as name, dosage form, quantity, manufacturer name, classification, and precautions for taking, a three-dimensional model of the drug Store the data.

  In the present embodiment, information on each drug provided from a pharmaceutical company or the like via the Internet 20 is stored in the drug database 7, but the present invention is not limited to this mode. Information may be received from a pharmaceutical company or the like using a dedicated line other than the Internet 20, or the user may be able to store these data manually.

  The dispensation database 8 stores dispensation information of medicines to be taken by the user, which is provided from a pharmacy or the like via the Internet 20 or the like. Dispensing information is a collection of drug information as a result of dispensing by a pharmacist or a doctor himself / herself based on the content of a prescription created by a doctor for each user at each time point. The time of taking is the timing of taking the drug, and is mainly based on meal and sleep, such as before breakfast, after dinner, before going to bed, and between meals after lunch. As for the time of taking a meal, there are three meals, breakfast, lunch, and dinner, before meal, immediately before meal, during meal, immediately after meal, after meal, and between meals. At the time of prescription, there is an instruction for the time of taking at once, such as after every meal, but in the dispensing database 8, after every meal, it is decomposed and stored into data of three times taken after breakfast, after lunch and after dinner. In addition to this, there are a wake-up time, before going to bed, a time designation (including every fixed time), and an arbitrary use.

  In the dispensation database 8, the amount of medicine to be taken (medicine ID) and the amount of medicine are taken as one record for each taking time point of each date for the amount of time for which the scheduled number of times other than single use is fixed, Stored in advance before taking.

  In the present embodiment, the dispensing information of the medicine to be taken by the user provided from the pharmacy via the Internet 20 or the like is stored in the dispensing database 8, but the present invention is not limited to this mode. As with the drug database 7, information may be received from a pharmacy or the like using a dedicated line other than the Internet 20, or the user may manually store these data.

  Next, components used in connection with the user terminal 100 will be described.

  The image sensor 10 is a combination of a color video camera, a depth sensor, and a projector for projecting light projection. Based on the control from the object recognition tracking unit 2 or the user identification unit 3, the image sensor 10 captures and tracks a user, a taking plate, a medicine, a cup, and the like as shown in FIG. 3. Further, an integrated motion sensor combined with a multi-axis sensor may be used as the image sensor 10.

  The biometric authentication device 11 is a device for performing fingerprint authentication, voiceprint authentication, vein authentication, iris authentication, and the like, and has a function of specifying the user of the user terminal 100 together with the image sensor 10. For example, the biometric authentication device 11 compares the fingerprint data of the user with the fingerprint data of a specific user registered in advance, and identifies whether the user is a specific user.

  In the present embodiment, the image sensor 10 and the biometric authentication device 11 are configured to be connected to the user terminal 100 for use, but the present invention is not limited to this mode. You may comprise so that the user terminal 100 in which the image sensor 10 or the biometrics authentication apparatus 11 was previously integrated as an integral thing may be used.

  The user notification device 12 notifies the user of various information. The user notification is performed by the trail sequence management unit 1 controlling the user notification device 12. Examples of the user notification device 12 include a display device such as a display or LED, a sound output device such as a speaker or a buzzer, and a vibration device using a vibrator.

  Here, the points to be noted when taking are briefly described.

  When taking a medicine, since the state of taking is photographed and recorded by a camera, the user must not hide his face until the end. Then, the user starts taking after confirming that the notified face identification result is the person himself / herself.

  The user picks up the amount that is easy to drink at the time of taking, or lifts up the taking plate, carries the medicine to the mouth, and puts it into the oral cavity. At this time, the system will warn you if you make a blind spot for a long time, so make it visible from the camera as much as possible.

  If the user goes out of the shooting range of the camera while taking, the recording is canceled. In addition, if another person appears in the camera, it is canceled in the same way. The amount taken until then is recorded, but if it is in use, it is not taken.

  Also, if you drop a drug on the way, you have never taken it.

  Next, a specific operation procedure of the user terminal 100 according to the embodiment will be described with reference to the flowchart of FIG.

  First, the trail sequence management unit 1 determines whether there is a trigger for starting the preparation process (step S101). The trigger for starting the preparation process includes a case where the user gives an instruction to start a preparation process for taking, and a case where the system automatically determines that the preparation process has started. In the former, the user explicitly instructs the system to start by pressing a dedicated button or operating a touch panel such as a tablet. In the latter case, it is determined that the preparation for taking has started, triggered by the acceleration sensor built in the taking plate, the output of the proximity sensor, the object recognition result on the taking plate, or the change in the amount of water in the water cup.

  When the preparation process is started, the user looks at the medicine bag, the medicine notebook, the medicine information provision form, and the like, and prepares all medicines necessary at the time of taking this time on the taking dish. At this time, (i) Confirm that there are no irrelevant items on the dosing plate, then (ii) take out the medicine to be taken from the medicine bag or medicine box, and (iii) remove the necessary amount from the packaging such as PTP. Remove and place on a dosing pan, and (iv) prepare a sufficient amount of water in a water cup. This process may be performed by a person other than the user.

  The trail sequence management unit 1 causes the object recognition tracking unit 2 to scan whether or not a medicine to be taken is prepared (step S102). The object recognition tracking unit 2 always tracks the dose tray by image recognition using data from the image sensor 10 and confirms the preparation state of the medicine. And it compares with the model data of the medicine constructed | assembled beforehand, and it determines with an approximate score being more than fixed and having the highest score. Once the drug is recognized, object tracking is performed on the drug object. Notification for confirmation by the user can also be performed for the recognized medicine.

  In addition, you may adjust a state (orientation, overlap) where a medicine is placed by incorporating a vibrator in the platform for placing the medication tray or the medication tray, or by providing a rotation mechanism in the platform. Thereby, when the object recognition result is not good, the medicine on the dish can be smoothed by operating the vibrator. This is an effective means especially when there is an overlap. Further, the number of cameras and projectors as the image sensor 10 connected to the user terminal 100 may be increased to two or more.

  Next, the trail sequence management unit 1 determines which dose is scheduled to be taken from the current time and information stored in the dose database 5 (step S103). A dose schedule is a schedule for a single dose after a set of the timing and timing of dinner and before going to bed and the type and amount of the drug to be taken. The trail sequence management unit 1 integrates information in the dispensing database 8 and the drug database 7 and extracts drug candidates at the time of taking. It is determined whether the list of medicines scheduled to be taken included in the candidates for taking time and the prepared medicines match (step S104). At this time, if the medicines do not match or no medicine is prepared, a warning is given through the user notification device 12 to prepare the medicine to be taken (step S106). However, if the drug mismatch is equal to or greater than the predetermined number of times, the process is terminated without executing step S106 (step S105). Next, the trail sequence management unit 1 determines whether or not the prepared medicine amount is equal to the medicine amount scheduled to be taken (step S107). When the amount of the prepared medicine is larger, notification is made by a screen display, voice, vibrator, etc. so as to return the medicine (step S108). If the display surface is equipped with a display, an indication may be made to mark the excess drug.

  On the other hand, if the medicine is insufficient, notification is similarly made by screen display, voice, vibrator, or the like (step S108). When the medicine is not prepared or when the medicine is insufficient, it is easy to understand if a photograph of the medicine or the like is presented. Therefore, the medicine is presented on a display or a display device on a plate to prompt the preparation for the addition of the medicine. In addition to these, if there are precautions when taking each drug according to information from the drug database 7, the information is appropriately presented to the user. This information provision is called medication navigation.

  By such medication navigation, it is possible to provide useful information to the user as appropriate, avoiding medication errors, and effectively preventing medication leakage.

  When it is detected that all the medicines scheduled to be taken have been prepared, the trail sequence management unit 1 presents a drug preparation completion guide (S109).

  Next, the trail sequence management unit 1 causes the user identification unit 3 to start user authentication (step S110). The user identification unit 3 performs face authentication or other biometric authentication based on data acquired from the image sensor 10 or the biometric authentication device 11.

  The user identification unit 3 determines whether or not the user authentication information matches the pre-registered information on the intended person (step S111). If the two match, a guide to the effect that user authentication has been completed is presented (step S113), and the user is allowed to start taking actual medicine.

  On the other hand, if it is determined in step S111 that the user authentication information does not match the pre-registered information on the intended user, user authentication is performed again. However, if a mismatch between the user authentication information and the information about the person scheduled to take has occurred a predetermined number of times (step S112), the process ends.

  When the user starts taking the medicine, all the prepared medicines are image-tracked by the object recognition tracking unit 2. The object recognition tracking unit 2 recognizes a person and tracks the human body until the end of taking. Then, during the period from the start of taking to the end of taking, the object recognition tracking unit 2 (i) the user who is the user does not leave the shooting range, and (ii) a person other than the user is mixed in the shooting range. (Iii) The three conditions that the medicine is not lost from the screen are continuously confirmed (step S114). This is because if the conditions (i) and (ii) are not satisfied, various misrepresentation by the user is possible. If (iii) is not satisfied, there is a high possibility that the user has not been taken. In the present embodiment, when the user enters an area at the edge of the screen where the user is likely to be out of the shooting area, a warning is notified to the user by screen display, sound, vibrator, or the like.

  When the above three conditions are continuously satisfied, the trail sequence management unit 1 starts detecting the dose and continuously detects it (step S115). The detection of the dose is performed by recognizing an image that the drug on the dose plate has decreased by a certain amount or more and the drug has entered the oral cavity of the user.

  The trail sequence management unit 1 continuously checks that the above three conditions are satisfied (step S116), and determines whether the dose has been completed (step S117). Judgment of completion of taking is performed by confirming that the amount of medicine on the taking dish is reduced by the amount taken, the medicine enters the oral cavity of the user, and there is no remaining medicine on the taking dish.

  Note that the above three conditions are not required to completely satisfy the conditions as long as the completion of administration can be accurately performed. For example, when the medicine clearly exists in the screen and the same user temporarily leaves the screen, it is determined that the authentication of taking completion is not affected, and the processing is continued. Further, even if there are times when a plurality of persons exist in the imaging range of the image sensor 10, if it is in a state in which a person who is scheduled to be taken can always be identified, it is determined that there is no effect on the authentication of the completion of taking, Continue.

  In the present embodiment, it is determined that the dose has been correctly completed when the above three conditions are satisfied, but the present invention is not limited to this mode. If it can be judged from the image data that the same user has taken all the prepared medicines from the start to the end of taking the medicine to be taken, the judgment is made using other conditions. May be.

  When it is determined that the dose has been completed, the user is notified of the completion. Also, assuming that the medicine is taken according to the correct procedure, all the drinking operations are recorded as a trail, recorded as a single data set together with the identity confirmation result, and the process is terminated. In this case, the type and amount of medicine taken are accurately recorded with time. On the other hand, when any of the above three conditions is not satisfied (for example, when it is determined as lost), all the operations are similarly recorded as a trail and the process is terminated. In this case, if a part of the medicine has been taken, the medication history information is interrupted by taking the medicine so far, but it can be confirmed whether or not the part of the medicine has been taken and consumed correctly.

  By saving the detailed trail in this way, it becomes possible to prove the fact of taking it afterwards. In addition, by specifying the drug in real time when taking, it is possible to warn the user that he or she has forgotten to drink or drink too much, and can support correct taking.

  In the present embodiment, a camera connected to the user terminal 100 is used as the image sensor 10, but the present invention is not limited to this aspect. In order to confirm that the user has surely put the medicine in the mouth, a camera may be built in the water cup and the medicine in the mouth may be photographed.

  Further, in this embodiment, the medicine is placed after being placed in the taking dish, but the form without using the taking dish may be used. In this case, in order to improve the accuracy of drug recognition, there is a separate light to illuminate the dosing plate, a camera is built in the dosing plate and the drug is taken from the side and back, and an acceleration sensor is built in the taking plate. The recognition timing of the medicine may be controlled by detecting that the medicine is placed on the dish and that the user touches the taking dish.

  Further, in this embodiment, in order to protect the privacy of the user, the trail sequence data is configured to be viewed by a doctor only with consent by user authentication, but is not limited to this mode. Depending on the operation policy, access restrictions may be removed or browsing may be restricted more strictly.

  As described above, according to the present embodiment, since the medicine and the user are continuously tracked from the start to the end of taking, the taking history can be accurately recorded. Thereby, the quality of medication management is improved, and as a result, the effect of drug treatment can be maximized. In addition, safe medication based on an accurate dosing history becomes possible. In addition, narcotics may be used for pain management in end-of-life care, etc., but since it is possible to record accurate use of these drugs that require strict management, appropriate residual drug management is possible. It becomes.

  Although the present invention has been described based on the drawings and examples, it should be noted that those skilled in the art can easily make various modifications and corrections based on the present disclosure. Therefore, it should be noted that these variations and modifications are included in the scope of the present invention. For example, the functions included in each component, each step, etc. can be rearranged so that there is no logical contradiction, and multiple components, steps, etc. can be combined or divided into one It is. Further, although the present invention has been described mainly with respect to the apparatus, the present invention can also be realized as a method, a program executed by a processor included in the apparatus, or a storage medium storing the program, and is within the scope of the present invention. It should be understood that these are also included.

DESCRIPTION OF SYMBOLS 1 Trail sequence management part 2 Object recognition tracking part 3 User identification part 4 Transmission / reception part 5 Dosing database 6 User database (memory | storage part)
7. Drug database (storage unit)
8 Dispensing database (storage unit)
DESCRIPTION OF SYMBOLS 10 Image sensor 11 Biometric authentication apparatus 12 User notification device 20 Internet 100 User terminal (dosing trail management terminal)
200 server 300 doctor terminal 400 taking trail management system

Claims (7)

An object recognition tracking unit for recognizing a medicine taken based on image data acquired from an image sensor;
A user identification unit for recognizing a user based on the image data;
A trail sequence management unit for authenticating that the medicine to be taken has been taken correctly,
The trail sequence management unit
Preparations of medication types and doses to be taken are prepared,
The user recognized by the user identification unit matches the person to be taken,
In the image data continuously acquired from the start of taking, the user does not leave the imaging range by the image sensor, and a person other than the user does not enter the imaging range by the image sensor, and the medicine is imaged. When it meets the conditions that it is not lost from the range, it starts detecting the dose,
Based on the image data, the drug to be taken is reduced by a certain amount or more, and by recognizing that the medicine has entered the user's mouth, detecting the user's taking, further, by confirming that there are no residual drug by taking the user, and wherein all of the drug to be the taking subject have rows determination that has been taken by the user, performs the authentication Doing trail management terminal. The object recognition tracking unit automatically tracks the drug using the image data until it is determined that the recognized drug has been taken orally or lost, and tracking is interrupted and constant. The medication trail management terminal according to claim 1 , wherein when the drug is not re-recognized in time, the drug is determined to be lost .   The dosage trail management terminal according to claim 1, wherein the trail sequence management unit generates trail sequence data in which the identification information of the user, a drug recognition result, and a tracking state are integrated.   The said object recognition tracking part recognizes the said medication type and dosage which were taken based on the comparison with the said image data and the chemical | medical agent information containing the three-dimensional model data of a chemical | medical agent. The taking trail management terminal according to one item.   The object recognition tracking unit includes an output of an acceleration sensor or a proximity sensor built in a taking dish used by the user at the time of taking medicine, a recognition result of an object on the taking dish, or a water cup used by the user at the time of taking medicine. The dosing trail management terminal according to any one of claims 1 to 4, wherein the dosing preparation is determined to have started by detecting the amount of water.   A dosage trail management system comprising the dosage trail management terminal according to claim 1, a server, and a doctor terminal, wherein the authenticated data can be transmitted to the doctor terminal based on the consent of the user. There is a medication trail management system. A dosage trail management method using a dosage trail management terminal,
The taking trail management terminal is
Recognizing the drug based on the image data acquired from the image sensor, and detecting that the drug of the type to be taken and the drug of the drug amount have been prepared;
Recognizing a user based on the image data;
Consistent with previous SL user taking the subject, and, in continuously the acquired image data from the dosing initiation, the user does not leave the imaging range by the image sensor, the non-user person Checking the condition that the imaging sensor does not enter the imaging range and the medicine is not lost from the imaging range;
Based on the image data, the drug to be taken is reduced by a certain amount or more, and by recognizing that the medicine has entered the user's mouth, detecting the user's taking, Further, by confirming that there is no remaining medicine by taking the user, it is determined that all the medicines to be taken are taken by the user, and that the medicine to be taken is correctly taken. taking trail management method characterized by performing the step of authenticating.

Images