KR20240018557A - Method and device for providing notification - Google Patents

Abstract

A method of providing a notification indicating a medication-related problem according to an embodiment includes acquiring a plurality of object images; determining a category corresponding to the plurality of object images as one of receipt, medicine bag, and prescription; Grouping a plurality of object images of different categories and corresponding to the same treatment into one group among the plurality of object images; determining whether a medication-related problem has occurred based on a comparison result of a plurality of object images included in the one group; and providing a notification indicating the medication-related problem based on a result of determining whether the medication-related problem has occurred.

Description

Method and device for providing notification}

The present invention relates to a method and device for providing notification. More specifically, among a plurality of object images corresponding to one of the categories of receipts, medicine envelopes, and prescriptions, a plurality of object images corresponding to the same treatment and having different categories are grouped into one group, and the plurality of object images corresponding to the grouped object images are grouped into one group. The present invention relates to a method and device for determining whether medication-related problems such as incorrect prescriptions, contraindications, and duplicate prescriptions occur based on the comparison results, and providing notifications regarding such problems.

Medical institutions prescribe medicines according to the results of treatment for patients, and issue various documents such as receipts, medicine envelopes, and prescriptions that provide information related to the prescribed medicines so that patients can confirm the prescribed medicines. However, it is difficult for patients to easily identify mismanufacturing, misprescription, or duplication of ingredients for the medicines they have been prescribed due to specialized medical terminology and document formats used in medicine-related documents, and their preferences for medicines (e.g., specific There are also difficulties in determining whether the use of substitutes for medicines, etc.) is reflected.

To solve this problem, there is a service that compares receipts, medicine envelopes, or prescriptions and provides judgment results regarding incorrect prescriptions for the medicine information prescribed to the patient. However, this service is only performed for a single treatment. If a patient has received multiple treatments within a specific period, technology to obtain comparison results between each treatment and provide information such as misprescription information on medicines prescribed to the patient according to each treatment is not provided, so misprescriptions and errors are still occurring. There are problems that make it difficult for patients to easily understand prescriptions and ingredient overlap.

Therefore, we use technology to determine mismanufacturing, misprescription, and ingredient duplication based on not only the comparison results of drug information prescribed for individual treatments, but also the comparison results between drug information prescribed for multiple treatments. , technology that can easily determine ingredient overlap, etc. is required.

Public Patent No. 10-2020-0054552, 2020.05.20

The problem to be solved by the present invention is to group a plurality of object images that contain prescribed drug information and correspond to any one of the categories of receipts, medicine envelopes, and prescriptions to correspond to the same treatment, and compare the results of the plurality of object images. Accordingly, a method and device are provided to determine whether medication-related problems, such as mismanufacturing, incorrect prescription, or ingredient duplication, have occurred and provide notification of such problems.

The problems to be solved by the present invention are not limited to the problems mentioned above, and other problems not mentioned can be clearly understood by those skilled in the art from the description below.

As a technical means for achieving the above-described technical problem, a method for providing a notification according to the first aspect of the present disclosure includes the steps of acquiring a plurality of object images; determining a category corresponding to the plurality of object images as one of receipt, medicine bag, and prescription; Grouping a plurality of object images of different categories and corresponding to the same treatment into one group among the plurality of object images; determining whether a medication-related problem has occurred based on a comparison result of a plurality of object images included in the one group; and providing a notification indicating the medication-related problem based on a result of determining whether the medication-related problem has occurred.

In addition, the step of determining whether a medication-related problem occurs determines whether an incorrect prescription has occurred based on the comparison result, and the step of providing a notification determines whether the incorrect prescription has occurred based on a result of determining whether the incorrect prescription has occurred. Notifications can be provided indicating manufacturing occurrences.

In addition, the step of determining whether a medication-related problem has occurred may obtain erroneous prescription details based on the comparison result, and the step of providing the notification may provide the erroneous prescription details.

Additionally, the step of determining the category as one of the receipt, the medicine bag, and the prescription may determine the category as one of the receipt, the medicine bag, the prescription, and the medicine.

Additionally, the grouping into one group includes obtaining characteristic information corresponding to the plurality of object images; and determining a plurality of object images included in the group based on a comparison result of the characteristic information, wherein the characteristic information includes prescription drug name, hospital name, pharmacy name, prescription date, dispensing date, and payment. Can contain at least one of the dates.

In addition, the step of determining whether a medication-related problem occurs determines whether a contraindication or overlap occurs between drugs included in a plurality of groups with overlapping medication periods, and the step of providing the notification determines whether the contraindication or overlap occurs. Based on the results of the decision as to whether this is occurring, notifications may be provided indicating the contraindication or overlap.

A notification providing device according to a second aspect of the present disclosure includes a camera that acquires a plurality of object images; and determining the category corresponding to the plurality of object images as one of receipt, medicine bag, and prescription, and grouping the plurality of object images whose categories are different from each other and corresponding to the same treatment among the plurality of object images into one group. And, based on the result of comparing the plurality of object images included in the one group, determine whether a medication-related problem occurs, and based on the result of determining whether the medication-related problem occurs, determine whether the medication-related problem occurs. It may include a processor that provides an indicating notification.

Additionally, the processor may determine whether mismanufacturing has occurred based on the comparison result, and may provide a notification indicating the occurrence of mismanufacturing based on the result of determining whether mismanufacturing has occurred.

Additionally, the processor may obtain mismanufacturing details based on the comparison result and provide the obtained mismanufacturing details.

In addition, the processor determines whether a contraindication or overlap occurs between drugs included in a plurality of groups with overlapping medication periods, and based on the result of determining whether the contraindication or overlap occurs, the contraindication or overlap occurs. A notification indicating can be provided.

According to a third aspect of the present disclosure, a computer-readable recording medium recording a program for executing the method of the first aspect on a computer can be provided.

In addition to this, other specific details of the present invention are included in the detailed description and drawings.

According to an embodiment of the present disclosure, a plurality of object images corresponding to the same treatment are grouped into one group, and whether a medication-related problem occurs is determined based on a comparison result of the plurality of object images included in one group. You can decide.

Additionally, a notification may be provided as to whether medicines with overlapping ingredients have been prescribed between multiple treatments based on the comparison results of multiple object images included in multiple groups according to multiple treatments.

In addition, by providing mismanufacturing details obtained based on the comparison results of a plurality of object images included in the same group, it is possible to easily determine the mismanufactured details and at the same time determine whether a substitute agent is used.

In addition, it is possible to easily determine whether preferences are reflected, such as whether a medicine with a specific ingredient has been replaced with another alternative.

The effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the description below.

Figure 1 is a block diagram schematically showing the configuration of a notification providing device according to an embodiment.
Figure 2 is a flowchart illustrating each step of providing a notification indicating a medication-related problem through a notification providing device according to an embodiment.
FIG. 3 is a diagram schematically illustrating an example in which a notification providing device determines a category corresponding to a plurality of object images, according to an embodiment.
FIG. 4 is a diagram schematically illustrating an example of grouping a plurality of object images of different categories and corresponding to the same treatment into one group based on characteristic information, according to an embodiment.
FIG. 5 is a diagram schematically illustrating an example of determining whether a medication-related problem occurs based on a comparison result of a plurality of object images included in one group, according to an embodiment.
FIG. 6 is a diagram schematically illustrating an example of determining whether a medication-related problem occurs based on a comparison result of a plurality of object images included in a plurality of groups, according to an embodiment.

The advantages and features of the present invention and methods for achieving them will become clear by referring to the embodiments described in detail below along with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below and may be implemented in various different forms. The present embodiments are merely intended to make the disclosure of the present invention complete, and are provided to those skilled in the art to which the present invention pertains. It is provided to fully inform the scope of the present invention, and the present invention is only defined by the scope of the claims.

The terms used in this specification are for describing embodiments and are not intended to limit the invention. As used herein, singular forms also include plural forms, unless specifically stated otherwise in the context. As used in the specification, “comprises” and/or “comprising” does not exclude the presence or addition of one or more other elements in addition to the mentioned elements. Like reference numerals refer to like elements throughout the specification, and “and/or” includes each and every combination of one or more of the referenced elements. Although “first”, “second”, etc. are used to describe various components, these components are of course not limited by these terms. These terms are merely used to distinguish one component from another. Therefore, it goes without saying that the first component mentioned below may also be a second component within the technical spirit of the present invention.

Unless otherwise defined, all terms (including technical and scientific terms) used in this specification may be used with meanings commonly understood by those skilled in the art to which the present invention pertains. Additionally, terms defined in commonly used dictionaries are not interpreted ideally or excessively unless clearly specifically defined.

Spatially relative terms such as “below”, “beneath”, “lower”, “above”, “upper”, etc. are used as a single term as shown in the drawing. It can be used to easily describe the correlation between a component and other components. Spatially relative terms should be understood as terms that include different directions of components during use or operation in addition to the directions shown in the drawings. For example, if a component shown in a drawing is flipped over, a component described as “below” or “beneath” another component will be placed “above” the other component. You can. Accordingly, the illustrative term “down” may include both downward and upward directions. Components can also be oriented in other directions, so spatially relative terms can be interpreted according to orientation.

Hereinafter, the plurality of object images 310 may refer to scanned images of medicine-related documents such as a receipt 320, a medicine envelope 330, and a prescription 340.

Hereinafter, a category may refer to one type of document, such as a receipt 320, a medicine envelope 330, or a prescription 340.

Hereinafter, a group may refer to a grouping of medicine-related documents corresponding to the same treatment based on date or prescription.

Hereinafter, embodiments of the present invention will be described in detail with reference to the attached drawings.

Figure 1 is a block diagram schematically showing the configuration of a notification providing device 100 according to an embodiment.

Referring to FIG. 1, the notification providing device 100 may include a camera 110 and a processor 120. The camera 110 according to one embodiment may acquire a plurality of object images 310.

The plurality of object images 310 according to one embodiment may refer to scanned images of medicine-related documents such as receipts 320, medicine envelopes 330, and prescriptions 340, and may be scanned images using camera 110, etc. It can be obtained through

The processor 120 according to an embodiment determines the category corresponding to the plurality of object images 310 as one of the receipt 320, medicine bag 330, and prescription 340, and selects the plurality of object images 310 A plurality of object images 310 of different categories and corresponding to the same treatment are grouped into one group 410, and the comparison results for the plurality of object images 310 included in one group 410 are compared. Based on this, it may be determined whether a medication-related problem has occurred, and based on the result of the determination as to whether a medication-related problem has occurred, a notification indicating a medication-related problem may be provided.

Additionally, the processor 120 may determine whether mismanufacturing has occurred (510) based on the comparison result, and may provide a notification indicating that mismanufacturing has occurred based on the determination result of whether mismanufacturing has occurred (510).

Additionally, the processor 120 may obtain incorrect manufacturing details 520 based on the comparison result and provide the obtained incorrect manufacturing details 520.

In addition, the processor 120 determines whether a notification 610 indicating a contraindication or a notification 620 indicating an overlap between drugs included in a plurality of groups with overlapping medication periods occurs, and determines whether a notification 610 indicating a contraindication occurs. Alternatively, a notification 610 indicating a taboo or a notification 620 indicating a duplication may be provided based on the result of determining whether the notification 620 indicating a duplication occurs.

In addition, those skilled in the art can understand that other general-purpose components in addition to the components shown in FIG. 1 may be further included in the notification providing device 100. For example, the notification providing device 100 may further include a memory (not shown) that stores a plurality of object images 310 . Alternatively, according to another embodiment, those skilled in the art may understand that some of the components shown in FIG. 1 may be omitted.

The notification providing device 100 according to an embodiment may be used by a user or worker, and may be equipped with a touch screen panel such as a mobile phone, smartphone, PDA (Personal Digital Assistant), PMP (Portable Multimedia Player), tablet PC, etc. It can include all types of handheld wireless communication devices, and in addition, it can include desktop PCs, tablet PCs, laptop PCs, and IPTVs including set-top boxes, which provide a basis for installing and running applications. It may also include devices.

The notification providing device 100 may be implemented as a terminal such as a computer that operates through a computer program to realize the functions described in this specification.

The font providing system according to one embodiment may include a notification providing device 100 and a server (not shown), but is not limited thereto. The server according to one embodiment may provide an application that provides notifications indicating medication-related problems, and may support a service that provides notifications indicating medication-related problems based on the user's medical institution visit history and prescription history.

Hereinafter, the description will focus on an embodiment in which the notification providing device 100 independently provides notifications, but as described above, notifications may also be provided through interworking with a server. That is, the notification providing device 100 and the server according to one embodiment may be integrated in terms of their functions, and the server may be omitted, and it can be seen that the present invention is not limited to any one embodiment.

The contents described above with reference to each configuration will be described in more detail later with reference to the drawings below.

FIG. 2 is a flowchart illustrating each step of providing a notification indicating a medication-related problem through the notification providing device 100 according to an embodiment.

Referring to the drawings, in step S210, the notification providing device 100 may acquire a plurality of object images 310. The plurality of object images 310 may represent scanned images of medicine-related documents such as receipts 320, medicine envelopes 330, and prescriptions 340 related to medical treatment provided to the user. These plural object images 310 may include the prescribed drug name, hospital name, pharmacy name, prescription date, dispensing date, and payment date.

In step S220, the notification providing device 100 may determine the category corresponding to the plurality of object images 310 as one of a receipt 320, a medicine bag 330, and a prescription 340.

Specifically, the notification providing device 100 may determine the category corresponding to the plurality of object images 310 as one of receipt 320, medicine bag 330, prescription 340, and medicine. The notification providing device 100 categorizes a plurality of object images 310 based on the results of learning about the format and images for conventional medical receipts 320, medicine envelopes 330, prescriptions 340, and medicines. It may include a pre-stored algorithm for making decisions. The notification providing device 100 may determine the category corresponding to the acquired plurality of object images 310 to be one of the receipt 320, medicine bag 330, prescription 340, and medicine based on a pre-stored algorithm. . Here, the category may represent one document type. In addition, determining the category corresponding to the plurality of object images 310 as a drug category means acquiring and analyzing the image of the drug itself, and using information such as the shape, color, or number of the drug according to the image analysis results. It is possible to determine the type of medication, etc., and more accurately determine medication-related problems such as mismanufacturing of medications in patient care.

In step S230, the notification providing device 100 may group a plurality of object images 310 of different categories and corresponding to the same treatment into one group 410 among the plurality of object images 310. When a plurality of object images 310 of different categories and corresponding to the same treatment are determined to be one group 410, the receipt 320, medicine bag 330, and prescription 340 obtained for the same treatment are Comparisons can be made, and through the comparison results, it is possible to more accurately determine whether misprescriptions or mismanufactures of medicines occurred during the prescription-dispensing process for the relevant treatment. In addition, when grouping a plurality of object images 310 for the same treatment, a notification 620 indicating overlap of specific medicines between each group is prescribed based on the comparison results between each group determined, or whether a type of medicine that should not be taken together is prescribed. It is possible to more accurately determine the notification 610 indicating a taboo.

Regarding this, referring to FIG. 4 , the notification providing device 100 may group a plurality of object images 310 corresponding to the same treatment into one group 410 based on a comparison result of characteristic information. Specifically, the characteristic information may include at least one of the prescription drug name, hospital name, pharmacy name, prescription date, dispensing date, and payment date related to the user's treatment. For example, the prescription date may be characteristic information included in the image for the prescription 340, the dispensing date may be characteristic information included in the image for the medicine bag 330, and the payment date may be in the receipt 320. It may be characteristic information included in the image. Additionally, the prescription drug name may be characteristic information included in the image of the prescription 340 and the medicine bag 330.

For example, if the prescribed drug name according to the characteristic information is the same, the object images may correspond to the same treatment, but there may be cases where the prescribed drug name is the same (e.g. antibiotics) but the treatment is different. , Determining a plurality of object images 310 included in one group 410 based on the comparison results of not only the name of the prescription drug but also the hospital name, pharmacy name, prescription date, dispensing date, and payment date corresponds to the same treatment. It may be more appropriate for grouping.

In one embodiment, payment for dispensed drugs for the same treatment is generally made within one week, which is the deadline for payment of the dispensed drugs. Accordingly, referring to FIG. 5, the notification providing device 100 groups images including the prescription date, dispensing date, and payment date included within a preset period (e.g., a week) into one group 410 corresponding to the same treatment. ) can be grouped. However, if the user receives different medical treatment within the preset period, that is, the prescription, dispensing, and payment dates included in the plurality of object images 310 are included within the preset period, but the prescription, dispensing, and payment date for the different treatment Since there may be a case, the notification providing device 100 selects the same object image 310 among the plurality of object images 310 based on a comparison result of the prescription date, treatment date, and payment date as well as the prescription drug name, hospital name, and/or pharmacy name. Images corresponding to medical treatment can be grouped into one group 410.

In another embodiment, when the hospital name and pharmacy name included in the plurality of object images 310 are within a preset distance (e.g., 1 km) on the map, the notification providing device 100 selects the images corresponding to the same treatment. It can be grouped into one group 410. In general, pharmacies and hospitals are often located very close to each other on the map, and in most cases, medicines prescribed by hospitals are handled by pharmacies adjacent to the hospital. Therefore, the closer the hospital and pharmacy are, the more the hospital and pharmacy names are included. The plurality of object images 310 can be viewed as images for the same medical treatment. However, in an area where many hospitals with different treatment areas are concentrated, even if hospitals and pharmacies are adjacent, it is difficult to view them as providing the same treatment. In this case, in addition to the hospital name and pharmacy name, the name of the prescribed medicine, date of prescription, date of dispensing, and payment are provided. It may be desirable to decide whether or not to group based on the comparison results for dates.

In another embodiment, a particular medication (e.g., an antidepressant) may be prescribed by a hospital that specializes in a particular specialty (e.g., a psychiatry department). Accordingly, the notification providing device 100 provides the name of a hospital (dispensary department) that can prescribe medicine according to the prescription medicine name based on the prescription medicine name and hospital name according to the characteristic information included in the plurality of object images 310. Images of hospitals (based on the fact that there are many cases included in this hospital name) can be grouped into groups corresponding to the same treatment.

In another embodiment, the notification providing device 100 may determine a plurality of object images 310 included in one group 410 based on a comparison result of characteristic information. Specifically, the notification providing device 100 assigns high weight in the order of prescription drug name, hospital name, prescription date, dispensing date, payment date, and pharmacy name to select one corresponding to the same treatment among the plurality of object images 310. A plurality of object images 310 included in the group 410 may be determined.

For example, the greater the number of identical prescription drug names indicated by the characteristic information, the higher the likelihood that the corresponding object images are images of the same medical treatment, so the highest weight may be assigned to the prescription drug name. In general, visits to the same hospital may be given the highest weight. In most cases, you receive treatment once, and it is rare to receive different treatment at the same hospital within a certain period of time (e.g. a week). Therefore, if the hospital name is the same, it can be seen that it is likely to be an image of the same treatment, so there is a high possibility that it is an image of the same treatment. High weight may be given to rankings.

In addition, if the prescription date is the same, it may be a prescription for the same treatment, but since there are cases where multiple treatments are received on the same date, it is somewhat difficult to regard it as the same treatment even if the prescription date is the same, so the prescription date is given a 3rd place higher weight. Since the user must visit the pharmacy after receiving a prescription for treatment to dispense and pay for the medicine corresponding to the treatment, a higher weight of 4th place is given to the date of dispensing and a higher weight of 5th place is given to the date of payment. It can be. In addition, since one pharmacy often handles medicines corresponding to different medical subjects, even if the pharmacy name is the same, it may be difficult to see it as an image corresponding to the same medical treatment, so the pharmacy name may be given a high weight of 6th place. .

As described above, the notification providing device 100 divides a plurality of object images 310 including corresponding characteristic information into one group 410 corresponding to the same treatment based on differently assigned weights to the characteristic information. By grouping, it is possible to group into multiple groups corresponding to multiple identical treatments, and more accurately determine whether there is a notification 610 indicating a taboo or a notification 620 indicating an overlap between drugs included in the multiple groups. It is also possible to determine more accurately whether there is mismanufacturing or misprescription within a group corresponding to the same treatment.

In step S240, the notification providing device 100 may determine whether a medication-related problem has occurred based on a comparison result of a plurality of object images 310 included in one group 410. In step S250, the notification providing device 100 may determine whether a medication-related problem has occurred. 100 may provide a notification indicating a medication-related problem based on the result of determining whether a medication-related problem has occurred. Medication-related issues may indicate information about mispreparation or misprescription.

For example, referring to FIG. 5, the notification providing device 100 displays medicines included in the receipt 320, medicine bag 330, and prescription 340 images included in one group 410 corresponding to the same treatment. Based on the results of comparing information, whether incorrect manufacturing has occurred (510) and incorrect manufacturing details (520) can be determined and obtained. Referring to the drawing, it can be seen that the drug A indicated by the receipt 320 and the prescription 340 is 10 mg, but the drug A indicated by the medicine bag 330 is 5 mg, indicating that a mismanufacturing has occurred. The notification providing device 100 can determine whether mismanufacturing has occurred based on the comparison result of drug information, obtain mismanufacturing details 520, and determine whether mismanufacturing has occurred 510. Based on this, a notification indicating the occurrence of incorrect manufacturing and incorrect manufacturing details 520 can be provided.

In addition, referring to the drawing, it can be seen that the receipt 320 and prescription 340 indicate 10 mg of medicine B, but the medicine bag 330 shows 10 mg of medicine C instead of 10 mg of medicine B. In this case, it may have been mistakenly manufactured as a C drug rather than a B drug, but the notification providing device 100 provides a preference reflection filtering function provided to the user to receive the user's preference for the drug, such as the type of drug, dosage, and use of substitutes. Based on the preference information previously obtained from the user (e.g., request for manufacture of drug C, a substitute for drug B), it can be determined that drug B has been replaced by drug C, which is a substitute, and drug B has been replaced by drug C. Details can be provided.

In one example, preference reflection filtering may be a function to more accurately determine whether there is mismanufacturing or misprescription by reflecting the user's preference for a specific medicine. For example, the notification providing device 100 may determine based on user input for preference reflection filtering that a drug B is preferred to be replaced with drug C, which is an alternative to drug B, and then drug C is manufactured instead of drug B. In this case, it can be determined that it is not a manufacturing error situation.

Additionally, the notification providing device 100 may determine and obtain whether mismanufacturing has occurred (510) and mismanufacturing details (520) based on a comparison result with the image of the drug itself. For example, if the shape, color, and size of the obtained image of the drug itself are different, a notification may be provided regarding whether mismanufacturing has occurred (510) and the mismanufacturing details (520).

Also, referring to FIG. 6, the notification providing device 100 may group a plurality of object images 310 corresponding to the same treatment into one group 410. These groups may exist as multiple groups based on the number and type of different medical treatments, etc. Accordingly, the notification providing device 100 may determine whether a notification 610 indicating a taboo or a notification 620 indicating an overlap between medicines included in a plurality of groups with overlapping medication periods is generated.

Referring to the drawing, the notification providing device 100 includes a notification 610 indicating a taboo or a notification 620 indicating an overlap between medicines included in the first group and the second group whose medication period overlaps among the plurality of groups. You can decide whether it will happen or not. Among some medicines, there are medicines that have a high risk of side effects when taken together with certain types of medicines during an overlapping period or are prohibited from being taken together, and medicines that have a high risk of side effects if the same medicine is taken at a certain dose or more. exist. If the user receives multiple treatments within a certain period of time and the medication period overlaps, determining whether a notification 610 indicating a contraindication or a notification 620 indicating an overlap between prescribed medicines occurs is very important in terms of the user's health. It can be important.

Accordingly, when the medication period between groups including a plurality of object images 310 corresponding to each treatment overlaps, the notification providing device 100 provides a notification 610 indicating a taboo between medicines included in each group, or It is possible to determine whether a notification 620 indicating a duplication occurs, and based on the decision result, a notification 610 indicating a taboo or a notification 620 indicating a duplication can be provided. These notifications may be provided with notification 610 details indicating taboos and notification 620 details indicating duplication.

Additionally, the notification providing device 100 may provide notifications indicating medication-related problems to the user in various ways, including notifications 610 indicating incorrect preparation, contraindications, and notifications 620 indicating duplication. For example, the notification providing device 100 may utilize a voice message to inform whether a medication-related problem has occurred or a voice message to provide detailed information on the details of the medication-related problem that has occurred, and whether or not it has occurred. A method of displaying messages about details can be used. Additionally, the vibration output method can be used to provide more effective notifications to specific users who have difficulty obtaining visual and auditory information. Such notifications may be transmitted to multiple devices, such as a user's smart device or wearable device that is linked to the notification providing device 100, and the notification may be provided in a manner provided by the smart device or wearable device.

FIG. 3 is a diagram schematically illustrating an example in which the notification providing device 100 determines a category corresponding to a plurality of object images 310 according to an embodiment.

Referring to the drawing, the notification providing device 100 may determine the category corresponding to the plurality of object images 310 as one of receipt 320, medicine bag 330, prescription 340, and medicine. The notification providing device 100 categorizes a plurality of object images 310 based on the results of learning about the format and images for conventional medical receipts 320, medicine envelopes 330, prescriptions 340, and medicines. It may include a pre-stored algorithm for making decisions. The notification providing device 100 may determine the category corresponding to the acquired plurality of object images 310 to be one of the receipt 320, medicine bag 330, prescription 340, and medicine based on a pre-stored algorithm. . In addition, determining the category corresponding to the plurality of object images 310 as a drug category means acquiring and analyzing the image of the drug itself, and using information such as the shape, color, or number of the drug according to the image analysis results. It is possible to determine the type of medication, etc., and more accurately determine medication-related problems such as mismanufacturing of medications in patient care.

FIG. 4 is a diagram schematically illustrating an example of grouping a plurality of object images 310 of different categories and corresponding to the same treatment into one group 410 based on characteristic information, according to an embodiment.

Referring to the drawing, the notification providing device 100 may group a plurality of object images 310 corresponding to the same treatment into one group 410 based on a comparison result of characteristic information. For example, if the number of identical prescription drug names among the plurality of object images 310 exceeds a preset ratio, the images may be images of the same medical treatment, and thus the images may be grouped into the same group 410.

In one embodiment, the notification providing device 100 may determine a plurality of object images 310 to be grouped into the same group 410 based on characteristic information to which weights of different sizes are assigned.

In this way, by grouping a plurality of object images 310 into the same group based on characteristic information, mismanufacturing is possible based on drug-related information included in the receipt 320, medicine bag 330, and prescription 340 within the same clinic. Alternatively, it is possible to more accurately determine whether there is an incorrect prescription, and when the dosage period between multiple groups overlaps, it is easier to determine whether a notification 610 indicating a contraindication that may pose a threat to the user's health or a notification 620 indicating an overlap occurs. You will be able to judge clearly.

FIG. 5 is a diagram schematically illustrating an example of determining whether a medication-related problem has occurred based on a comparison result of a plurality of object images 310 included in one group 410, according to an embodiment.

The notification providing device 100 may determine and obtain whether mismanufacturing has occurred 510 and mismanufacturing details 520 based on a comparison result of a plurality of object images 310 included in the same group.

Referring to the drawing, it can be seen that the drug A shown in the images of the receipt 320 and the prescription 340 is 10 mg, but the drug A shown in the image of the medicine bag 330 is 5 mg, indicating that a mismanufacturing has occurred. Also, referring to the drawing, the receipt 320 and prescription 340 images represent 10 mg of drug B, whereas the image of the medicine bag 330 represents 10 mg of drug C, not drug B. In this way, if different drug information is shown between each image, it may be a mismanufacturing situation. However, if the user's preference information is obtained indicating that the user prefers drug C, which is an alternative to drug B, it may not be a mismanufacturing situation. .

The notification providing device 100 determines and obtains whether mismanufacturing has occurred (510) and mismanufacturing details (520) based on the comparison results of the plurality of object images (310) included in the same group, thereby allowing the user to There is no need to determine whether a manufacturing error has occurred by identifying related information one by one, and in addition, the user's preference information is reflected to determine whether a manufacturing error has occurred (510), making it possible to provide a customized service to the user.

FIG. 6 is a diagram schematically illustrating an example of determining whether a medication-related problem has occurred based on a comparison result of a plurality of object images 310 included in a plurality of groups, according to an embodiment.

Referring to the drawing, the notification providing device 100 may group a plurality of object images 310 corresponding to the same treatment into one individual group 410. These groups may exist as multiple groups based on the number and type of different medical treatments, etc. Accordingly, the notification providing device 100 may determine whether a notification 610 indicating a taboo or a notification 620 indicating an overlap between medicines included in a plurality of groups with overlapping medication periods is generated.

Referring to the drawing, the notification providing device 100 includes a notification 610 indicating a taboo or a notification 620 indicating an overlap between medicines included in the first group and the second group whose medication period overlaps among the plurality of groups. You can decide whether it will happen or not. Among some medicines, there are medicines that have a high risk of side effects when taken together with certain types of medicines during an overlapping period or are prohibited from being taken together, and medicines that have a high risk of side effects if the same medicine is taken at a certain dose or more. exist. If the user receives multiple treatments within a certain period of time and the medication period overlaps, determining whether a notification 610 indicating a contraindication or a notification 620 indicating an overlap between prescribed medicines occurs is very important in terms of the user's health. It can be important.

Accordingly, when the medication period between groups including a plurality of object images 310 corresponding to each treatment overlaps, the notification providing device 100 provides a notification 610 indicating a taboo between medicines included in each group, or It is possible to determine whether a notification 620 indicating a duplication occurs, and based on the decision result, a notification 610 indicating a taboo or a notification 620 indicating a duplication can be provided. These notifications may be provided with notification 610 details indicating taboos and notification 620 details indicating duplication.

In this way, by providing a notification indicating a taboo (610) and a notification indicating an overlap (620) that may occur when the medication period overlaps, the notification indicating a taboo (610) and the notification indicating an overlap (620) are provided. You can minimize the possibility of dangerous situations that may result in health deterioration due to taking medication without knowing it.

Meanwhile, the notification providing device according to the above-described embodiment may include one or more processors and/or one or more memories. In addition, in Figure 1, for convenience of explanation, only the essential components for explaining the notification providing device according to an embodiment are shown, but to configure the device corresponding to the invention, such as a speaker (not shown) and a communication unit (not shown), Various conventional components may be organically combined to perform the operations described above in FIGS. 1 to 6.

Additionally, memory may include volatile and/or non-volatile memory. One or more memories may store instructions that, when executed by one or more processors, cause one or more processors to perform operations. In the present disclosure, the program or command is software stored in memory and may include an operating system for controlling server resources, an application, and/or middleware that provides various functions to the application so that the application can utilize the resources of the device. You can.

One or more processors may run software (eg, programs, instructions) to control at least one component of a device connected to the processor. Additionally, the processor may perform various operations related to the present disclosure, such as calculation, processing, data generation, and processing. Additionally, the processor can load data, etc. from memory or store it in memory.

In one embodiment, at least one of the components of the notification providing device may be omitted, or another component may be added. Additionally, some components may be integrated and implemented additionally or alternatively, or may be implemented as a single or plural entity.

The steps of the method or algorithm described in connection with embodiments of the present invention may be implemented directly in hardware, implemented as a software module executed by hardware, or a combination thereof. The software module may be RAM (Random Access Memory), ROM (Read Only Memory), EPROM (Erasable Programmable ROM), EEPROM (Electrically Erasable Programmable ROM), Flash Memory, hard disk, removable disk, CD-ROM, or It may reside on any type of computer-readable recording medium well known in the art to which the present invention pertains.

Above, embodiments of the present invention have been described with reference to the attached drawings, but those skilled in the art will understand that the present invention can be implemented in other specific forms without changing its technical idea or essential features. You will be able to understand it. Therefore, the embodiments described above should be understood in all respects as illustrative and not restrictive.

100: Notification providing device
110: Camera 120: Processor
310: Multiple object images
320: Receipt 330: Medicine bag
340: Prescription 410: One group
510: Whether mismanufacturing occurred 520: Mismanufacturing details
610: Taboo 620: Redundancy

Claims (11)

Obtaining a plurality of object images;
determining a category corresponding to the plurality of object images as one of receipt, medicine bag, and prescription;
Grouping a plurality of object images of different categories and corresponding to the same treatment into one group among the plurality of object images;
determining whether a medication-related problem has occurred based on a comparison result of a plurality of object images included in the one group; and
Providing a notification indicating the medication-related problem based on a result of determining whether the medication-related problem has occurred. A method of providing a notification comprising a.
According to claim 1,
The step of determining whether a medication-related problem occurs determines whether an incorrect prescription has occurred based on the comparison result,
The step of providing the notification provides a notification indicating the occurrence of the erroneous manufacturing based on a result of determining whether the erroneous manufacturing has occurred.
According to claim 1,
The step of determining whether the medication-related problem occurs is obtaining erroneous prescription details based on the comparison results,
The step of providing the notification includes providing the erroneous manufacturing details.
According to claim 1,
The step of determining the category as one of the receipt, the medicine bag, and the prescription determines the category as one of the receipt, the medicine bag, the prescription, and the medicine.
According to claim 1,
The step of grouping into one group is
Obtaining characteristic information corresponding to the plurality of object images; and
It includes; determining a plurality of object images included in the one group based on a comparison result of the characteristic information;
The characteristic information includes at least one of the prescription drug name, hospital name, pharmacy name, prescription date, dispensing date, and payment date.
According to claim 1,
The step of determining whether a medication-related problem occurs determines whether a contraindication or overlap occurs between drugs included in a plurality of groups with overlapping medication periods,
The step of providing the notification provides a notification indicating the taboo or overlap based on a result of determining whether the taboo or the overlap occurs.
A camera that acquires a plurality of object images; and
Determine the category corresponding to the plurality of object images as one of receipt, medicine bag, and prescription,
Among the plurality of object images, a plurality of object images of different categories and corresponding to the same treatment are grouped into one group,
Determine whether a medication-related problem occurs based on the comparison results of the plurality of object images included in the one group,
A processor providing a notification indicating the medication-related problem based on a result of determining whether the medication-related problem has occurred. A notification providing device comprising a.
According to claim 7,
The processor is
Based on the results of the comparison, determine whether or not a manufacturing error has occurred,
A notification providing device that provides a notification indicating that the erroneous manufacturing has occurred, based on a result of determining whether the erroneous manufacturing has occurred.
According to claim 7,
The processor is
A notification providing device that obtains incorrect manufacturing details based on the comparison result and provides the obtained incorrect manufacturing details.
According to claim 7,
The processor determines whether a contraindication or overlap occurs between drugs included in a plurality of groups with overlapping medication periods,
A notification providing device that provides a notification indicating the taboo or overlap based on a result of determining whether the taboo or overlap occurs.
A computer-readable recording medium recording a program for executing the method of any one of claims 1 to 6 on a computer.