KR20220020326A - Terminal for managing taking food and drug based on an image analysis - Google Patents

Abstract

Disclosed is a terminal for managing food and medicine taking based on image analysis. According to one embodiment, a terminal for managing food and medicine taking based on image analysis includes: a communication module which receives images captured by a plurality of medicine packets fixed to a medicine taking management device; and a processor which identifies the medicine packets in the image and determines whether to take a medicine based on the identification result of the medicine packets, wherein the processor determines whether the medicine packets are detached from the medicine taking management device, and determines whether the medicine is taken or not based on the determined result. According to the present invention, medicine taking can be conveniently and regularly performed.

Description

Image analysis-based food and drug administration terminal {TERMINAL FOR MANAGING TAKING FOOD AND DRUG BASED ON AN IMAGE ANALYSIS}

The present invention relates to an image analysis-based food and drug administration terminal. More specifically, a medication management device for medication management of long-term medications is provided to the purchaser, an appropriate medication plan is established based on the information obtained using the medication management device, and a regular delivery service according to the established medication plan is provided. It relates to a food and drug administration terminal based on image analysis provided.

In the case of purchasers who regularly take and purchase long-term food products (eg, foods such as nutritional supplements or medicines related to certain chronic diseases), there is the inconvenience of having to directly purchase each time the food and medicine runs out. In addition, since they habitually purchase the same food and drug, there was a problem that it was difficult to change easily even if there were dissatisfaction with the medication method, effect, and food and drug combination.

In addition, in the case of long-term medication, it is difficult to accurately take the medication according to the medication plan because the medication time is often missed or the medication is forgotten after several hours have elapsed.

Therefore, recently, medication devices have been developed to assist in the medication plan, but the purchaser's effort is somewhat required to set the medication, and the price is high, so the effect is not great and it is difficult for real buyers to use it. There was a problem.

Laid-open Patent Publication No. 10-2018-0109901, 2018.10.08.

The problem to be solved by the present invention is to provide the user with a medication management device that assists medication management together with individually packaged food and drug for medication management of long-term medication, so that the user regularly takes food and drugs according to a medication plan can help you do that.

In addition, it is to provide a method and system for establishing an appropriate medication plan based on the feedback information obtained using the medication management device (whether or not taking food products and taking time, etc.) and providing a regular delivery service according to the established medication plan. .

The problems to be solved by the present invention are not limited to the problems mentioned above, and other problems not mentioned will be clearly understood by those skilled in the art from the following description.

According to an embodiment of the present invention for solving the above problems, a food and drug administration terminal based on image analysis includes a communication module configured to receive an image of a plurality of medicine tablets fixed to a medication management device; and a processor that identifies the medicine forge in the image and determines whether to take the medicine based on the identification result of the medicine tablet, wherein the processor is configured to: It is determined whether the medicine forge is detached from the medicine, and it is characterized in that it is determined whether the medicine is taken or not based on the determined result.

At this time, the processor, when the designated position of the medicine forge in the image is changed, characterized in that it determines that the medicine forge is detached.

That is, the processor further identifies the medication plan of the medicine poji in the image, and provides a medication notification to the user based on the identified medication plan.

In addition, the processor determines that the user is in a state where the medication is ready when the medicine sheet is detached, and provides the medication alarm based on the medication plan when the medication is ready. .

In addition, the processor may provide the medication alarm when it is determined that the medication management terminal is out of a preset area while the medication is ready.

In this case, a preset network is provided in the preset area, and the processor provides the medication alarm when it is determined through the communication module that the medication management terminal has deviated from the location of the preset network. do it with

In addition, a beacon for recognizing the location of the medication management terminal is provided in the preset area, and the processor provides the medication alarm when it is determined through the communication module that it is outside the radius of the beacon do it with

On the other hand, the processor, based on the change in the quantity of the medicine poji in the image, characterized in that it transmits feedback data related to food and drug delivery to an external server through the communication module.

At this time, the processor, when it is determined that the quantity of the medicine forge in the image is reduced to less than a preset number, it is characterized in that it transmits the feedback data to the external server so that a new food and drug is delivered to the user. .

In addition, the feedback data includes at least one of a user's health, lifestyle, eating habits, and medication habit, and the new medication medication plan to be delivered to the user is sent to the external server based on the feedback data. characterized by being changed by

According to an image analysis-based food and drug administration terminal according to an embodiment of the present invention, it is possible to assist users to more conveniently and regularly take long-term medicines, which are easy to miss.

In addition, a personalized medication plan can be established through the medication habits and lifestyle collected through the medication management device, so that food and drugs more suitable for the health promotion of the purchaser can be provided regularly.

Effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the following description.

1 is a diagram schematically illustrating a medication management method according to an embodiment.
2 is a flowchart illustrating a medication management method according to an embodiment.
3 is a diagram for explaining in detail a medication management apparatus according to an embodiment.
4 is a front view and a side view of a medication management apparatus according to an embodiment.
5 illustrates an example in which the medication management terminal provides an alarm to a user according to an embodiment.
6 is a block diagram schematically showing the configuration of a medication management terminal according to an embodiment.

Advantages and features of the present invention and methods of achieving them will become apparent with reference to the embodiments described below in detail in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in various different forms, and only the present embodiments allow the disclosure of the present invention to be complete, and those of ordinary skill in the art to which the present invention pertains. It is provided to fully understand the scope of the present invention to those skilled in the art, and the present invention is only defined by the scope of the claims.

The terminology used herein is for the purpose of describing the embodiments and is not intended to limit the present invention. In this specification, the singular also includes the plural unless specifically stated otherwise in the phrase. As used herein, “comprises” and/or “comprising” does not exclude the presence or addition of one or more other components in addition to the stated components. Like reference numerals refer to like elements throughout, and "and/or" includes each and every combination of one or more of the recited elements. Although "first", "second", etc. are used to describe various elements, these elements are not limited by these terms, of course. These terms are only used to distinguish one component from another. Accordingly, it goes without saying that the first component mentioned below may be the second component within the spirit of the present invention.

Unless otherwise defined, all terms (including technical and scientific terms) used herein will have the meaning commonly understood by those of ordinary skill in the art to which this invention belongs. In addition, terms defined in a commonly used dictionary are not to be interpreted ideally or excessively unless specifically defined explicitly.

1 is a diagram schematically illustrating a medication management method according to an embodiment.

Referring to FIG. 1 , a medication management system according to an embodiment may include a medication management device 10 , a medication management terminal 100 , a server 20 , and a distribution center 30 responsible for delivery of food and drugs. there is. The medication management device 10 is a device for managing medication medication in a calendar form, and a fixing unit capable of fixing a plurality of individually wrapped medication sheets in a single medication unit and a calendar display even when the plurality of medication paper sheets are fixed. It may include a background part arranged so as to be recognizable. In addition, it may further include a lighting unit for exposing the medicine sheet to lighting, a photographing unit for photographing the medicine sheet exposed to the lighting, and a transmission unit for transmitting the photographed image to the medication management terminal 100 or the server 20 .

According to an embodiment, the medication management terminal 100 determines a medication time and whether to take a medication based on the received captured image, and manages the user's medication based on this. For example, the medication management terminal 100 may provide medication guidance and information according to a medication plan to the user, or perform medication notification/management according to a specified time and situation through a push alarm or the like. As another example, the terminal 100 may recognize the symbol or date printed on the medicine wrapper in the captured image, and notify the administration of food and medicine according to the corresponding schedule.

In addition, the terminal 100 may determine that the user has detached the medicine forge when the designated position of the medicine forge is changed in the received captured image, and may determine that the medicine contained in the medicine has been taken. For example, when the user ignores the medication notification and moves out of a predetermined area, the terminal 100 may analyze the received image to determine whether to actually take medication.

Alternatively, the terminal 100 may determine that the user has detached the medicine tablet when the designated position of the medicine tablet is changed in the received captured image, and may determine that the user has completed the preparation step for taking the medicine.

Also, although not shown in FIG. 1 , the terminal 100 may determine whether the user has omitted medication based on a beacon (not shown), and in this case, may provide a medication notification to the user. Of course, various communication signal information such as Bluetooth, WIFI, and GPS coordinates that are conventionally installed as well as a beacon may be used.

For example, since the place where users regularly take food and drugs is fixed, the medication management terminal 100 uses a beacon mounted at a predetermined location every time the terminal 100 passes the corresponding location. You can have notifications generated. Conversely, when the terminal 100 is out of the designated network location (eg, when there is a high possibility of omitting the medication), the terminal 100 determines that a medication alarm is necessary, and may generate a notification and provide it to the user.

Meanwhile, the terminal 100 may transmit feedback data to the server 20 . Here, the feedback data may be data monitored whether the purchaser is properly taking food and drugs according to the medication plan. In addition, the feedback data may include at least one of a buyer's health, lifestyle, eating habits, or medication habits collected through big data. In addition, the feedback data may be data collected by the purchaser's terminal, or may be collected in response to medication information recorded by the user or a survey. The server 20 may periodically or irregularly revise the user's medication plan by using the received feedback data.

For example, it is possible to change the medication plan by determining whether the user prefers capsule-type pills or powdered pills. As another example, the medication plan may be changed by determining whether the user prefers to take medication regularly at every meal or only once a day. Furthermore, an appropriate medication plan may be set according to the efficacy of the medication being taken.

The server 20 may transmit the changed medication plan to the distribution warehouse 30, so that the food and medicines are regularly delivered to the user in the distribution warehouse. Here, the food and drug may be individually packaged in a medication unit and provided to the user. In general, prescription drugs can be managed using individual packaging provided by pharmacies. Alternatively, in the case of food whose components are separately purchased, such as nutritional supplements, the convenience of administration may be secured by providing separate individual packaging during delivery.

Meanwhile, as described above, according to the medication management system and method according to an embodiment of the present invention, it is possible to assist users to more conveniently and regularly take long-term medication, which is easy to miss the medication time.

In addition, a personalized medication plan can be established through the medication habits and lifestyle collected through the medication management device, so that food and drugs more suitable for the health promotion of the purchaser can be provided regularly.

Hereinafter, a medication management method according to an embodiment will be described in detail with reference to FIGS. 2 to 6 .

2 is a flowchart illustrating a medication management method according to an embodiment.

Referring to FIG. 2 , in step S200 , the medication management terminal 100 according to an embodiment may receive a photographed image obtained by photographing a plurality of medication tablets fixed to the medication management apparatus 10 . Since the medication management apparatus 10 according to an embodiment includes a photographing unit and a communication unit, the fixed medication sheet may be photographed at a predetermined period and transmitted to the medication management terminal 100 through the communication unit.

In more detail, FIG. 3 is a diagram for explaining in detail a medication management apparatus according to an embodiment.

Referring to FIG. 3 , it may be implemented in the form of a calendar so that a user can easily recognize a medication schedule according to an embodiment. The medication management device 10 includes a fixing part 203 capable of fixing a plurality of medicine wrappers individually packaged in units of one-time medication, and a background part arranged so that even when the plurality of medicine wrappers are fixed, a calendar display is visible. (205), a lighting unit 201 for exposing the medicine sheet to lighting, a photographing unit 202 for photographing the medicine sheet exposed to the lighting, and a transmission unit (not shown) for the captured image to the medication management terminal 100. can

The lighting unit 201 and the photographing unit 202 according to an embodiment may be positioned above the medication management device 10 and may photograph a plurality of fixed medication tablets 204 regardless of time and light or shade.

The fixing part 203 according to an embodiment is implemented in the form of a clip, so that it can be fixed regardless of the specifications of the conventionally marketed yakpoji 204 . Of course, those skilled in the art to which the present invention pertains can easily understand that the configuration of the fixing unit 203 is not necessarily limited to this state, and may include any configuration capable of fixing the yakpoji of various standards as it is.

For example, FIG. 4 shows a side view (FIG. 4(a)) and a front view (FIG. 4(b)) of the medication management apparatus according to an embodiment.

Referring to FIG. 4 , the fixing unit 202 is located on the upper portion of the medication management device, and includes a clasp that can be fixed by stacking the plurality of medication papers, and at least one medication paper can be detached from the fixed state. In particular, it may be fixed by stacking a plurality of them, regardless of the standard of conventionally marketed medicinal paper.

In addition, the medication management apparatus 100 according to an embodiment may be configured in a form in which only a plurality of medication tablets can be stacked in one line without including the background unit 205 .

In addition, the lighting unit 201 may include at least one or more LED lights, and the photographing unit 202 may be disposed between the lighting units 201 to more efficiently photograph the weak spots 204 .

Referring back to FIG. 2 , in step S210 , the medication management terminal 100 according to an embodiment identifies the medication plan of the medication and the change in the location of the medication in the received captured image.

Next, in step S220, the medication management terminal according to an embodiment may provide a medication alarm to the user according to the medication plan of the medication book. Here, the medication notification may include various alarms related to the user's medication information, medication notification, and other health care.

On the other hand, the medication notification may be determined from the data directly received by the terminal 100 from the medication management device 10 , or may be received via the server 20 .

In step S230, the medication management terminal 100 according to an embodiment may determine whether to take the medication based on the change in the location of the medication location.

For example, the medication management terminal 100 may determine that the user has taken the food and medicine of the medication when a change in the position of the medication is detected.

As another example, the medication management terminal according to an embodiment determines that the medication preparation is in a state of preparation when detachment of the medication paper is detected based on the change in the location of the medication paper (eg, when the user detaches the medication paper to be taken at lunch in the morning) , school/company is determined to be ready to take the medicine), and only when the medicine is in the ready state, a medication alarm may be provided to the user at a specific time and date based on the medication plan.

In step S240, the medication management terminal according to an embodiment may transmit the feedback data to the server so that new food and medicine can be delivered when the number of pill papers identified in the captured image is reduced to a predetermined number or less. That is, even if the user does not have much interest in the quantity of food and drug for long-term use, it can be controlled so that food and drugs are properly delivered without inconvenience.

In addition, the feedback data may include at least one of a user's health, lifestyle, eating habits, and medication habit, and the medication plan to be delivered may be changed based on the feedback data.

Meanwhile, FIG. 5 illustrates an example in which the medication management terminal provides an alarm to a user according to an embodiment.

Referring to FIG. 5 , the medication management terminal 100 may determine whether the user has omitted medication based on the beacon 502 , and may provide a medication notification to the user. In general, since the place where users regularly take food and drugs is fixed, the medication management terminal 100 may generate a notification whenever the terminal 100 leaves the predetermined area 501 . For example, the terminal 100 may determine that the beacon 502 or a case outside a predetermined network location (WiFi, Bluetooth, etc.) is a case in which medication is highly likely to be omitted, and may generate a notification and provide it to the user.

6 is a block diagram schematically showing the configuration of the medication management terminal 100 according to an embodiment.

The medication management terminal 100 according to an embodiment may include a processor 110 , a memory 120 , and a communication module 130 . The operation of the medication management terminal 100 may be performed by executing a program stored in the memory 120 through the processor 110 . Although FIG. 6 shows only a configuration for explaining the operation of the medication management terminal 100 for convenience of explanation, the present invention can further include various configurations for performing the operation described above in FIGS. 1 to 5 . It will be apparent to those skilled in the art.

The processor 110 according to an embodiment communicates with the medication management device 10 and the server 20 through the communication module 130 , and may control to transmit/receive captured image data, medication plan, feedback data, and the like.

Communication module 130 according to an embodiment is LAN (Local Area Network), eMBB (enhanced Mobile Broadband), URLLC (Ultra Reliable Low-Latency Communications), MMTC (Massive Machine Type Communications), LTE (long-term evolution) , LTE Advance (LTE-A), Universal Mobile Telecommunications System (UMTS), Global System for Mobile communications (GSM), code division multiple access (CDMA), wideband CDMA (WCDMA), Wireless Broadband (WiBro), wireless fidelity (WiFi) ), Bluetooth, near field communication (NFC), global positioning system (GPS), or global navigation satellite system (GNSS) can perform wired and wireless communication.

Meanwhile, the medication management terminal 100 according to an embodiment may include one or more processors 110 and/or one or more memories 120 . Also, the memory 120 may include volatile and/or non-volatile memory. The one or more memories 120 may store instructions that, when executed by the one or more processors 130 , cause the one or more processors 110 to perform an operation.

In one embodiment, the operation performed by the one or more processors 110 may determine the medication time and whether to take medication based on the received captured image, and perform medication management of the user based on this. there is.

In addition, the processor 130 may perform an operation to determine whether to take the medicine based on the change in the position of the medicine forge in the received photographed image.

In addition, the processor 130 transmits the feedback data to the server so that new food and medicine can be delivered when the number of medicine tablets identified in the photographed image is reduced to a predetermined number or less, and automatically delivered regularly at a time point desired by the user. service can be used.

The steps of a method or algorithm described in relation to an embodiment of the present invention may be implemented directly in hardware, as a software module executed by hardware, or by a combination thereof. A software module may contain random access memory (RAM), read only memory (ROM), erasable programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), flash memory, hard disk, removable disk, CD-ROM, or It may reside in any type of computer-readable recording medium well known in the art to which the present invention pertains.

As mentioned above, although embodiments of the present invention have been described with reference to the accompanying drawings, those skilled in the art to which the present invention pertains know that the present invention may be embodied in other specific forms without changing the technical spirit or essential features thereof. you will be able to understand Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive.

Claims (10)

a communication module for receiving an image in which a plurality of medication tablets fixed to the medication management device are photographed; and
A processor for identifying the drug posi in the image, and determining whether to take the medicine based on the identification result of the medicine posi;
The processor is
Based on the change in the position of the medicine forge in the image, it is determined whether the medicine forge is detached from the medication management device,
Determining whether to take the medication based on the determined result,
An image analysis-based food and drug administration terminal. According to claim 1,
The processor is
When the designated position of the medicinal forge in the image is changed, determining that the medicinal forge is detached,
An image analysis-based food and drug administration terminal. 3. The method of claim 2,
The processor is
Further identifying the medication plan of the medicine forge in the image,
Based on the identified medication plan, providing a medication notification to the user,
An image analysis-based food and drug administration terminal. 4. The method of claim 3,
The processor is
When the medicine forge is detached, it is determined that the user is in a state where the medicine is ready,
When the medication is in a ready state, based on the medication plan, providing the medication alarm,
An image analysis-based food and drug administration terminal. 5. The method of claim 4,
The processor is
providing the medication alarm when it is determined that the medication management terminal is out of a preset area in the state where the medication is ready;
An image analysis-based food and drug administration terminal. 6. The method of claim 5,
A preset network is provided in the preset area,
The processor is
providing the medication alarm when it is determined through the communication module that the medication management terminal is out of the preset network location;
An image analysis-based food and drug administration terminal. 6. The method of claim 5,
A beacon for recognizing the location of the medication management terminal is provided in the preset area,
The processor is
When it is determined that the beacon is out of the radius through the communication module, providing the medication alarm,
An image analysis-based food and drug administration terminal. 4. The method of claim 3,
The processor is
Transmitting feedback data related to food and drug delivery to an external server through the communication module based on a change in the quantity of the medicine forge in the image,
An image analysis-based food and drug administration terminal. 4. The method of claim 3,
The processor is
When it is determined that the quantity of the medicine pills in the image is reduced to less than a preset number, transmitting the feedback data to the external server so that a new food and drug is delivered to the user,
An image analysis-based food and drug administration terminal. 9. The method of claim 8,
The feedback data includes at least one of a user's health, lifestyle, eating habit, and medication habit,
The new food and drug medication plan to be delivered to the user is changed by the external server based on the feedback data,
An image analysis-based food and drug administration terminal.

Images