JP2022187605A - Medicine detection system - Google Patents

Abstract

To provide a medicine detection system capable of saving input labor and easily converting medicine information into data.SOLUTION: A medicine detection system 10 includes a data server 11, a mobile terminal 12, a feature amount detection device 13, a medicine name detection device 14, and a medicine number detection device 15. The mobile terminal 12 includes a camera 31, a touch panel 32, a mobile control unit 33, a mobile communication unit 34, and a mobile storage unit 35. The feature amount detection device 13 detects a feature amount (overall shape and character shape) of a medicine based on an image captured by the camera 31 of the mobile terminal 12 and transmits the detected feature amount to the medicine name detection device 14. The medicine name detection device 14 detects a feature amount that matches the detected feature amount detected by the feature amount detection device 13 from among various feature amounts of various medicine information stored in the mobile storage unit 35 and detects a name of a medicine corresponding to the detected feature amount as a name of the medicine captured by the camera 31.SELECTED DRAWING: Figure 1

Description

The present invention relates to drug detection systems.

Conventionally, a receipt computer is known as a computer system for creating a receipt (medical fee statement) for claiming medical fees from a medical facility to a payment organization such as a health insurance association (see, for example, Patent Document 1). )

A receipt computer is used, for example, in a pharmacy, and stores information such as paper prescription information prescribed at a hospital for each patient. The receipt computer is equipped with a two-dimensional code reader, and the two-dimensional code that indicates the prescription information written on the paper prescription is read by the two-dimensional code reader. information is stored in the receipt computer.

JP 2018-32381

However, there are cases where the patient takes a drug that he/she has purchased by himself/herself, in addition to the prescription. Since information, etc., is converted into data and stored in the receipt computer, it takes time and effort to input.

SUMMARY OF THE INVENTION An object of the present invention is to provide a drug detection system that saves the trouble of inputting information and can easily convert drug information into data.

[1] A drug detection system of the present invention is a drug detection system that recognizes a drug and detects the name of the drug. a feature amount detection device for detecting the feature amount of the drug; a storage device for storing drug information having the feature amount for recognizing the drug and the name of the drug in association with each other; and detected by the feature amount detection device. drug name detection for recognizing the drug photographed by the camera and detecting the name of the recognized drug based on the detected feature amount and the feature amount of the drug information stored in the storage device; and a device.

According to the present invention, the name of the recognized drug can be detected by recognizing the drug photographed by the camera. , drug information can be easily converted into data.

[2] It is preferable to provide a medicine number detection device for detecting the number of medicines photographed by the camera based on the detected feature quantity detected by the feature quantity detection device.

According to the above configuration, since the number of drugs can be detected, compared with the method of detecting the number of drugs by visually recognizing the drugs, the labor of inputting can be saved, and the information on the number of drugs can be easily converted into data. can be done.

[3] The storage device stores information on the overall shape of the drug as a feature amount for recognizing the drug, and the feature amount detection device stores information on the overall shape of the drug as the feature amount of the drug. The drug name detection device uses the camera based on the information on the overall shape of the drug detected by the feature amount detection device and the information on the overall shape of the drug stored in the storage device It is preferable to recognize the photographed drug and detect the name of the recognized drug.

According to the above configuration, the name of the drug is detected based on the overall shape of the drug, so the name of the drug can be easily detected.

[4] The storage device stores information of a character shape drawn around the drug as a feature quantity for recognizing the drug, and the feature quantity detection device stores the character shape information of the drug as the feature quantity of the drug. The drug name detection device detects the character shape information drawn around the medicine, and the drug name detection device detects the character shape information drawn around the medicine detected by the feature amount detection device and the character shape information stored in the storage device. It is preferable to recognize the drug photographed by the camera and detect the name of the recognized drug based on the character shape information drawn around the drug.

According to the above configuration, the name of the drug is detected based on the information of the character shape drawn around the drug, so the name of the drug can be easily detected.

[5] It is preferable to provide a drug information acquisition device that acquires information on the detected drug based on the name of the drug detected by the drug name detection device.

According to the above configuration, it is possible to acquire the information of the detected drug. Therefore, compared with the case where the information of the drug is acquired manually, the labor of inputting can be saved, and the information of the drug can be easily converted into data. .

1 is a schematic diagram showing an outline of the configuration of a drug detection system according to one embodiment of the present invention; FIG. Explanatory drawing which shows a medicine package. The figure which shows the state which has image|photographed the medicine with the camera of the portable terminal. The figure which shows the state which displayed the detailed information of the medicine on the touch panel of the portable terminal. The figure which shows the state which expanded and displayed the detailed information of the medicine on the touch panel of the portable terminal.

Embodiments of the present invention will be described below with reference to the drawings.

First, with reference to FIG. 1, an outline of the configuration of a drug detection system 10 according to one embodiment of the present invention will be described.

The drug detection system 10 recognizes drugs packaged in drug packages (see FIG. 2) and detects the names and numbers of the drugs D. 13, a drug name detection device 14, and a drug number detection device 15, which are installed in, for example, a pharmacy.

The data server 11 includes a server storage unit 21 that stores detailed information on various drugs, and a server communication unit 22 that can communicate with the outside. The server storage unit 21 is configured by a storage device such as a ROM (Read Only Memory), a RAM (Random Access Memory), and an HDD (Hard Disk Drive).

In this embodiment, the data server 11 is configured by, for example, a data server managed by PMDA (Pharmaceuticals and Medical Devices Agency).

The mobile terminal 12 is configured by, for example, a smartphone, and includes a camera 31, a touch panel 32, a mobile control unit 33 configured by a CPU and the like, and controlling the mobile terminal 12 in an integrated manner, and a mobile communication unit 34 capable of communicating with the outside. , and a portable storage unit 35 , and can communicate with the data server 11 . The portable storage unit 35 is configured by a storage device such as a ROM, for example. Communication between the data server 11 and the portable terminal 12 may be either wireless or wired.

The portable storage unit 35 associates and stores drug information having feature amounts for recognizing various drugs with names of the corresponding drugs.

In this embodiment, the overall shape of the drug and the character shape drawn around the drug are used as feature amounts for recognizing various drugs.

The mobile terminal 12 is provided with a medicine detection mode, and when the mobile terminal 12 shifts to this medicine detection mode, medicine detection, which will be described later in detail, is executed.

The feature quantity detection device 13 is built in the mobile terminal 12, for example, and detects the feature quantity (for example, the overall shape and character shape) of the drug based on the captured image captured by the camera 31 of the mobile terminal 12.

Various programs such as an OCR program for operating OCR (Optical Character Recognition) for recognizing characters written in a photographed image are stored in the mobile terminal 12, and the OCR program is read. The name of the drug may be detected based on an image captured by the camera 31 of the mobile terminal 12, or drug detection based on shape and drug detection based on character recognition may be performed in combination. .

The drug name detection device 14 is built in the portable terminal 12, for example, and includes the detected feature quantity (overall shape and character shape) detected by the feature quantity detection device 13 and the feature quantity of the drug information stored in the portable storage unit 35 ( The medicine photographed by the camera 31 is recognized based on the overall shape and character shape), and the name of the recognized medicine is detected.

The number-of-medicine detection device 15 is built in, for example, the mobile terminal 12, and includes a captured image captured by the camera 31 of the mobile terminal 12, the detected feature amount (overall shape and character shape) detected by the feature amount detection device 13, Based on the names of drugs detected by the drug name detection device 14, the number of drugs whose names are detected is detected.

[Drug detection]
Next, the flow of recognizing drugs and detecting the names and numbers of the drugs using the drug detection system 10 will be described.

First, a pharmacy clerk (hereinafter referred to as an operator) who operates the drug detection system 10 operates the touch panel 32 of the mobile terminal 12 to switch the mobile terminal 12 to a drug detection mode. The transition to the drug detection mode is performed by the mobile control unit 33 of the mobile terminal 12 .

Next, as shown in FIG. 3, the operator takes a picture of the drug package handed over by the patient with the camera 31 of the mobile terminal 12 (touches the circle below the characters in the picture). The portable control unit 33 stores the photographed image data of the drug in the portable storage unit 35 and transmits the data to the feature amount detection device 13 .

In this embodiment, for example, the name of the drug is "abc tablet" and the character shape drawn around the drug is "abc tablet".

The feature amount detection device 13 recognizes the drug packed in the drug package based on the captured image captured by the camera 31 of the mobile terminal 12, and detects the feature amount (overall shape and character shape) of the recognized drug. Then, the detected feature amount is transmitted to the drug name detection device 14 .

In the present embodiment, the character shape drawn around the medicine is "abc tablet", and "abc tablet" is detected as the character shape that is the feature quantity of the recognized medicine.

"abc tablet" is not detected as a character shape, but "ab tablet", "ac tablet", "abc", and "bc tablet" are detected as character shapes due to the orientation of the drug package at the time of shooting, the way the light hits it, etc. Sometimes. Even in this case, "ab tablet", "ac tablet", "abc", "bc tablet", "ab tablet", "ac tablet", "abc tablet", "bc tablet ” is stored in the portable storage unit 35 . Note that the feature quantity (character shape) to be stored can be changed as appropriate.

In the present embodiment, the feature amount detection device 13 repeatedly performs well-known machine learning (supervised learning: an algorithm that learns to produce a correct output when given an input and its correct output as learning data). This improves the ability to detect drug feature amounts (overall shape and character shape).

The drug name detection device 14 selects the detection feature quantity (overall shape and character shape) detected by the feature quantity detection device 13 from various feature quantities (overall shape and character shape) of various drug information stored in the portable storage unit 35 . shape).

The drug name detection device 14 detects the name of each drug stored in the portable storage unit 35 when a feature quantity that matches the detected feature quantity (overall shape and character shape) detected by the feature quantity detection device 13 is found. The name of the drug corresponding to the retrieved feature amount is detected from among them, and the name of the drug corresponding to the retrieved feature amount is detected as the name of the drug photographed by the camera 31 .

Alternatively, the drug name detected by the drug name detection device 14 may be output as voice from a speaker (not shown) of the mobile terminal 12 . As a result, the operator can confirm whether the detection result is correct or not, and if the detection result is not correct, the operator can photograph again with the camera to detect the drug.

The mobile control unit 33 stores the drug name data detected by the drug name detection device 14 in association with the patient name in a storage device for storing patient information in the pharmacy.

The number-of-drugs detection device 15 detects the captured image captured by the camera 31 of the mobile terminal 12, the detected feature amounts (overall shape and character shape) detected by the feature amount detection device 13, and the detected by the drug name detection device 14. For example, the number of drugs having the same detected feature amount (overall shape and character shape) is detected as the number of drugs whose names are detected.

The mobile control unit 33 stores the drug quantity data detected by the drug quantity detection device 15 in association with the patient name in a storage device for storing patient information in the pharmacy.

In addition, the mobile control unit 33 transmits drug name data detected by the drug name detection device 14 to the data server 11 via the mobile communication unit 34 .

Then, the detailed information of the drug that matches the drug name data transmitted from the portable terminal 12 is searched from among the detailed information of various drugs stored in the server storage unit 21 of the data server 11, and the searched drug is retrieved. is transmitted to the mobile terminal 12 via the server communication unit 22 .

As shown in FIG. 4 , the mobile control unit 33 of the mobile terminal 12 displays the detailed information on the drug transmitted from the data server 11 on the touch panel 32 . In addition, in FIG. 4, as the detailed information of the drug, the detailed information of "CAMCIA combination tablet LD 'SAND'" is simply displayed.

In addition, as shown in FIG. 5 , the mobile control unit 33 enlarges (converts) the detailed information of the drug to a display suitable for the touch panel 32 and displays it. For example, in the case of the detailed information of “Camsia combination tablet LD “sandwich””, the data is data (for example, PDF data) in which two paragraphs on the left and right are displayed on one page (see FIG. 4). As detailed information, first the left paragraph of the first page is displayed (see FIG. 5), and then the right paragraph of the first page is displayed. This makes it easier to check the detailed information of the drug than when two paragraphs on the left and right of one page are displayed at the same time.

Then, the operator stores the detailed information on the drug transmitted from the data server 11 in the storage device for storing patient information in the pharmacy.

This makes it possible to obtain information on drugs brought in by patients rather than drugs prescribed at hospitals.

In this way, the name of the recognized drug can be detected by recognizing the drug photographed by the camera 31. Therefore, compared to the method in which the name of the drug is detected by visually recognizing the drug, labor for inputting can be saved. Drug information can be easily converted into data.

In addition, since the number of medicines photographed by the camera 31 is detected based on the detection feature amount, the number of medicines can be easily input, and information on the number of medicines can be obtained, compared to the method in which the number of medicines is detected by visually recognizing the medicines. Data can be easily converted.

Furthermore, the name of the drug is detected based on the information on the overall shape of the drug and the character shape drawn around the drug, so the name of the drug can be easily detected.

In addition, since detailed information on the detected drug is acquired based on the name of the detected drug, it is possible to save the time and effort of inputting drug information and easily obtain drug information compared to manual acquisition of drug information. can be

Although the present invention has been described in terms of its preferred embodiments, it should be readily apparent to those skilled in the art that the present invention is not limited to such embodiments and that departures from the spirit of the invention are not intended to be construed as limiting the scope of the invention. It can be changed appropriately as long as it does not occur.

For example, in the above embodiments, the name and number of drugs are detected, but at least the name of the drug should be detected.

Although the data server 11 is included in the drug detection system 10 in the above embodiment, the data server 11 may not be included in the drug detection system 10 .

In the above embodiment, the feature amount detection device 13, the drug name detection device 14, and the drug quantity detection device 15 are provided in the mobile terminal 12, but they may be provided separately from the mobile terminal 12. FIG.

In the above embodiment, information on the overall shape of the medicine and the character shape drawn around the medicine are detected as feature amounts, but only one of them may be detected as the feature amount. The feature amount of the drug to be detected can be changed as appropriate, and for example, the width, character information, or the like may be detected as the feature amount of the drug.

DESCRIPTION OF SYMBOLS 10... Drug detection system, 11... Data server, 12... Portable terminal, 13... Characteristic amount detection device, 14... Drug name detection device, 31... Camera, 32... Touch panel (display device)

Claims (5)

A drug detection system that recognizes a drug and detects the name of the drug,
a camera for photographing the drug;
a feature amount detection device that detects the feature amount of the drug based on the captured image captured by the camera;
a storage device that associates and stores drug information having a feature amount for recognizing the drug and the name of the drug;
The drug photographed by the camera is recognized based on the detected feature amount detected by the feature amount detection device and the feature amount of the drug information stored in the storage device, and the recognized drug is detected. a drug name detection device that detects a name;
A drug detection system comprising: The drug detection system of claim 1,
A drug detection system, comprising: a drug number detection device that detects the number of drugs photographed by the camera based on the detected feature quantity detected by the feature quantity detection device. In the drug detection system according to claim 1 or 2,
The storage device stores information on the overall shape of the drug as a feature amount for recognizing the drug,
The feature amount detection device detects information on the overall shape of the drug as the feature amount of the drug,
The drug name detection device is based on the information on the overall shape of the drug detected by the feature amount detection device and the information on the overall shape of the drug stored in the storage device. A drug detection system that recognizes the drug and detects the name of the recognized drug. In the drug detection system according to any one of claims 1 to 3,
The storage device stores information of a character shape drawn around the drug as a feature amount for recognizing the drug,
The feature amount detection device detects character shape information drawn around the drug as the feature amount of the drug,
The drug name detection device stores character shape information drawn around the drug detected by the feature quantity detection device and character shape information drawn around the drug stored in the storage device. and detecting the name of the recognized drug by recognizing the drug photographed by the camera. In the drug detection system according to any one of claims 1 to 4,
A drug detection system, comprising: a drug information acquisition device that acquires information on the detected drug based on the name of the drug detected by the drug name detection device.

Images