JP2017127407A - Dispensing inspection device and method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a dispensing inspection device and method, and a program capable of reliably inspecting whether or not dispensing has been properly performed.SOLUTION: A dispensing inspection device detects a medicine name using optical character recognition and/or code recognition from a first image 110 taken of a medicine sheet placed on a first placement table by a first imaging device 26. The dispensing inspection device detects the number of medicine sheets from a second image 120 taken of the medicine sheets placed on the first placement table by a second imaging device 28, detects the number of fractional medicines from a third image 130 taken of fractional medicines placed on a second placement table by a third image device 30, and detects a total number of medicines. The dispensing inspection device detects a medicine name of fractional medicines from the third image, and determines whether or not the medicine name and the number of medicines according to the prescription information coincide with the detected medicine name and total number of medicines.SELECTED DRAWING: Figure 7

Description

  The present invention relates to a dispensing inspection apparatus and method, and a program, and more particularly, to a dispensing audit support technique for determining whether dispensing has been performed correctly.

  Dispensing pharmacies dispense drugs based on prescriptions issued by doctors. Dispensing includes “picking”. In addition, after dispensing based on a prescription at a dispensing pharmacy or the like, a dispensing audit is performed to check whether the dispensing is definitely performed according to the prescription, such as the type of drug or the number of drugs. Dispensing audit is also called “Dispensing medicine audit”.

  Dispensing audits are usually performed by visual confirmation by a pharmacist who is different from the pharmacist who performed the dispensing. That is, a pharmacist who is different from the pharmacist who performed dispensing confirms, for example, the name of the drug written on the back surface of a dispensed PTP (Press Through Package) sheet, and further, the number of PTP sheets and fractional drugs. The number of drugs is visually confirmed and the number of drugs is counted. Then, it is confirmed whether the name of the dispensed drug and the number of drugs match the contents of the prescription.

  Thus, since the current dispensing audit relies on visual confirmation by a pharmacist, it is not necessarily sufficient to prevent dispensing accidents. Dispensing audits are also a burden on pharmacists. In order to solve such a problem, an apparatus for supporting a dispensing audit has been proposed.

  Patent Document 1 describes a drug inspection system that performs a dispensing audit by taking an image of a medicine to be audited and analyzing the taken image. In the medicine inspection system described in Patent Document 1, the color of a binding tool such as a rubber band is determined for each number of medicine sheets of the medicine to be audited. After that, the medicine to be audited is dispensed with a binding tool of a color according to the number of the medicine sheets, and the surface on which the barcode of the medicine sheet is displayed faces the camera and is placed on the mounting table. Put. Next, the auditable medicine placed on the mounting table is photographed, the medicine name of the auditable medicine is detected from the barcode of the photographed image, and the number of medicine sheets of the auditable medicine is detected from the color of the binding tool Detect the number of drugs.

  In another aspect of the drug inspection system described in Patent Document 1, the number of drug sheets is known by measuring the height of a drug to be audited placed on a placement table instead of the color of a binding tool. The number of drugs is detected.

  In the medicine inspection system described in Patent Literature 1, the medicine to be audited is placed on the placement table with the surface of the medicine sheet on which the barcode is displayed facing upward, and the medicine to be audited is placed from above the placement table. The mode of imaging and the imaging table are made transparent, the drug sheet bar code surface is facing down, the auditable drug is placed on the mounting table, and the auditable drug is imaged from below the mounting table Are described.

  In patent document 1, according to the aspect which image | photographs from the downward direction of a mounting base, the distance with the surface with which the barcode of a chemical | medical agent sheet is displayed, and a camera is equal irrespective of the number of the chemical | medical agent sheets which an inspection object chemical | medical agent has. Therefore, it is always possible to obtain an image obtained by photographing the barcode with high definition, focusing on the surface of the medicine sheet where the barcode is displayed.

JP2013-214170A

  By using a drug inspection system as described in Patent Document 1, it is possible to reduce the burden on the pharmacist in dispensing inspection.

  However, in the medicine inspection system described in Patent Document 1, the color of the binding tool is determined for each number of medicine sheets of the medicine to be audited, and the object to be audited using the binding tool of the color determined for each number of medicine sheets. It is necessary to bind the drugs. Therefore, it takes a lot of time for dispensing inspection, and there is also a possibility that the medicine to be audited may be bound using a binding tool of wrong color.

  On the other hand, in the aspect of measuring the height of the medicine to be inspected, it is necessary to measure and store the height (thickness) for each kind of the medicine sheet in advance, which is also troublesome.

  In addition, the prescribed medicine often includes not only a complete medicine sheet but also a fraction of a medicine cut from the medicine sheet. However, in the medicine inspection system of Patent Document 1, the number of medicines in the fraction is considered. Not.

  DISCLOSURE OF THE INVENTION The present invention has been made in view of such circumstances, and a dispensing inspection apparatus and method that can perform audits of medicines to be audited, including fractional medicines, with high reliability and ease. It aims at providing a program.

  As means for solving the problems, the following aspects of the invention are provided.

  The dispensing inspection device according to the first aspect includes a first placement table for placing a medicine sheet, a second placement table for placing a fraction of the medicine cut from the medicine sheet, and a medicine placed on the first placement table. First imaging means for imaging the sheet from the first direction, second imaging means for imaging the drug sheet placed on the first mounting table from a second direction different from the first direction, and mounting on the second mounting table The medicine name of the medicine sheet is detected from at least one of optical character recognition and code recognition from the third photographing means for photographing the fractioned medicine and the first image which is an image photographed by the first photographing means. The first medicine name detection means, the number detection means for detecting the number of medicine sheets from the second image which is an image taken by the second imaging means, and the fractional number from the third image which is an image taken by the third imaging means. A fraction drug number detecting means for detecting the number of drugs, and a drug sheet Corresponding to the prescription instructions, the total drug number detection means for detecting the total drug number from the number of sheets and the number of fractional drugs, the second drug name detection means for detecting the drug name of the fractional drug from the third image Whether the drug name and the number of drugs in the prescription information match the drug name detected by the first drug name detecting unit and the second drug name detecting unit and the total number of drugs detected by the total drug number detecting unit, respectively. A dispensing audit apparatus comprising: an audit result determination unit that determines whether or not.

  A “drug sheet” is a sheet in which a plurality of drugs are packaged in a package. A typical example of the drug sheet is a PTP sheet of a dispensing packaging unit in which PTP is packaged.

  According to the first aspect, it is determined whether or not the medicine name of the medicine sheet placed on the first placement table matches the medicine name of the fractional medicine placed on the second placement table. It is possible to perform audits with high reliability and simpleness, including fractional drugs, for drugs to be audited.

  The second aspect is the dispensing inspection device according to the first aspect, wherein the second medicine name detecting means uses a dictionary in which the feature of the medicine image and the medicine name are associated with each other, and the fraction medicine is obtained by pattern recognition from the third image. It can be set as the structure which detects the chemical | medical agent name.

  According to a third aspect, the dispensing inspection device of the second aspect includes a dictionary data generation unit that generates dictionary data from the third image and the drug name detected by the first drug name detection unit. it can.

  A 4th aspect can be set as the structure provided with the dictionary update means which performs the additional learning using the 3rd image, and the process which updates a dictionary in the dispensing inspection apparatus of the 2nd aspect or the 3rd aspect.

  In the dispensing inspection device according to the fourth aspect, the fifth aspect causes additional learning to be executed when the drug name detected by the first drug name detection unit and the drug name detected by the second drug name detection unit do not match. An operation means for giving an instruction can be provided.

  The sixth aspect is configured such that, in the fourth aspect or the fifth dispensing inspection apparatus, an operation means for giving an instruction to execute additional learning when the medicine name detected by the second medicine name detection means is incorrect. be able to.

  A seventh aspect is the dispensing inspection apparatus according to any one of the second to sixth aspects, wherein a server having dictionary storage means for storing a dictionary is connected to the network, and communicates with the server connected to the network. It can be set as the structure provided with the communication means to perform.

  According to an eighth aspect, in the dispensing inspection device according to any one of the first to seventh aspects, a configuration may be provided that includes display means for displaying information on a determination result by the audit result determination means.

  A ninth aspect is the dispensing inspection device according to any one of the first aspect to the eighth aspect, wherein the first imaging means is a medicine from below that is below the mounting surface of the first mounting table in the direction of gravity. It can be set as the structure which image | photographs a sheet | seat.

  According to a tenth aspect, in the dispensing inspection apparatus according to the ninth aspect, a diffusing illumination unit that irradiates the first mounting table with diffused light from below the first mounting table can be provided.

  An eleventh aspect is the dispensing inspection device according to any one of the first aspect to the tenth aspect, wherein the second imaging means images the drug sheet from the side of the first mounting table that is a direction non-parallel to the gravity direction. It can be set as the structure to do.

  According to a twelfth aspect, in the dispensing inspection device according to the eleventh aspect, the medicine sheet placed on the first placement table is provided with a side illumination unit that emits light from the side of the first placement table. it can.

  A thirteenth aspect is the dispensing inspection device according to any one of the first aspect to the twelfth aspect, wherein the third imaging means is a medicine with a fraction from the lower side that is lower than the placement surface of the second placement table in the direction of gravity. It can be set as the structure which image | photographs.

  A fourteenth aspect is the dispensing inspection device according to the thirteenth aspect, in which the second mounting table is irradiated with light from below the second mounting table in a state where the optical axis has an angle with respect to the imaging optical axis of the third imaging unit. It can be set as the structure provided with the oblique illumination means to do.

  According to the fifteenth aspect of the dispensing inspection method, the first imaging step of imaging the medicine sheet placed on the first placement table for placing the medicine sheet from the first direction and the first placement table The second imaging step of imaging the medicine sheet from a second direction different from the first direction, and the fraction of medicine placed on the second mounting table for placing the fraction of medicine cut from the medicine sheet. A first drug name detecting step of detecting a drug name of a drug sheet using at least one of optical character recognition and code recognition from a first image which is an image shot by the third shooting step and the first shooting step; A number detection step for detecting the number of drug sheets from the second image, which is an image taken in the second imaging step, and a fractional drug for detecting the number of fractional drugs from the third image, which is an image taken in the third imaging step Number detection process and drug sheet Corresponding to the prescription instructions, the total drug number detecting step for detecting the total drug number from the number and the number of fractional drugs, the second drug name detecting step for detecting the drug name of the fractional drug from the third image, The drug name and the number of drugs in the prescription information coincide with the drug name detected in each step of the first drug name detection step and the second drug name detection step and the total number of drugs detected in the total drug number detection step. An audit result determination step for determining whether or not there is a dispensing audit method.

  In the fifteenth aspect, matters similar to the matters specified in the second aspect to the fourteenth aspect can be appropriately combined. In this case, the means responsible for the process or function specified in the dispensing inspection apparatus can be grasped as an element of the “process (step)” of the corresponding process or operation.

  The program according to the sixteenth aspect is a first image for acquiring a first image that is an image obtained by photographing the medicine sheet placed on the first placement table for placing the medicine sheet from the first direction by the first photographing means. An acquisition function, a second image acquisition function for acquiring a second image, which is an image obtained by photographing the medicine sheet placed on the first placement table from the second direction different from the first direction by the second photographing means, and the medicine sheet A third image acquisition function for acquiring a third image, which is an image obtained by imaging the fractional medicine placed on the second mounting table for placing the fractional medicine cut from the second imaging means by the third imaging means; A first medicine name detection function for detecting a medicine name of a medicine sheet from one image using at least one of optical character recognition and code recognition; a number detection function for detecting the number of medicine sheets from a second image; Number of fractional drugs from 3 images A fraction drug number detection function to detect, a total drug number detection function to detect the total drug number from the number of drug sheets and the number of fraction drugs, and a second drug name to detect the drug name of the fraction drug from the third image Drug name detection function, drug name and number of drugs in prescription information corresponding to prescription instructions, drug name and total drug number detection function detected by each of the first drug name detection function and the second drug name detection function This is a program for causing a computer to realize an audit result determination function for determining whether or not the total number of drugs detected in (1) matches.

  In the sixteenth aspect, matters similar to the matters specified in the second aspect to the fourteenth aspect can be appropriately combined. In that case, the means responsible for the process or function specified in the dispensing inspection apparatus can be grasped as an element of the “function” of the program that performs the corresponding process or operation.

  According to the present invention, it is possible to perform a highly reliable dispensing audit including a fractional drug by simple conversion.

FIG. 1 is a block diagram showing a configuration of a dispensing inspection apparatus according to an embodiment of the present invention. FIG. 2 is a perspective view showing an example of the appearance of the scanner. FIG. 3 is a perspective view schematically showing an example of the configuration of the scanner. FIG. 4 is a perspective view schematically showing an example of the positional relationship between the side illumination device and the second imaging device. FIG. 5 is a perspective view schematically showing an example of a PTP sheet that is a medicine sheet in a dispensing packaging unit. FIG. 6 is a plan view showing an example of the back surface of the PTP sheet. FIG. 7 is a block diagram for explaining the function of the detection unit in the processing apparatus. FIG. 8 is a diagram illustrating an example of a first image obtained by photographing the back surface of the PTP sheet. FIG. 9 is a diagram illustrating an example of a second image obtained by photographing a side surface of a PTP sheet laminate in which a plurality of PTP sheets are laminated. FIG. 10 is a diagram illustrating an example of a second image obtained by photographing the side surface of the PTP sheet laminate in which a plurality of PTP sheets are laminated. FIG. 11 is a diagram illustrating another example of the second image obtained by photographing the side surface of the PTP sheet laminate. FIG. 12 is a diagram illustrating another example of the second image obtained by photographing the side surface of the PTP sheet laminate. FIG. 13 is a diagram illustrating an example of a third image obtained by photographing the front surface of the fractional medicine. FIG. 14 is a diagram showing a sheet region of fractional medicines extracted from the third image shown in FIG. FIG. 15 is a partial enlarged view in which a portion of the sheet area in the third image is cut out. FIG. 16 is a diagram illustrating an image obtained by extracting a bright part and a dark part from the image illustrated in FIG. 15. FIG. 17 is a diagram illustrating an image obtained by narrowing down drug candidate regions from the image illustrated in FIG. 16. FIG. 18 is a diagram illustrating an image obtained by rotating an image extracted as a drug candidate based on the image illustrated in FIG. FIG. 19 is a block diagram showing a main configuration of the dictionary updating function in the dispensing inspection device. FIG. 20 is a flowchart showing the procedure of the dispensing inspection method according to the embodiment of the present invention. FIG. 21 is a flowchart of a recognition process performed in the second medicine name detection step. FIG. 22 is a diagram illustrating a display example of a dispensing audit result by the dispensing inspection device. FIG. 23 is a diagram illustrating a display example of a dispensing audit result by the dispensing auditing device. FIG. 24 is a diagram illustrating a display example of a dispensing audit result by the dispensing inspection device. FIG. 25 is a flowchart of additional learning processing by the dispensing inspection device. FIG. 26 is a block diagram showing a system configuration example of a dispensing inspection apparatus according to another embodiment of the present invention.

  Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[Outline of dispensing inspection equipment]
FIG. 1 is a block diagram showing a configuration of a dispensing inspection apparatus 10 according to an embodiment of the present invention. The dispensing inspection apparatus 10 is an apparatus that supports dispensing audits by a pharmacist by auditing (confirming) whether or not a medicine dispensed by a pharmacist at a dispensing pharmacy or the like has been dispensed according to a prescription prescribed by a doctor. . The dispensing inspection device 10 includes a scanner 12, a processing device 14, a display unit 16, and an operation unit 18.

<Configuration of Scanner 12>
The scanner 12 is an apparatus that performs imaging of an audit target medicine to be audited. The scanner 12 includes a first mounting table 20, a second mounting table 24, a first imaging device 26, a second imaging device 28, a third imaging device 30, a diffuse illumination device 32, and a side illumination device 34. And an oblique illumination device 36.

  FIG. 2 is a perspective view showing an example of the appearance of the scanner 12. FIG. 3 is a perspective view schematically showing a part of the configuration of the scanner 12.

  The 1st mounting base 20 is a table for imaging | photography the PTP sheet | seat which is a chemical | medical agent sheet of a dispensing packaging unit among the chemical | medical agents to be audited. One or a plurality of PTP sheets are mounted on the first mounting table 20. When there is one PTP sheet of the medicine to be inspected, the back surface of the PTP sheet faces the mounting surface 20a of the first mounting table 20 (that is, the back surface of the PTP sheet faces downward), and the PTP sheet is It is mounted on the first mounting table 20. When there are a plurality of PTP sheets of the same drug type, the back surface of the PTP sheet positioned in the lowermost layer faces the mounting surface 20a of the first mounting table 20 in a state where the plurality of PTP sheets are stacked. Then, it is mounted on the first mounting table 20.

  The back surface of the PTP sheet is the surface on the side from which the medicine is taken out. The surface opposite to the back surface of the PTP sheet, that is, the surface on the side having the convex portions due to the medicine is the front surface of the PTP sheet. In the following description, a single PTP sheet placed on the first placement table 20 or a PTP sheet laminate formed by laminating a plurality of PTP sheets is referred to as a “sheet drug” for the sake of convenience. Represent. The sheet medicine 41 is placed on the first placement table 20.

  The 2nd mounting base 24 is a table for imaging | photography the fraction chemical | medical agent cut | disconnected from the PTP sheet | seat of the dispensing packaging unit among the audit target chemical | medical agents used as audit object. The fractional medicine cut from the PTP sheet is referred to as “fractional medicine” for convenience and is represented by reference numeral 42. The fraction drug 42 is placed on the second placement table 24.

  The fraction drug 42 is placed on the second placement table 24 with the front surface of the fractional sheet piece cut from the PTP sheet facing the placement surface of the second placement table 24. The front surface of the sheet piece refers to the surface of the sheet piece on the side where there are convex portions due to the drug.

  As shown in FIG. 3, the first mounting table 20 is provided with a first imaging device 26, a second imaging device 28, a diffuse illumination device 32, and a side illumination device 34. The second mounting table 24 is provided with a third imaging device 30 and an oblique illumination device 36.

  Each of the first imaging device 26, the second imaging device 28, and the third imaging device 30 is configured by a camera using an imaging device such as a CCD (Charge-Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor. can do. The camera may include an optical member such as a lens. “Camera” is synonymous with “imaging device”.

  Each of the first photographing device 26, the second photographing device 28, and the third photographing device 30 may shoot a color image or may shoot a monochrome image. It is preferable that the imaging apparatus captures a color image in that a barcode and / or the number of drugs can be detected with higher accuracy by image analysis described later.

  In addition, in the specification, the part of the description “A and / or B” using the notation “and / or” is abbreviated to be a combination of the items “A and B, or A or B”. In the following, this notation is used. The description “A and / or B” indicates that at least one of A and B is included.

  The first imaging device 26 is an imaging device that images the sheet medicine 41 placed on the first placement table 20 from below the first placement table 20. The lower side of the first mounting table 20 indicates the lower side in the gravity direction than the mounting surface 20a of the first mounting table 20. In the case of the mounting surface 20 a inclined with respect to the horizontal plane as shown in FIG. 2, the space below the mounting surface 20 a corresponds to the lower side of the first mounting table 20.

  The first imaging device 26 images the back surface of the sheet medicine 41 placed on the placement surface 20 a of the first placement table 20. The back surface of the sheet medicine 41 means the back surface of the PTP sheet when the sheet medicine 41 is only one PTP sheet. When the sheet medicine 41 has a configuration in which a plurality of PTP sheets are laminated, It means the back surface of the PTP sheet (PTP sheet closest to the mounting surface 20a of the first mounting table 20) located in the lower layer.

  It is preferable that the first photographing device 26 photographs the back surface of the PTP sheet from the front. The imaging optical axis of the first imaging device 26 in this example is configured to be orthogonal to the mounting surface 20a of the first mounting table 20 (configuration parallel to the normal line of the mounting surface 20a). The photographing direction of the first photographing device 26 (the direction of the photographing optical axis of the camera facing the subject) corresponds to one form of “first direction”.

  The diffuse illumination device 32 is an example of a first illumination device that irradiates the sheet medicine 41 placed on the first placement table 20 with illumination light from below the first placement table 20 (see FIG. 3). The first mounting table 20 of the scanner 12 has a mounting surface 20a that is inclined with respect to a horizontal plane. A transparent imaging region 20b is provided on a part of the mounting surface 20a of the first mounting table 20 with a glass plate or the like (see FIG. 3).

  The diffuse illumination device 32 irradiates the imaging region 20b of the first mounting table 20 with diffused light for imaging the sheet medicine 41 from below. In the example shown in FIG. 3, the diffuse illumination device 32 includes a substantially hemispherical reflector 32 a and a light source (not shown) disposed in the reflector 32 a. The inner surface of the reflector 32a is a diffuse reflection surface. As the light source (not shown), a known light source such as an LED (Light Emitting Diode) or a halogen lamp may be used.

  The reflector 32a is arranged at the opening so as to cover the imaging region 20b. Light emitted from a light source (not shown) is diffusely reflected by the reflector 32a, and the diffused light is incident on the back surface of the sheet medicine 41 placed in the imaging region 20b.

  In this way, by photographing the back surface of the sheet medicine 41 by the first imaging device 26 in a state where the diffused illumination device 32 irradiates the sheet medicine 41 with the diffused light through the imaging region 20b of the first mounting table 20, The back surface of the PTP sheet can be photographed without shadows caused by unevenness formed on the back surface of the PTP sheet. For this reason, detection of a drug name or the like by barcode recognition and / or optical character recognition (OCR) described later can be performed more accurately.

  The drug name of the drug that the PTP sheet has is usually printed on the back surface of the PTP sheet. In recent years, it has become mandatory to attach a barcode indicating a dispensing packaging unit (drug name and number of drugs) to a PTP sheet. This barcode is usually printed on the back side of the PTP sheet.

  The dispensing inspection device 10 detects the name of the medicine to be audited and the number of medicines included in the PTP sheet by performing at least one of barcode recognition and OCR from an image obtained by photographing the back surface of the PTP sheet. This will be described in detail later.

  In addition, the form of the diffused illumination device that irradiates the imaging region 20b of the first mounting table 20 with the diffused light is not limited to the example of FIG. 3, and various illumination devices with other configurations that irradiate the diffused light are used. Is possible.

  A photographed image obtained by photographing the back surface of the sheet medicine 41 by the first photographing device 26 in a state where the illumination light is irradiated to the back surface of the sheet medicine 41 by the diffuse illumination device 32 is referred to as a first image.

  The second imaging device 28 is an imaging device that images the sheet medicine 41 placed on the first placement table 20 from the side of the first placement table 20 that is a direction non-parallel to the gravity direction. The side illumination device 34 is an example of a second illumination device that irradiates the sheet medicine 41 placed on the first placement table 20 with illumination light from the side of the first placement table 20. The sheet medicine 41 is imaged by the second imaging device 28 in a state where the illumination light is irradiated to the sheet medicine 41 from the side surface side of the sheet medicine 41 by the side illumination device 34. A captured image obtained by photographing the sheet medicine 41 by the second photographing device 28 is referred to as a second image.

  In the example shown in FIG. 3, the second imaging device 28 images the side surface of the sheet medicine 41 from the back side in the drawing of FIG. 3. The second image is an image obtained by photographing the side surface of the sheet medicine 41, in other words, the end surface of one or a plurality of stacked PTP sheets.

  The photographing direction of the second photographing device 28 corresponds to one form of “second direction”. As is clear from FIG. 3, the second direction that is the shooting direction of the second shooting device 28 is different from the first direction that is the shooting direction of the first shooting device 26. In this example, the first direction and the second direction are orthogonal to each other. However, when the invention is implemented, the first direction and the second direction may be non-parallel, and are not necessarily required to be orthogonal.

  The dispensing inspection apparatus 10 detects the number of PTP sheets of the sheet medicine 41 from the second image obtained by photographing the side surface of the sheet medicine 41. This will be described in detail later.

  The side illumination device 34 irradiates light to the side surface (the back side surface in FIGS. 2 and 3) of the sheet medicine 41 mounted on the first mounting table 20. Preferably, the side illumination device 34 irradiates the corners of the PTP sheet of the sheet medicine 41 positioned by the first butting portion 50 and the second butting portion 52.

  The side illumination device 34 includes a light source such as an LED, a halogen lamp, a fluorescent lamp, or a laser line light source in which the laser light source is planar, and a reflector or projector for irradiating light in a predetermined direction. The lighting device to be used may be used.

  FIG. 4 is a perspective view schematically showing an example of the positional relationship between the side illumination device 34 and the second imaging device 28. The PTP sheet is usually formed of an aluminum foil and a transparent resin material. Therefore, by adopting the side illumination device 34 as in this embodiment, light is emitted from the end surface of the PTP sheet as the sheet medicine 41, preferably at the end surface corner portion 54 of the PTP sheet indicated by the mesh in FIG. The side surface of the sheet medicine 41 can be photographed by the second photographing device 28 in a state where the light is reflected.

  As a result, a captured image in which the end face of each PTP sheet of the sheet medicine 41 is emphasized can be obtained as the second image, and the detection of the number of PTP sheets described later can be performed more stably and with high accuracy. Become.

  Further, as shown in FIG. 2, in the scanner 12 of this example, in the first mounting table 20, the flat plate-like first abutting portion 50 and the second abutting portion 52 are erected vertically from the mounting surface 20a. Has been. The first butting portion 50 and the second butting portion 52 are provided orthogonal to each other. The first butting portion 50 and the second butting portion 52 serve as butting surfaces for positioning the sheet medicine 41 on the first mounting table 20.

  A transparent region 52 a is provided in a part of the second abutting portion 52. Light is applied to the sheet medicine 41 from the side illumination device 34 through the transparent region 52a, and the sheet medicine 41 is imaged by the second imaging device 28.

  The sheet medicine 41 abuts the end surface of the PTP sheet against the first butting portion 50 and the second butting portion 52, and the corner of the PTP sheet is formed at the corner formed by the first butting portion 50 and the second butting portion 52. The sheet medicine 41 is placed on the first placement table 20 with the back surface of the sheet medicine 41 facing downward while the parts are in contact with each other. With the corners of the PTP sheet in contact with the corners of the first butting portion 50 and the second butting portion 52, the sheet medicine 41 is placed at an appropriate position on the imaging region 20b of the first placing table 20. As described above, the positions of the first butting portion 50 and the second butting portion 52 are determined.

  Thereby, the position of the sheet medicine 41 on the first mounting table 20 is regulated to a predetermined position, and the first photographing device 26 and the second photographing device 28 perform the photographing of the sheet medicine 41 stably and appropriately. It becomes possible.

  In the case of the scanner 12 of this example, the mounting surface 20 a of the first mounting table 20 is inclined with respect to the horizontal plane so as to descend toward the first abutting portion 50. Thus, by adopting a configuration in which the placement surface 20a on which the sheet medicine 41 is placed is inclined with respect to the horizontal plane, the sheet medicine 41 placed on the placement surface 20a is moved along the inclination of the placement surface 20a. The sheet medicine 41 can be abutted against the first abutting portion 50 and positioned at a predetermined position more stably and reliably.

  In the scanner 12, the means for positioning the sheet medicine 41 is not limited to the configuration of the first butting portion 50 and the second butting portion 52 as in the example of FIG. Various positioning methods for positioning the laminated body in the surface direction can be used.

  The scanner 12 illustrated in FIG. 2 positions the sheet medicine 41 in two orthogonal directions, but the sheet medicine 41 may be positioned in only one direction. However, as shown in the example of FIG. 2, it is possible to guide the sheet medicine 41 to a more appropriate position by positioning the sheet medicine 41 in two orthogonal directions. It becomes possible.

  In addition, when mounting the sheet | seat chemical | medical agent 41 of the structure which laminated | stacked the several PTP sheet | seat on the 1st mounting base 20, these several PTP sheet | seats may be bound using binding tools, such as a rubber band, It does not have to be.

  On the other hand, a transparent imaging region 24b is provided on a part of the mounting surface of the second mounting table 24 by a glass plate or the like (see FIG. 3). The fractional medicine 42 is irradiated with light from the oblique illumination device 36 through the imaging region 24b, and the fractional medicine 42 is imaged by the third imaging device 30.

  The third imaging device 30 is an imaging device that images the fraction medicine 42 placed on the second mounting table 24 from below the second mounting table 24. The lower side of the second mounting table 24 indicates a lower side in the gravity direction than the mounting surface of the second mounting table 24. The space below the mounting surface of the second mounting table 24 corresponds to the lower side of the second mounting table 24.

  The third imaging device 30 images the front surface of the sheet piece of the fraction drug 42 placed on the second placement table 24. The third imaging device 30 is disposed below the second mounting table 24, and images the front surface of the fraction drug 42 mounted on the second mounting table 24 from below the second mounting table 24. The fraction drug 42 is placed on the imaging region 24b of the second placement table 24 with the front surface of the sheet piece facing downward. The third image obtained from the third imaging device 30 is an image obtained by photographing the front surface of the fraction medicine 42.

  The oblique illumination device 36 is an example of a third illumination device that irradiates the fraction medicine 42 placed on the second mounting table 24 with illumination light. The oblique illumination device 36 irradiates the imaging region 24 b of the second mounting table 24 with light for imaging the fraction medicine 42 from below the second mounting table 24.

  As shown in FIG. 3, the oblique illumination device 36 is in a state where the illumination optical axis of the illumination light has an angle with respect to the imaging optical axis of the third imaging device 30 (the imaging optical axis and the illumination optical axis are non-parallel). In the state), the fraction drug 42 on the second mounting table 24 is moved from below the second mounting table 24 and obliquely (non-parallel and non-perpendicular) to the mounting surface of the second mounting table 24. Irradiate with illumination light.

  That is, in the example of FIG. 3, the imaging optical axis of the third imaging device 30 is orthogonal to the placement surface of the fractional medicine 42 in the imaging region 24b. When the mounting surface of the second mounting table 24 is parallel to the horizontal plane, the third imaging device 30 is arranged directly below the imaging region 24b, and the imaging optical axis of the third imaging device 30 is the same as that of the mounting surface. Parallel to the normal.

  On the other hand, the oblique illumination device 36 irradiates light to the imaging region 24b of the second mounting table 24 with the illumination optical axis of the illumination light inclined with respect to the imaging optical axis of the third imaging device 30. . That is, the third image is an image obtained by photographing the front surface of the fraction drug 42 in a state where light is obliquely irradiated with respect to the optical axis (imaging direction) of the third imaging device 30. In other words, the third image is an image obtained by photographing the front surface of the fraction medicine 42 from the front in a state where the fraction medicine 42 is irradiated with light obliquely.

  The front surface of the PTP sheet has a convex portion due to the medicine. Accordingly, the front surface of the fraction medicine 42 is directed downward, the sheet surface is darkened without being illuminated by ambient light such as room lighting, and the front face of the fraction medicine 42 is irradiated from one oblique direction. As a result, a shadow caused by the convex portion due to the medicine is formed on the fraction medicine 42. On the other hand, since the drug diffuses and reflects light, even if the light is incident obliquely, the light reflected by the drug enters the third imaging device 30 and the drug appears bright. That is, in the third image obtained by irradiating light obliquely and photographing the front surface of the fraction medicine 42, a bright portion due to the medicine and a dark portion due to the shadow of the medicine are adjacent to the position of the medicine. Exist.

  The dispensing inspection apparatus 10 according to the present embodiment detects the number of medicines included in the fraction medicine 42 by using the brightness of the third image resulting from the shadow of the medicine. This will be described in detail later.

  The PTP sheet is formed using aluminum foil or the like. Therefore, the front surface of the PTP sheet has a certain degree of light reflectivity. When the light reflected by the plane portion of the PTP sheet enters the third photographing device 30, it becomes interference light such as reflection of the light source, and the quality of the third image is deteriorated. The deterioration of the image quality of the third image can be a factor of reducing the detection accuracy of the fractional medicine number that the fractional medicine 42 described later has.

  In this regard, as in the present embodiment, the fractional medicine 42 is photographed from the front by photographing the flat part of the fraction medicine 42 with the illumination light for photographing by the third photographing device 30 obliquely applied to the fraction medicine 42. The light reflected by the planar portion of the sheet of the medicine 42 can be prevented from entering the third imaging device 30, and a high-quality third image can be stably captured.

  In addition, since the light reflected by the flat portion of the sheet of the fraction medicine 42 is reflected in a direction different from that of the third imaging device 30, and the medicine diffuses and reflects the light, the medicine may be particularly bright in the third image. it can.

  The angle of the optical axis (irradiation optical axis) of the oblique illumination device 36 relative to the imaging optical axis of the third imaging device 30, that is, the light irradiation direction of the oblique illumination device 36 relative to the imaging optical axis of the third imaging device 30 is oblique. What is necessary is just to set suitably the angle and / or distance which the light radiate | emitted from the direction illumination apparatus 36 can irradiate the whole imaging | photography area | region 24b with appropriate light quantity.

  Here, if the angle of the optical axis of the oblique illumination device 36 with respect to the imaging optical axis of the third imaging device 30 is too small, the shadow caused by the medicine is not sufficiently produced. On the other hand, if the angle of the optical axis of the oblique illumination device 36 with respect to the imaging optical axis of the third imaging device 30 is too large, the shadow becomes unnecessarily large and it becomes difficult to detect the shadow.

  Considering the above points, the angle formed by the optical axis of the light emitted by the oblique illumination device 36 and the imaging optical axis of the third imaging device 30 is preferably 30 ° or more and 60 ° or less, and 45 ° or more and 60 ° or less. It is more preferable that the temperature is not more than °.

  By making the light irradiation direction of the oblique illumination device 36 within the above-mentioned angular range, it is possible to appropriately form a shadow of the fractional medicine 42 and detect the fractional medicine number more accurately. Become.

  The distance between the oblique illumination device 36 and the second mounting table 24 is at least one of the irradiation angle of the oblique illumination device 36, the size of the oblique illumination device 36, and the directivity and / or intensity of the irradiated light. According to the two conditions, the distance at which the light from the oblique illumination device 36 can irradiate the entire imaging region 24b with an appropriate amount of light may be set as appropriate.

  The light emitted by the oblique illumination device 36 preferably has a certain degree of directivity. Since the light from the oblique illumination device 36 has directivity, it is possible to more appropriately form a shadow due to the medicine, and it is possible to more accurately detect the fraction of the medicine.

  The light emitted by the oblique illumination device 36 preferably has a half-value width in an orientation distribution (orientation curve) of 20 ° or more and 60 ° or less (± 10 to 30 °), and 20 ° or more and 40 ° or less (± 10 to 10 °). 20 °) is more preferable. The half width in the orientation distribution is an angle at which the light intensity is half of the front (on the optical axis) in the orientation distribution. “Light intensity” refers to radiation intensity (luminosity).

  By setting the half-value width of the light emitted by the oblique illumination device 36 to 20 ° or more and 60 ° or less, the effect of obliquely entering the light for photographing on the fraction drug 42 can be obtained more suitably, The shadow by the medicine can be formed more suitably. Thereby, the detection of the fractional number of medicines can be performed more accurately.

  As the oblique illumination device 36, various types of illumination devices composed of a light source such as an LED or a fluorescent lamp, a reflector, and / or a lens for adjusting the orientation of irradiated light, etc. can be used. is there.

  Here, the oblique illumination device 36 is, for example, a long illumination device such as an illumination device having one or a plurality of LED arrays in which a plurality of LEDs are arranged in one direction, or an illumination device using a fluorescent lamp. Is preferred. In particular, the oblique illumination device 36 has a length in the longitudinal direction equal to or longer than a length (hereinafter also referred to as the same direction) that coincides with the longitudinal direction of the oblique illumination device 36 in the imaging region 24 b of the second mounting table 24. Is preferred.

  In general, the intensity of light emitted from the illumination device decreases as it goes to the end in the light diffusion direction. Therefore, by making the oblique illumination device 36 long and making the length in the longitudinal direction equal to or longer than the length in the same direction in the photographing region 24b, the entire region of the photographing region 24b is appropriately irradiated with light. It becomes possible. Thereby, the detection of the number of drugs of the fraction medicine 42 can be performed stably regardless of the placement position of the fraction medicine 42 in the imaging region 24b.

  The fraction medicine 42 is photographed by the third photographing device 30 in a state where the illumination light is irradiated from the oblique direction below the second mounting table 24 onto the front surface of the fraction medicine 42 by the oblique illumination device 36. A photographed image obtained by photographing the fraction medicine 42 with the third photographing device 30 is referred to as a third image.

  The first imaging device 26 corresponds to one form of “first imaging means”. The second imaging device 28 corresponds to one form of “second imaging means”. The third imaging device 30 corresponds to one form of “third imaging means”. The diffuse illumination device 32 corresponds to one form of “diffuse illumination means”. The side illumination device 34 corresponds to one form of “side illumination means”. The oblique illumination device 36 corresponds to one form of “orthogonal illumination means”.

<Configuration of Processing Device 14>
The processing device 14 illustrated in FIG. 1 functions as a control device that controls the scanner 12 and performs various operations including processing of captured images (first image, second image, and third image) obtained from the scanner 12. It functions as a computing device to perform. The processing device 14 includes an imaging control unit 56 and an illumination control unit 58. Further, the processing device 14 includes an image acquisition unit 60, an image processing unit 62, a detection unit 64, an audit result determination unit 66, a dictionary data generation unit 68, a storage unit 70, a display control unit 72, and a control. Part 74.

  The processing device 14 is configured using, for example, computer hardware and software. “Software” is synonymous with “program”. Further, part or all of the processing functions in the processing device 14 can be realized by an integrated circuit or the like.

  The photographing control unit 56 controls the photographing operation of each of the first photographing device 26, the second photographing device 28, and the third photographing device 30.

  The illumination control unit 58 controls light irradiation emitted from each of the illuminating device 32, the side illuminating device 34, and the oblique illuminating device 36.

  The image acquisition unit 60 is an interface unit that acquires captured images captured by the first imaging device 26, the second imaging device 28, and the third imaging device 30. The image acquisition unit 60 includes a data input terminal that captures data of the first image captured by the first imaging device 26, the second image captured by the second imaging device 28, and the third image captured by the third imaging device 30. can do. Further, a wired or wireless communication interface unit may be employed as the image acquisition unit 60.

  The function in which the processing device 14 acquires the first image via the image acquisition unit 60 corresponds to one form of the “first image acquisition function”. The function in which the processing device 14 acquires the second image via the image acquisition unit 60 corresponds to one form of the “second image acquisition function”. The function in which the processing device 14 acquires the third image via the image acquisition unit 60 corresponds to one form of the “third image acquisition function”.

  The image processing unit 62 performs necessary image processing such as color correction, gradation correction, noise removal, and area mask processing on the first image, the second image, and the third image acquired via the image acquisition unit 60. Apply. The image processing unit 62 can supply the processed first image, second image, and third image to the display control unit 72. The display control unit 72 causes the display unit 16 to display the first image, the second image, and the third image.

  In the present embodiment, the image displayed on the display unit 16 is not limited to all of the first image, the second image, and the third image, and for example, any one of the first image, the second image, and the third image. Only two images may be displayed, or two appropriately selected images such as a first image and a third image may be displayed. Moreover, a pharmacist or the like may select an image to be displayed on the display unit 16 by a user operation.

  However, in order to accurately perform the dispensing audit, it is preferable to display all of the first image, the second image, and the third image. In order to visually confirm the number of drugs in the fraction drug 42, at least the fraction drug 42 is displayed. It is preferable to display the 3rd image which image | photographed the front surface.

  The first image, the second image, and the third image that have been subjected to image processing by the image processing unit 62 are supplied to the detection unit 64 and the storage unit 70. The storage unit 70 stores the first image, the second image, and the third image in association with each other.

  The detection unit 64 analyzes the first image, the second image, and the third image that have been subjected to the required image processing by the image processing unit 62, and the drug name of the audit target drug including the sheet drug 41 and the fraction drug 42 and Detect the number of drugs. The detection unit 64 utilizes information registered in the drug database 80 when detecting the drug name and the number of drugs. Details of the function of the detection unit 64 will be described later.

  The drug database 80 is a database in which information such as a dispensing package unit (drug name and number of drugs), drug efficacy, timing of medication, and drug price handled by a dispensing pharmacy is managed. The drug database 80 can include dictionary data in which information indicating the appearance characteristics of drugs and drug names are associated with each other. The appearance feature includes at least one of elements such as shape, engraving, and color.

  The medicine database 80 may be stored in an external storage device connected to the processing device 14, or may be stored in a storage device in the processing device 14. The term “connection” includes a wired connection, a wireless connection, or a combination thereof. The medicine database 80 can be stored, for example, in a storage device of a computer owned by a dispensing pharmacy. For example, the drug database 80 may be held in the receipt computer 82. Further, the medicine database 80 may be held in another computer (not shown), and a form in which the processing device 14 acquires information from the medicine database 80 via a network is also possible. The network can be a local area network, a wide area network, or a combination thereof.

  The detection unit 64 supplies the detected drug name and the number of drugs to be audited to the audit result determination unit 66, the storage unit 70, and the display control unit 72.

  The audit result determination unit 66 compares the drug name and the number of drugs to be audited supplied from the detection unit 64 with the prescription information supplied from the receipt computer 82, and the auditable drug detected by the detection unit 64 It is determined whether or not the drug name and the number of drugs match the prescription information.

  The receipt computer 82 holds dispensing information based on the description of the prescription. When dispensing, the pharmacist performs an operation of inputting the dispensing information to the receipt computer 82 based on the dispensing information described in the prescription. The dispensing information includes the patient's name and age, and the drug name, dosage, usage and dose. Note that the drug name input to the receipt computer 82 is not limited to the drug name described in the prescription, and may be the drug name of a generic drug having the same component and the same medicinal effect.

  The drug name is a unique name for each drug for identifying the drug. The drug name is synonymous with “drug type”. The prescription information (dispensing information) input to the receipt computer 82 is referred to as “prescription information”. Information on the determination result by the audit result determination unit 66 is displayed on the display unit 16 via the display control unit 72.

  The display control unit 72 performs control for displaying various information on the display unit 16. The display control unit 72 performs a process of generating a display signal for the display unit 16.

  As the display unit 16, for example, display devices using various display methods such as a liquid crystal display and an organic EL (Organic Electro-Luminescence) display can be used. Operations such as inputting and / or setting instructions to the processing device 14 can be performed using the operation unit 18 and the display unit 16. The combination of the display unit 16 and the operation unit 18 functions as a user interface of the processing device 14.

  The operation unit 18 is a means for an operator such as a pharmacist to input various information. Various input devices such as a keyboard, a mouse, a touch panel, a trackball, or operation buttons can be used for the operation unit 18, and an appropriate combination thereof may be used. In the present embodiment, as an example, the display unit 16 is a touch panel, and the display unit 16 is an element constituting the operation unit 18. Buttons and / or menus for operating the dispensing inspection device 10 or operation instructions are displayed on the display unit 16.

  In addition, the display unit 16 displays various types of information related to the captured images captured by the first imaging device 26, the second imaging device 28, and the third imaging device 30, the result of the dispensing audit, or the operation of the dispensing audit device 10. Etc. can be displayed. The display unit 16 corresponds to a form of “display means”. The operation unit 18 corresponds to one form of “operation means”.

  The dictionary data generation unit 68 generates new dictionary data by associating the drug image generated from the third image with the drug name automatically according to the instruction input from the operation unit 18 or according to the program, Perform a process to update the dictionary. The dictionary data generation unit 68 corresponds to one form of “dictionary data generation means”.

  The storage unit 70 stores various data necessary for various processes in the processing device 14. For example, the storage unit 70 can store the first image, the second image, and the third image supplied from the image processing unit 62. The storage unit 70 can store the medicine name and the number of medicines supplied from the detection unit 64 in association with the first image, the second image, and the third image.

  The control unit 74 performs overall control of each unit of the processing device 14. A part of the storage area of the storage unit 70 can be used as a work memory of the control unit 74.

[Example of PTP sheet]
FIG. 5 is a perspective view schematically showing an example of a PTP sheet 90 which is a medicine sheet in a dispensing packaging unit. A plurality (10 in the example of FIG. 5) of medicines 92 is packaged on the PTP sheet 90. The number of medicines per sheet is not limited to 10 illustrated in FIG. 5, and may be various forms such as 7, 14, 20 depending on the kind of medicine. “Number of medicines per sheet” is the number of medicines contained in one PTP sheet.

  The PTP sheet 90 has a convex accommodation portion 94 in which the medicine 92 is accommodated. The accommodating portion 94 is a dome-shaped convex portion having a semicircular or semi-elliptical longitudinal shape or a shape substantially similar to these. The accommodating portion 94 is provided only on one surface of the PTP sheet 90. One side of the PTP sheet 90 on which the accommodating portion 94 is provided is referred to as the “front surface” of the PTP sheet 90, and the opposite surface to the accommodating portion 94 is referred to as the “back surface” of the PTP sheet 90. Although not shown in FIG. 4, there are cases where characters indicating the drug type are printed or stamped on the drug 92 itself.

  FIG. 6 is a plan view showing an example of the back surface of the PTP sheet 90. On the aluminum foil that is the package 96 of the PTP sheet 90, a character string 97 indicating a drug name and a barcode 98 that is code information indicating a dispensing package unit are described. The arrangement form of the character string 97 and / or the barcode 98 is not limited to the illustrated example, and there may be various forms. In the example shown in FIG. 6, the character string 97 and the barcode 98 are described at a plurality of positions on the back surface of the PTP sheet 90, but at least one of the character string 97 and the barcode 98 is on the back surface of the PTP sheet 90. It should just be described in at least one place.

[Configuration Example of Detection Unit 64]
FIG. 7 is a block diagram for explaining the function of the detection unit 64. The detection unit 64 includes a first drug name detection unit 100, a number detection unit 102, a fraction drug detection unit 104, a total drug number detection unit 106, and a second drug name detection unit 108. .

  The first medicine name detection unit 100 detects the medicine name of the sheet medicine 41 (see FIG. 2) using at least one of optical character recognition and code recognition from the first image 110 photographed by the first photographing device 26. I do.

  FIG. 8 is an example of the first image 110. As shown in FIG. 8, on the back surface of the PTP sheet, a character string 114 indicating a medicine name and a barcode 116 indicating a code of a dispensing packaging unit are printed.

  The first medicine name detection unit 100 illustrated in FIG. 7 analyzes the first image 110, extracts the barcode 116, and recognizes the barcode 116 when the barcode 116 can be extracted. “Recognize the barcode 116” is synonymous with reading the barcode. Note that the extraction and recognition of the barcode from the image may be performed by a known method.

  The first medicine name detection unit 100 searches the medicine database 80 using the barcode 116 recognized from the first image 110, searches for the data of the PTP sheet of the dispensing packaging unit corresponding to the recognized barcode 116, and The drug name of the PTP sheet and the number of drugs per sheet are detected.

  In implementing the present invention, code recognition is not limited to barcodes, and various known code recognitions such as two-dimensional barcodes can be used.

  If the barcode cannot be extracted from the first image 110, the first medicine name detection unit 100 analyzes the first image 110 by OCR and recognizes the character string 114 written on the back surface of the PTP sheet. , Detect drug name. In addition, what is necessary is just to perform OCR by a well-known method.

  When the first drug name detection unit 100 detects the drug name by OCR, the first drug name detection unit 100 searches the drug database 80 using the detected drug name, and 1 of the PTP sheet corresponding to the drug name Detect the number of drugs per sheet.

  The process of detecting the drug name from the first image 110 may be performed using both the OCR method and the code recognition method. Further, when the OCR method and the code recognition method are used in combination, an error may be generated if the drug name by OCR and the drug name by code recognition are different. The first medicine name detection unit 100 corresponds to one form of “first medicine name detection means”. The function of the first drug name detection unit 100 detecting the drug name corresponds to one form of the “first drug name detection function”.

  Information on the drug name detected by the first drug name detection unit 100 is supplied to the audit result determination unit 66. The information on the number of drugs per sheet detected by the first drug name detection unit 100 or the information on the number of drugs per sheet input through the operation unit 18 (see FIG. 1) is the total drug number detection unit 106. To be supplied.

  Note that, for example, when the sheet medicine 41 is placed on the first placement table 20 with the front surface of the PTP sheet facing down, the barcode and / or the character string cannot be properly recognized from the first image 110. It can happen. In this case, it is output that an error has occurred due to a display on the display unit 16, etc., and the sheet medicine 41 is repositioned to visually check the dispensing medicine and confirm the sheet medicine 41. Similarly, an error is output when there is no PTP sheet for the dispensing packaging unit corresponding to the recognized barcode in the medicine database 80.

  The sheet number detecting unit 102 detects the number of PTP sheets of the sheet medicine 41 from the second image 120 photographed by the second photographing device 28. As an example, the sheet number detection unit 102 detects an edge of the second image 120, further performs a Hough transform (Hough transform), obtains a straight line, and detects an end surface of the PTP sheet.

  At this time, as described with reference to FIG. 4, the side illumination device 34 illuminates the side surface of the sheet medicine 41, particularly the end surface corner, thereby improving the detection accuracy of the end surface of the PTP sheet.

  9 and 10 show examples of the second image 120. FIG. As shown in FIGS. 9 and 10, the end portion 90a in the surface direction (lateral direction in the drawing) of the PTP sheet is often warped on the end surface of the PTP sheet. Therefore, the sheet number detection unit 102 can detect the number of PTP sheets by counting the number of end faces at the end part 90 a of the end face of the PTP sheet detected from the second image 120.

  In addition, as shown in FIG. 9, two PTP sheets are laminated with their back surfaces aligned by observing the end portion 90 a of the end surface even when it appears as one end surface at the center in the surface direction of the PTP sheet. Or a single PTP sheet, the number of PTP sheets included in the sheet medicine 41 can be detected.

  In addition, as shown in FIG. 10, there are many cases where there is a gap 90b between the PTP sheets even in the state where the two PTP sheets are laminated with their back surfaces aligned. Since the gap 90b between the PTP sheets becomes a shadow, it has lower luminance than the end face of the PTP sheet formed of aluminum foil and / or resin. Therefore, when there is a dark portion between the end surfaces of the PTP sheet detected from the second image 120, the number detection unit 102 is in a state where the two PTP sheets are stacked with the back surface aligned. Judgment can be made.

  Alternatively, even when two PTP sheets that are laminated with their back surfaces are in close contact with each other, they are often partially separated as shown in FIG. Since this partial separation part 90c also becomes a shadow, it becomes low-intensity. Therefore, even when the number detection unit 102 looks at the end face of one PTP sheet in the second image 120, if the dark part exists inside the end face detected from the second image 120, the number of PTPs is two. It can be determined that the sheet is in a state of being laminated with the back surfaces aligned.

  11 and 12 show another example of the second image 120 obtained by photographing the side surface of the sheet medicine 41. FIG. In dispensing, in order to reduce the thickness of the laminate when the prescribed medicines are laminated, the PTP sheets are often laminated with the front surfaces of the two PTP sheets facing each other. Also, the two PTP sheets with the front surfaces aligned are often misaligned in the surface direction.

  Here, as shown in FIG. 11 and FIG. 12, when the PTP sheets are stacked so as to be displaced in the surface direction, the two PTP sheets that match the back surface can be seen as one end surface, but the surface direction The thickness is different between the central portion and the end portion. Therefore, when the thickness of the end surface of the PTP sheet detected from the second image 120 is different between the center portion and the end portion, the number detection unit 102 is in a state in which the two PTP sheets are stacked with the back surface aligned. It can be determined that

  In addition, when the PTP sheets are stacked by combining the surfaces of the two PTP sheets, the drug is present between the detected end faces. Here, when there is no omission of the PTP sheet laminated with the front surfaces aligned, as shown in FIG. 11, between the end faces of the PTP sheet detected from the second image 120, the arrangement of the drugs is The same applies between the end faces. On the other hand, when the PTP sheet is missing, as shown in FIG. 12, the portion where the PTP sheet is missing (the portion between the end surfaces indicated by the arrow C) is different from the gap between the other end surfaces. The sequence is different.

  Therefore, when the gap between the end faces detected from the second image 120 is analyzed and there is a gap between the end faces where the arrangement of the drugs is different from the other, that is, when the regularity of the image is broken between the detected end faces, It can be determined that there is a missing PTP sheet between the end faces having different arrangements.

  The sheet number detection unit 102 analyzes the second image 120 as described above, detects the shape of the edge of the end face of the PTP sheet, the density between the detected end faces, the density in the detected end face, and the thickness of the detected end face. The number of PTP sheets included in the sheet medicine 41 is detected using at least one of the regularity of the image between the detected end faces. The number detection unit 102 supplies information on the number of detected PTP sheets to the total drug number detection unit 106. The sheet number detection unit 102 corresponds to a form of “sheet number detection means”. The function of detecting the number of PTP sheets by the number detection unit 102 corresponds to one form of the “number detection function”.

  When the number detection unit 102 cannot properly detect the number of PTP sheets in the sheet medicine 41 from the second image 120, the detection unit 64 has caused an error due to display on the display unit 16 or the like. Is output to prompt the user to reposition the sheet medicine 41, visually check the dispensing, check the sheet medicine 41, and the like.

  The fraction drug number detection unit 104 detects the drug number (fraction drug number) of the fraction drug 42 from the third image 130 captured by the third imaging device 30.

  FIG. 13 is a diagram illustrating an example of the third image 130. FIG. 14 is a diagram illustrating a sheet region of fractional medicines extracted from the third image 130. FIG. 15 is a partially enlarged view in which a sheet area portion in the third image 130 is cut out. FIG. 16 is an image obtained by extracting a bright part and a dark part from the image shown in FIG. FIG. 17 is an image obtained by narrowing down drug candidate regions from the image shown in FIG. 16. FIG. 18 is an image obtained by rotating an image extracted as a drug candidate.

  The fraction drug number detection unit 104 analyzes the third image 130 as shown in FIG. 13 and extracts the area of the sheet of the fraction drug 42 as shown in FIG. Extraction of the sheet region may be performed by a known method such as background difference, edge detection, or extraction using image (pixel) continuity.

  As described in FIG. 3, the oblique illumination device 36 irradiates light from the oblique direction on the mounting surface of the second mounting table 24, and the optical axis of the illumination light of the oblique illumination device 36 is The third imaging device 30 crosses obliquely with an angle with respect to the imaging optical axis. Therefore, as shown in FIG. 15, a shadow due to the convex portion of the medicine is generated in the sheet region of the third image 130 obtained from the third imaging device 30. Moreover, since the packaging body of the PTP sheet is made using aluminum foil or the like, the packaging body reflects obliquely incident light in a direction different from that of the third imaging device 30, whereas the drug diffuses light. Since the light is reflected, the light reflected by the medicine enters the third imaging device 30. Therefore, in the third image 130, the drug portion is brightened.

  That is, in the third image 130, a relatively bright medicine and a shadow caused by the convex part of the medicine are photographed next to each other. Corresponding to such image features, as shown in FIG. 16, the fraction drug number detection unit 104 extracts a bright portion and a dark portion of the image as regions having features in the extracted sheet region. Furthermore, as shown in FIG. 17, the fraction drug number detection unit 104 detects an area where a bright part and a dark part are adjacent to each other in the sheet area as a drug candidate.

  As one of the detection conditions in the process of detecting drug candidates, no drug can exist near the edge of the sheet region. Further, it is possible to determine that an abnormally large bright portion that greatly exceeds the size of the drug or a bright portion that is abnormally smaller than the size of the drug is not a drug. Therefore, even if the bright part and the dark part are adjacent to each other, if the bright part is located near the edge of the sheet region, or if the size of the bright part is inappropriate, it is not extracted as a drug candidate (medicine Exclude from candidates).

  In this way, when the drug candidate that is a bright part having an appropriate position and size is extracted, the fraction drug number detection unit 104 causes the arrangement direction of the bright part of the drug candidate to be a predetermined direction as shown in FIG. The third image 130 is rotated. In the example of FIG. 18, the third image 130 is rotated so that the bright portions of drug candidates are arranged in the horizontal direction (lateral direction) in the drawing.

  The fraction drug 42 is cut from the PTP sheet. A plurality of drugs are regularly arranged on the PTP sheet. Therefore, in the fraction drug 42, the drugs are regularly arranged to reflect the arrangement form of the drugs in the PTP sheet before cutting. For this reason, as shown in FIG. 18, it is possible to determine that a drug candidate arranged in a predetermined direction is not a drug if it is out of the regularity of the arrangement.

  The fraction drug number detection unit 104 (see FIG. 7) excludes drug candidates that deviate from the regular arrangement in the third image 130 rotated so that the arrangement direction of the drug candidates is a predetermined direction, and the fraction drug 42 The part of the medicine is finally extracted from the sheet area, and the number of medicines included in the fraction medicine 42 is detected. The fraction drug number detection unit 104 corresponds to one form of “fraction drug number detection means”. The function in which the fraction medicine number detection unit 104 detects the number of medicines of the fraction medicine 42 corresponds to one form of the “fraction medicine number detection function”.

  The drug number (fraction drug number) of the fraction drug 42 detected by the fraction drug number detection unit 104 is supplied to the total drug number detection unit 106.

  The fraction drug number detection unit 104 can appropriately detect the drug number of the fraction drug 42 from the third image 130, for example, when the fraction drug 42 is placed on the second mounting table 24 with the back side down. If not, the fact that an error has occurred is displayed on the display unit 16, etc., and the fractional medicine 42 is repositioned, and the dispensing inspection by visual inspection, confirmation of the fractional medicine 42, etc. are prompted.

  The total drug number detection unit 106 detects the number of PTP sheets detected by the number detection unit 102, the number of drugs per sheet acquired through the first drug name detection unit 100, and the fraction drug number detection unit 104 detects From the number of medicines of the fraction medicine 42, the number of medicines (total number of medicines) of the medicine to be audited consisting of the sheet medicine 41 and the fraction medicine 42 is calculated. Note that the information on the number of drugs per sheet is not limited to the form acquired from the first drug name detection unit 100, and the total drug number detection unit 106 may acquire the information from the drug database 80.

  The total drug number detection unit 106 calculates the total drug number, for example, the number of PTP sheets detected by the sheet number detection unit 102 is k, the number of drugs per sheet is a, the fraction drug number detection unit 104 detects When the number of drugs in the fractional drug is b and the total number of drugs is s, the total number of drugs can be obtained according to the formula s = a × k + b. K represents an integer of 0 or more. a represents an integer of 2 or more. b represents an integer of 0 or more. Information on the total number of drugs detected by the total drug number detection unit 106 is supplied to the audit result determination unit 66. The total drug number detection unit 106 corresponds to one form of “total drug number detection means”. The function that the total drug number detection unit 106 detects the total drug number corresponds to one form of the “total drug number detection function”.

  The second drug name detection unit 108 detects the drug name of the fraction drug 42 from the third image 130 captured by the third imaging device 30. The second drug name detection unit 108 extracts the drug part from the third image 130, and uses the dictionary 140 in which the feature of the drug image and the drug name are associated with each other to determine the drug name of the fraction drug 42 by pattern recognition. To detect. The data of the dictionary 140 may be stored in the storage unit 70 described with reference to FIG. 1 or may be included in the medicine database 80. There are no particular restrictions on the data storage location and data structure of the dictionary 140.

  The second medicine name detection unit 108 corresponds to one form of “second medicine name detection means”. The function in which the second medicine name detection unit 108 detects the medicine name of the fraction medicine 42 corresponds to one form of the “second medicine name detection function”. The drug name detected by the second drug name detection unit 108 is supplied to the audit result determination unit 66.

  The audit result determination unit 66 determines whether the drug name detected by the second drug name detection unit 108 matches the drug name detected by the first drug name detection unit 100. The audit result determination unit 66 receives prescription information 84, which is prescription information, from the receipt computer 82 via a network conforming to NSIPS (registered trademark New Standard Interface of Pharmacy-system Specifications). Supplied. “IF” is an abbreviation for Interface. The prescription information may be acquired by optically reading the prescription with a scanner or the like and using OCR.

  The audit result determination unit 66 includes the drug name and the number of drugs in the prescription information 84 corresponding to the prescription instruction, and the drug name and the total number of drugs detected by the first drug name detection unit 100 and the second drug name detection unit 108, respectively. It is determined whether or not the total number of drugs detected by the detection unit matches. The audit result determination unit 66 corresponds to one form of “audit result determination means”. The processing function of the audit result determination unit 66 corresponds to one form of the “audit result determination function”. Information on the determination result obtained by the audit result determination unit 66 is displayed on the display unit 16 via the display control unit 72.

[Dictionary update function by machine learning]
The dispensing inspection apparatus 10 according to the present embodiment has a function of updating data in the dictionary 140 used for detecting the medicine name of the fraction medicine 42 by machine learning. That is, the dispensing inspection apparatus 10 has a function of extracting a drug image area from the third image captured by the third imaging apparatus 30 and learning image data of the extracted image area. The dispensing inspection device 10 detects the case where the drug name detected by the first drug name detection unit 100 and the drug name detected by the second drug name detection unit 108 do not match, or detected by the second drug name detection unit 108 When the medicine name is wrong, additional learning is executed and the dictionary 140 is updated according to the user operation from the operation unit 18. Whether the medicine name is incorrect can be determined with reference to the user's manual operation. The operation unit 18 functions as a means for the user to indicate success or failure of the detection result of the medicine name. The operation unit 18 serves as an operation unit that gives an instruction to execute additional learning. Further, the user can input information on the correct medicine name of the fraction medicine 42 from the operation unit 18.

  FIG. 19 is a block diagram showing the main configuration of the dictionary update function in the dispensing inspection device 10 according to the present embodiment. In FIG. 19, the same elements as those described in FIGS. 1 to 3 are denoted by the same reference numerals, and the description thereof is omitted. As illustrated in FIG. 19, the dispensing inspection apparatus 10 includes an additional learning determination unit 150, a learning image generation unit 152, and a dictionary update unit 154.

  The additional learning determination unit 150, the learning image generation unit 152, and the dictionary update unit 154 can be included in the dictionary data generation unit 68 shown in FIG.

  The additional learning determination unit 150 extracts an image region of the drug portion from the third image 130 based on an instruction input from the operation unit 18 by the user, and determines whether the drug image is a negative case image (incorrect answer pattern). Determine whether it is a case image. If there is an error in the drug name detected by the second drug name detection unit 108 and the user inputs a correct drug name from the operation unit 18, it is determined as a negative case image. When the medicine name detected by the second medicine name detection unit 108 is correct, it is determined as a correct case image.

  The learning image generation unit 152 generates a learning image based on the image in the image area determined to be a negative case image by the additional learning determination unit 150. The learning image generation unit 152 extracts a drug image region from the third image 130 and generates a learning image. The learning image generation unit 152 performs at least one image processing among rotation, enlargement, reduction, and affine transformation on the drug image region extracted from the third image 130, and includes various image variations. An image can be generated.

  The dictionary update unit 154 performs additional learning using the learning image generated by the learning image generation unit 152, and updates the dictionary 140 (see FIG. 7) stored in the dictionary storage unit 156. The dictionary update unit 154 corresponds to one form of “dictionary update means”.

  The dictionary storage unit 156 is a storage unit that stores data of the dictionary 140. The dictionary storage unit 156 may be a part of the storage area of the storage unit 70 described in FIG. 1, or may be an external storage device or a storage device of a server connected to a network. The dictionary storage unit 156 corresponds to one form of “dictionary storage means”.

[Example of operation of dispensing inspection apparatus 10]
Next, the operation of the dispensing inspection apparatus 10 will be described. FIG. 20 is a flowchart showing the procedure of the dispensing inspection method by the dispensing inspection device 10. Each step in the flowchart of FIG. 20 is executed by the program of the processing device 14 described in FIG.

  The medicine to be inspected is usually bundled by a binding tool such as a rubber band in a state where the sheet medicine 41 and the fraction medicine 42 are overlapped. In the dispensing audit, first, the pharmacist or the like removes the fraction medicine 42 from the medicine to be audited and separates it into the sheet medicine 41 and the fraction medicine 42. Then, the sheet medicine 41 is placed on the first placement table 20. The sheet medicine 41 is positioned by the first butting portion 50 and the second butting portion 52 and placed on the imaging region 20b of the first placing table 20 with the back surface of the PTP sheet facing downward. In addition, the fraction medicine 42 is placed on the imaging region 24b of the second mounting table 24 with the front surface facing downward.

  When an instruction to start dispensing inspection is input, the diffuse lighting device 32, the side lighting device 34, and the oblique lighting device 36 are operated according to an instruction from the lighting control unit 58. The diffuse illumination device 32 is disposed on the back surface of the sheet medicine 41, the side illumination device 34 is disposed on the side surface of the sheet medicine 41, particularly the corner portion, and the oblique illumination device 36 is disposed obliquely on the front surface of the fraction medicine 42, respectively. Irradiate light.

  Note that at least one of the sheet medicine 41 and the fraction medicine 42 is the first mounting table 20 and the first medicine from the image photographed by at least one of the first photographing device 26, the second photographing device 28, and the third photographing device 30. It is also possible to detect dispensing on at least one of the two loading tables 24 and automatically start dispensing inspection.

  When the dispensing inspection process shown in FIG. 20 is started, the sheet medicine 41 placed on the first placement table 20 is photographed by the first photographing device 26 from below the first placement table 20 (step S12). Step S12 corresponds to a form of “first photographing step”. The first image 110 is obtained by the first photographing process in step S12.

  Moreover, the sheet | seat chemical | medical agent 41 mounted in the 1st mounting base 20 is image | photographed by the 2nd imaging device 28 from the side of the 1st mounting base 20 (step S14). Step S14 corresponds to a form of “second photographing step”. The second image 120 is obtained by the second photographing process in step S14.

  Furthermore, when the fraction medicine 42 of the medicine to be inspected is placed on the second mounting table 24, the fraction medicine 42 placed on the second placing table 24 is moved from below the second placing table 24 by the third imaging device 30. A picture is taken (step S16). Step S <b> 16 corresponds to a form of “third photographing step”. The third image 130 is obtained by the third photographing process in step S16.

  The order of execution of the first photographing step (step S12), the second photographing step (step S14), and the third photographing step (step S16) is not limited to the illustrated example, and the photographing order is not limited. The first shooting step (step S12), the second shooting step (step S14), and the third shooting step (step S16) may be performed simultaneously, and the shooting order may be changed.

  When the first image 110 is acquired by the first imaging process (step S12), the first medicine name detection unit 100 detects the medicine name of the sheet medicine 41 from the first image 110 (step S18). Step S18 corresponds to one form of a “first drug name detection step”.

  When the second image 120 is acquired by the second imaging step (step S14), the number detection unit 102 detects the number of sheet medicines 41 from the second image 120 (step S20). Step S20 corresponds to one form of the “sheet number detection step”.

  When the third image 130 is acquired by the third imaging step (step S16), the fraction drug number detection unit 104 detects the number of fraction medicines 42 from the third image 130 (step S22). Step S22 corresponds to one form of the “fraction drug number detection step”.

  When the number of sheet medicines 41 is detected in step S20 and the number of fraction medicines 42 is detected in step S22, the total medicine number detection unit 106 determines the total medicine from the number of sheet medicines 41 and the number of fraction medicines 42. The number is detected (step S24). Step S24 corresponds to one form of the “total drug number detection step”.

  In addition, when the third image 130 is acquired by the third imaging process (step S16), the second drug name detection unit 108 detects the drug name of the fraction drug 42 from the third image (step S26). Step S26 corresponds to one form of a “second medicine name detection step”. In the second drug name detection step (step S26), the drug name of the fraction drug 42 is detected by pattern recognition from the third image 130 using the dictionary 140 in which the feature of the drug image and the drug name are associated with each other.

  In addition, the order of each process of step S18 to step S28 is not restricted to the example of illustration, The order of a process can be changed suitably in the range which can detect the objective.

  After the detection of the drug name of the sheet drug 41 in step S18, the detection of the total drug number in step S24, and the detection of the drug name of the fraction drug 42 in step S26, the audit result determination unit 66 first Whether the drug name detected in each of the drug name detection process (step S18) and the second drug name detection process (step S26) and the total number of drugs detected in step S24 match the prescription information 84. Is determined (step S28). Step S28 corresponds to one form of the audit result determination step.

  Based on the determination result in step S28, the display control unit 72 displays information on the determination result on the display unit 16 (step S30). Since the determination result information is displayed on the display unit 16 by the determination result display step in step S30, it is possible to alert a user such as a pharmacist about a dispensing error.

[Recognition process in second drug name detection step (step S26)]
FIG. 21 is a flowchart showing the procedure of the recognition process performed in the second medicine name detection step (step S26). In the present embodiment, the flowchart of FIG. 21 is executed by the second medicine name detection unit 108 (see FIG. 4).

  When the recognition process in FIG. 21 is started, the second medicine name detection unit 108 uses the medicine name detected by the first medicine name detection unit 100 as a search key, and the corresponding medicine from the dictionary 140 of the dictionary storage unit 156. Name dictionary data is acquired (step S42). In the dictionary data acquisition step (step S42), for example, when the drug name detected by the first drug name detection unit 100 is “medicine name A”, the second drug name detection unit 108 reads “drug name” from the dictionary 140. A feature amount indicating the appearance feature of the drug “A” is acquired.

  Further, the second medicine name detection unit 108 extracts a medicine region from the third image photographed by the third photographing device 30 (step S44). Then, the second medicine name detection unit 108 calculates the feature amount of the medicine from the medicine area extracted in the medicine area extraction process of Step S44 (Step S46). The feature amount calculated in the feature amount calculation step in step S46 is an image feature useful for pattern discrimination, and may be an image feature indicating the appearance feature of the medicine.

  Next, the second drug name detection unit 108 compares the feature amount calculated in step S46 (the feature amount of the drug in the third image) with the feature amount of “drug name A” acquired from the dictionary 140. The likelihood that is an evaluation value for evaluating whether or not the feature amount of the drug in the third image is likely to be close to the feature amount of “drug name A” is calculated (step S48). Likelihood is an index representing the degree of similarity between images.

As a method for calculating the likelihood from the feature amount of the image, for example, a method described in JP 2011-90413 A can be used. If the value of the feature value in a certain image region is f _k , the probability that the region is a part of the recognized object (predetermined pattern) is Pr (f _k | I ₊ ), and the probability that the region is a part of the unrecognized object. Is Pr (f _k | I ₋ ). These probabilities Pr (f _k | I ₊ ) and Pr (f _k | I ₋ ) are obtained in advance by machine learning a large amount of learning images. Likelihood C _k in the target image region is defined as in equation (1). That is, the ratio between the probability Pr (f _k | I ₊ ) and the probability Pr (f _k | I ₋ ) is calculated, and the logarithm thereof is set as the likelihood C _k .

C _k = log [{Pr (f _k | I ₊ )} ÷ {Pr (f _k | I ₋ )}]
= C _{k +} (f _k ) −C _k− (f _k ) (1)
Where C _{k +} (f _k ) = log {Pr (f _k | I ₊ )},
C _k− (f _k ) = log {Pr (f _k | I ₋ )}
The dictionary data has a configuration in which the value of C _{k +} (f _k ) and the value of C _k− (f _k ) in Expression (1) can be referred to. That is, it is only necessary that Pr (f _k | I ₊ ) and Pr (f _k | I ₋ ) are obtained by machine learning and the logarithm of these values is stored in the data of the dictionary 140.

  Next, the second drug name detection unit 108 determines a drug name based on the likelihood calculated in the likelihood calculation step of step S48 (step S50). For example, in the pattern recognition process in the second medicine name detection unit 108, a medicine image having a likelihood equal to or higher than a predetermined threshold is detected as a recognition result.

  When the feature amount of the drug in the third image is likely to be close to the feature amount of “drug name A” acquired from the dictionary data (when the likelihood is greater than or equal to the threshold value), in the drug name determination step of step S50, The second drug name detection unit 108 detects that the drug name of the fraction drug 42 is “drug name A”. On the other hand, if the likelihood calculated in step S48 is less than the threshold, the second drug name detection unit 108 determines that the drug name of the fraction drug 42 is not “drug name A”, and the drug names do not match. Is detected.

  As a correspondence example when the second drug name detection unit 108 detects a mismatch in the drug name, a configuration is adopted in which error information indicating the mismatch is supplied from the second drug name detection unit 108 to the audit result determination unit 66. be able to. As another example of correspondence when the second drug name detection unit 108 detects a mismatch in drug name, the second drug name detection unit 108 uses the search key to search for the feature amount of the drug in the third image calculated in step S46. As an example, a configuration in which the corresponding drug name is detected from the dictionary 140 by referring to the dictionary 140 can be employed.

  In this way, the information on the drug name determined based on the dictionary data by pattern recognition from the third image 130 which is a captured image of the fraction drug 42 is supplied to the audit result determination unit 66.

  The audit result determination unit 66 determines whether or not the drug name detected by the second drug name detection unit 108 matches the drug name detected by the first drug name detection unit 100. It is determined whether the drug name and the total number of drugs match the drug name and the number of drugs in the prescription information 84.

[Example of audit result display screen]
FIG. 22 is a diagram illustrating an example of an audit result display screen. When the medicine name and the number of medicines of the prescribed medicine and the medicine name and the medicine number of the medicine to be audited supplied from the detection section 64 match, the audit result determination unit 66, as shown in FIG. The display control unit 72 is instructed to display “OK pass” indicating that the audit result is appropriate.

  FIG. 23 is a diagram illustrating another example of an audit result display screen. When the number of medicines to be audited supplied from the detection unit 64 is larger than the number of medicines prescribed, the audit result determination unit 66 has an inappropriate audit result as shown in FIG. The display control unit 72 is instructed to display “NG excess” indicating that the number of drugs is too large.

  FIG. 24 is a diagram illustrating another example of an audit result display screen. When the number of medicines of the audit target medicine supplied from the detection unit 64 is smaller than the number of medicines of the prescribed medicine, the audit result determination part 66 has an inappropriate audit result as shown in FIG. The display control unit 72 is instructed to display “NG shortage” indicating that the number of medicines is short. In the display screen illustrated in FIG. 24, “(additional input?)” Is displayed when the third image 130 is shot in two steps.

  In dispensing, for example, when the number of drugs is 21 tablets, there are 2 PTP sheets of 10 tablets and 5 PTS sheets and 5 How to put out medicines like the fraction of tablets and the fraction of 6 tablets. By not providing the fraction of one tablet, accidental ingestion that prevents the medicine from being taken out of the package (whole package) is prevented. In such a case, it is necessary to photograph two fraction drugs 42. The display of “(additional input?)” Shown in FIG. 24 corresponds to the case where two fraction medicines 42 are imaged, and asks whether or not additional input of fractions, that is, whether or not the third image 130 is additionally imaged. To display.

  In the dispensing inspection apparatus 10 according to the present embodiment, when there are two fractional medicines 42, the third image 130 may be taken in two steps corresponding to each fractional medicine 42, or Alternatively, the two fraction medicines 42 may be placed on the second mounting table, the two fraction medicines 42 may be photographed on one third image 130, and the fraction medicine number may be detected as described above.

  In the dispensing inspection device 10, when two fractional medicines 42 are photographed simultaneously, a pharmacist or the like may be able to input the fact through the operation unit 18. Alternatively, the pharmacist or the like can input by the operation unit 18 whether the fractional medicine 42 is one, the two fractional medicines 42 are photographed at one time, or the two fractional medicines 42 are photographed at two times. You may do it.

  In addition, when the medicine name of the prescribed medicine and the medicine name of the medicine to be audited supplied from the detection section 64 are different, the audit result determination unit 66 performs a display indicating that the medicine name is different. The display control unit 72 is instructed. Further, when the drug name detected by the first drug name detection unit 100 and the drug name detected by the second drug name detection unit 108 are different, the audit result determination unit 66 displays that the two drug names are different. The display control unit 72 is instructed to perform In this case, it is preferable that the drug name detected by the first drug name detection unit 100 and the drug name detected by the second drug name detection unit 108 are displayed side by side on one display screen.

  The audit result determination unit 66 displays that the drug name could not be detected when at least one of the first drug name detection unit 100 and the second drug name detection unit 108 could not detect the drug name. The display control unit 72 is instructed to perform The display control unit 72 causes the display unit 16 to perform display according to the determination result.

  For example, if the second drug name detection unit 108 cannot detect a drug name that matches the drug name detected by the first drug name detection unit 100, the display unit 16 indicates “Is it a drug with a different fractional sheet? "Check it?" Or "Would you have mistaken the fractional sheet?"

  A pharmacist or the like who is a user visually confirms the drug names of the sheet drug 41 and the fraction drug 42, and the dispensing inspecting apparatus 10 determines “mismatch” even though both drug names match. If the answer is yes, correct / wrong judgment by the user is input from the operation unit 18 to correct the data in the dictionary 140.

  That is, when there is an error in the drug name detected by the second drug name detection unit 108 (that is, the drug name of the fraction drug 42), or when the second drug name detection unit 108 cannot detect the drug name. Then, a process of updating the dictionary 140 by additional learning is performed.

  For example, when the medicine to be prescribed is “medicine name A” and the medicine name detected by the second medicine name detecting unit 108 is “medicine name B”, the dispensing inspection apparatus 10 displays the display unit 16. Through the display, the user is informed that “medicine is wrong”. In this case, when the user visually confirms the drug name of the fraction drug 42 placed on the second mounting table 24 and the drug name of the fraction drug 42 is “medicine name A” (in fact, it is not wrong) Since the detection of the drug name by the second drug name detection unit 108 is incorrect, the user can change the drug name of the fraction drug 42 on the second mounting table 24 by the manual operation from the operation unit 18. ". Based on the correct drug name input from the operation unit 18, the dispensing inspection apparatus 10 executes a process of updating the dictionary 140 by additional learning.

[About dictionary]
The dictionary 140 may be prepared in advance, or the dictionary data may be constructed from the third image automatically collected by the dispensing inspection apparatus 10 of the present embodiment. When the prescribed number is exceeded, the drug name detection function by the second drug name detection unit 108 may be validated.

[Dictionary update process by additional learning]
FIG. 25 is a flowchart showing a procedure of dictionary update processing by additional learning. The dictionary update process includes a learning image acquisition step (step S62), a feature amount calculation step (step SS64), a probability distribution update step (step S66), and a dictionary update step (step S68).

  When the additional learning process is started, the dictionary updating unit 154 acquires the negative case image or the positive case image generated by the learning image generation unit 152 as a learning image (step S62). Then, the dictionary update unit 154 calculates a feature amount from the acquired learning image (step S64).

Next, the dictionary updating unit 154 updates the probability distribution based on the feature amount calculated in step S64 (step S66). The probability distribution here refers to the probability Pr (f _k | I ₊ ) and the probability Pr (f _k | I ₋ ) described above.

  Then, the dictionary updating unit 154 updates the dictionary that defines the correspondence between the medicine image and the medicine name in accordance with the update of the probability distribution in Step S66 (Step S68).

  In this manner, dictionary data in which the drug name detected by the first drug name detection unit 100 is associated with the appearance characteristics of the drug extracted from the third image is generated, and the dictionary is updated. By installing the function of updating the dictionary by additional learning, the reliability of determination by the dispensing inspection apparatus 10 can be improved.

[Advantages of this embodiment]
(1) According to the dispensing inspection apparatus 10 of the present embodiment, the fraction medicine 42 is removed from the dispensed medicine to be audited, and the sheet medicine 41 is placed on the first mounting table 20 with the back surface of the PTP sheet facing downward. The fraction medicine 42 is placed on the second mounting table 24 with the front face of the fraction medicine 42 facing down, and an instruction to start an audit is given or automatically, including the medicine number of the fraction medicine. Thus, it is possible to audit whether or not the prescribed drug name and number of drugs to be audited are appropriate.

  (2) According to the dispensing inspection apparatus 10 of the present embodiment, it can be determined whether or not the drug name of the sheet drug 41 and the drug name of the fraction drug 42 match.

  (3) According to the dispensing inspection apparatus 10 of the present embodiment, when the drug name of the fraction drug 42 cannot be correctly detected, the drug name detected from the first image by additionally learning the third image Dictionary data in which the image of the medicine extracted from the third image is associated, and the dictionary 140 can be updated. Thereby, the detection accuracy of the medicine name of the fraction medicine 42 can be improved.

  (4) According to the dispensing inspection apparatus 10 of the present embodiment, there is no need to use a binding tool such as a rubber band that is color-coded according to the number of PTP sheets of the medicine to be audited. In addition, since the dispensing inspection apparatus 10 captures an image of the auditable drug and detects the number of PTP sheets by image analysis, unlike the case of obtaining the number of PTP sheets from the thickness of the auditable drug, It is not necessary to know the thickness for each PTP sheet.

  (5) According to the dispensing inspection apparatus 10 of the present embodiment, the burden of dispensing inspection by a pharmacist at a dispensing pharmacy or the like can be significantly reduced.

  (6) According to the dispensing inspection apparatus 10 of the present embodiment, the data in the dictionary 140 can be easily updated based on the third image actually captured by the third imaging apparatus 30, and the determination reliability You can improve your sex.

  (7) The dispensing inspection device 10 of the present embodiment associates the captured first image, second image and third image, drug name and number of drugs, and audit result (determination result) as a preferred mode. And stored in the storage unit 70. In this way, it is necessary to confirm the drug provided to the patient at a later date by storing the image of the drug to be audited, the name of the drug, the number of drugs, and the audit result in association (linked). Even in this case, the image, the name of the medicine, the number of medicines, and the audit result can be shown to cope with it appropriately.

[Modification 1]
Information such as the image of the medicine to be audited, the name of the medicine, the number of medicines, and the audit result is stored in the local personal computer instead of the storage unit 70 included in the dispensing inspection device 10 or in addition to the storage unit 70 included in the dispensing inspection device 10. It may be stored (saved) in a computer or a cloud server on a network.

  In addition, it is not limited to memorize | storing all the image which image | photographed the chemical | medical agent to be audited, a chemical | medical agent name and the number of chemical | medical agents, and an audit result. For example, only an audit result and an image may be stored, only a drug name, the number of drugs, and an audit result may be stored, or only a drug name, the number of drugs, and an image may be stored. Alternatively, it is not necessary to store any information such as an image obtained by photographing the medicine to be audited, the medicine name and the number of medicines, and the audit result.

[Modification 2]
The installation positions of the first imaging device 26, the second imaging device 28, and the third imaging device 30 may have various forms as long as each imaging device can function. The 1st imaging device 26 should just be able to optically read the barcode and / or character string attached | subjected to the back surface of the PTP sheet. The second imaging device 28 only needs to be able to image the sheet drug 41 from the side of the sheet drug 41, preferably from a direction orthogonal to the stacking direction of the PTP sheets (surface direction of the PTP sheet). The 3rd imaging device 30 should just image the front surface (drug | medicine side) of the fraction medicine 42. FIG. Depending on the orientation or posture of each of the sheet medicine 41 and the fraction medicine 42 at the time of photographing, the first photographing device 26 is installed above the placement surface 20a of the first placement table 20, and the second photographing device 28 is a second one. There may be a mode in which the first mounting table 20 is installed below the mounting surface 20 a or a mode in which the third imaging device 30 is installed above the mounting surface of the second mounting table 24.

[Modification 3]
In FIG. 1, the example in which the function of the processing device 14 is realized by a single computer has been described. However, the function of the processing device 14 may be realized by sharing the function among a plurality of computers. In addition, a configuration in which the scanner 12 and the processing device 14 described in FIG. 1 are integrated into a single housing to be an integrated dispensing inspection device is also possible.

[Modification 4]
The operation unit 18 in the above-described embodiment gives an instruction to perform additional learning when the drug name detected by the first drug name detection unit 100 and the drug name detected by the second drug name detection unit 108 do not match. It functions as an operating means that gives an instruction to execute additional learning when the medicine name detected by the second medicine name detecting means is incorrect.

  However, when carrying out the invention, an operation for giving an instruction to execute additional learning when the drug name detected by the first drug name detection unit 100 and the drug name detected by the second drug name detection unit 108 do not match. A configuration in which at least one of a means and an instruction to execute additional learning when the medicine name detected by the means and the second medicine name detection means is wrong is also possible.

  In addition, when the drug name detected by the first drug name detection unit 100 and the drug name detected by the second drug name detection unit 108 do not match, an operation unit that gives an instruction to perform additional learning (first operation unit) ) And an operation means (second operation means) for giving an instruction to execute additional learning when the drug name detected by the second drug name detection means is wrong is also possible.

[Configuration Example of Dispensing Audit System According to Other Embodiment]
FIG. 26 is a block diagram illustrating a configuration example of a dispensing inspection system 200 according to another embodiment. In FIG. 26, elements that are the same as or similar to the configuration of the embodiment described in FIGS. 1 to 25 are given the same reference numerals, and descriptions thereof are omitted.

  A dispensing inspection system 200 shown in FIG. 26 includes a server 202, a dispensing inspection apparatus 10A, and a receipt computer 82A. The server 202 has a dictionary storage unit 156, and the dictionary storage unit 156 stores data of the dictionary 140 (see FIG. 7). Further, the server 202 can be configured to include the processing function of the dictionary data generation unit 68 described with reference to FIG. The server 202 is connected to the network 204. The network 204 means a telecommunication line and can be a wide area network such as the Internet, for example.

  The configuration of the dispensing inspection device 10A is the same as the configuration of the dispensing inspection device 10 described in FIG. The processing device 14 of the dispensing inspection device 10 </ b> A has a communication unit 210. The communication unit 210 is a communication interface unit that transmits and receives data through the first communication line 212A. The processing device 14 is connected to the first communication line 212A via the communication unit 210. The first communication line 212A can be, for example, a local area network constructed in a dispensing pharmacy or hospital premises. The communication unit 210 corresponds to a form of “communication means”.

  A router 214A is connected to the first communication line 212A. The router 214A is a device that relays the connection between the first communication line 212A and the network 204. The first communication line 212A is connected to the network 204 via the router 214A. A receipt computer 82A is connected to the first communication line 212A.

  The dispensing inspection apparatus 10A can acquire the prescription information 84 (see FIG. 7) from the receipt computer 82A via the first communication line 212A. The dispensing inspection apparatus 10A is connected to the server 202 via the first communication line 212A and the network 204. The third image acquired by the scanner 12 of the dispensing auditing apparatus 10A is sent to the server 202, and the server 202 updates the dictionary 140.

  The dispensing audit system 200 can include a plurality of dispensing audit apparatuses 10A and 10B. In FIG. 17, for convenience of illustration, two dispensing inspection apparatuses 10 </ b> A and 10 </ b> B are illustrated, but two or more dispensing inspection apparatuses 10 may be included.

  The configuration of the dispensing inspection device 10B is the same as the configuration of the dispensing inspection device 10A. The dispensing inspection device 10B is connected to the second communication line 212B. The second communication line 212B can be a local area network constructed in another dispensing pharmacy or hospital premises different from the first communication line 212A. The second communication line 212B is connected to the network 204 via the router 214B. A receipt computer 82B is connected to the second communication line 212B.

  The dispensing inspection apparatus 10B can acquire the prescription information 84 (see FIG. 7) from the receipt computer 82B via the second communication line 212B. The dispensing inspection device 10B is connected to the server 202 via the second communication line 212B and the network 204. The third image acquired by the scanner 12 of the dispensing auditing apparatus 10B is sent to the server 202, and the server 202 updates the dictionary 140.

  According to the dispensing inspection system 200 shown in FIG. 26, the dictionary 140 used in the plurality of dispensing inspection apparatuses 10A and 10B can be centrally managed by the server 202 on the network.

  The timing at which the third image is transmitted from the dispensing inspection apparatuses 10A and 10B to the server 202 and the dictionary 140 is updated includes, for example, the timing of user operation and the model change of the tablet shape in each dispensing inspection apparatus 10A and 10B. There may be various timings such as the timing at which the marking on the medicine itself is changed to printing.

[About a program that enables a computer to implement the dispensing audit function]
A program for causing a computer to implement the dispensing inspection function of the dispensing inspection apparatus described in the above embodiment is a CD-ROM (Compact Disc Read-Only Memory) or a magnetic disk or other computer-readable medium (non-transitory information as a tangible object) It is possible to provide the program through the information storage medium. Instead of providing a program stored in such an information storage medium, it is also possible to provide a program signal as a download service using a network such as the Internet.

  It is also possible to provide a service that provides a processing function through a network by realizing part or all of the processing function in the dispensing inspection apparatus described in the embodiment by an application server or cloud computing.

  In the embodiment of the present invention described above, the configuration requirements can be changed, added, or deleted as appropriate without departing from the spirit of the present invention. The present invention is not limited to the embodiments described above, and many modifications can be made by those having ordinary knowledge in the field within the technical idea of the present invention.

10, 10A, 10B Dispensing inspection device 12 Scanner 14 Processing device 16 Display unit 18 Operation unit 20 First mounting table 20a Mounting surface 20b Imaging region 24 Second mounting table 24b Imaging region 26 First imaging device 28 Second imaging device 30 Third imaging device 32 Diffuse illumination device 32a Reflector 34 Side illumination device 36 Oblique illumination device 41 Sheet medicine 42 fraction medicine 50 first abutting section 52 second abutting section 52a transparent region 54 end face corner section 56 imaging control section 58 Illumination control unit 60 Image acquisition unit 62 Image processing unit 64 Detection unit 66 Audit result determination unit 68 Dictionary data generation unit 70 Storage unit 72 Display control unit 74 Control unit 80 Drug database 82, 82A, 82B Recto computer 84 Prescription information 90 PTP sheet 90a End 90b Clearance 90c Separation part 92 Drug 94 Storage part 96 Packaging 97 sentence Column 98 Barcode 100 First drug name detection unit 102 Number detection unit 104 Fractional drug number detection unit 106 Total drug number detection unit 108 Second drug name detection unit 110 First image 114 Character string 116 Bar code 120 Second image 130 Three images 140 Dictionary 150 Additional learning determination unit 152 Learning image generation unit 154 Dictionary update unit 156 Dictionary storage unit 200 Dispensing audit system 202 Server 204 Network 210 Communication unit 212A First communication line 212B Second communication line 214A, 214B Router S12 1 imaging process S14 2nd imaging process S16 3rd imaging process S18 1st medicine name detection process S20 number detection process S22 fraction medicine number detection process S24 total medicine number detection process S26 2nd medicine name detection process S28 audit result judgment process S30 judgment Result display step S42 Dictionary data acquisition step S44 Region extracting step S46 the feature quantity calculation step S48 the likelihood calculation step S50 drug name determining step S62 training image acquisition step S64 the feature quantity calculation step S66 probability distribution updating step S68 dictionary updating process

Claims (16)

A first mounting table for mounting a medicine sheet;
A second mounting table for mounting a fraction of the medicine cut from the medicine sheet;
First imaging means for imaging a medicine sheet placed on the first placement table from a first direction;
Second imaging means for imaging the drug sheet placed on the first placement table from a second direction different from the first direction;
Third imaging means for imaging a fraction of the medicine placed on the second mounting table;
A first medicine name detecting means for detecting a medicine name of a medicine sheet from at least one of optical character recognition and code recognition from a first image that is an image photographed by the first photographing means;
A number detection means for detecting the number of drug sheets from a second image which is an image taken by the second imaging means;
A fraction medicine number detection means for detecting the number of fraction medicines from a third image which is an image photographed by the third photographing means;
From the number of the drug sheets and the fractional number of drugs, a total drug number detecting means for detecting the total drug number;
Second drug name detection means for detecting a drug name of the fractional drug from the third image;
The drug name and the number of drugs in the prescription information corresponding to the prescription instruction, the drug name detected by each of the first drug name detecting means and the second drug name detecting means, and the total drug detected by the total drug number detecting means An audit result judging means for judging whether or not the numbers match,
Dispensing inspection device comprising   The said 2nd medicine name detection means detects the medicine name of the said fraction drug by pattern recognition from the said 3rd image using the dictionary with which the characteristic of the image of a medicine and the medicine name were linked | related. Dispensing inspection equipment.   The dispensing inspection apparatus according to claim 2, further comprising dictionary data generation means for generating data of the dictionary from the third image and the drug name detected by the first drug name detection means.   The dispensing inspection device according to claim 2 or 3, further comprising a dictionary updating unit that performs additional learning using the third image and performs a process of updating the dictionary.   The operation means which gives the instruction | indication which performs the said additional learning when the chemical | medical agent name which the said 1st chemical | medical agent name detection means and the chemical | medical agent name which the said 2nd chemical | medical agent name detection means do not correspond is provided. The dispensing inspection device described.   The dispensing inspection apparatus according to claim 4 or 5, further comprising an operation unit that gives an instruction to execute the additional learning when a drug name detected by the second drug name detection unit is incorrect. A server having dictionary storage means for storing the dictionary is connected to the network;
The dispensing inspection apparatus according to any one of claims 2 to 6, further comprising a communication unit that communicates with the server connected to the network.   The dispensing inspection device according to any one of claims 1 to 7, further comprising a display unit that displays information on a determination result by the audit result determination unit.   The dispensing inspection apparatus according to any one of claims 1 to 8, wherein the first photographing unit photographs a medicine sheet from a lower side that is lower than a placement surface of the first placement table in a direction of gravity.   The dispensing inspection device according to claim 9, further comprising diffusion illumination means for irradiating diffused light to the first mounting table from the lower side of the first mounting table.   The dispensing inspection device according to any one of claims 1 to 10, wherein the second imaging unit images the medicine sheet from a side of the first mounting table that is a direction not parallel to the direction of gravity.   The dispensing inspection apparatus according to claim 11, further comprising a side illumination unit configured to irradiate the medicine sheet placed on the first placement table with light from a side of the first placement table.   The dispensing inspection apparatus according to any one of claims 1 to 12, wherein the third imaging unit images a fraction of the drug from below, which is below the mounting surface of the second mounting table in the direction of gravity.   The oblique illumination means which irradiates light to the said 2nd mounting base from the said lower part of the said 2nd mounting base in the state in which an optical axis has an angle with respect to the imaging | photography optical axis of a said 3rd imaging means. Dispensing inspection device as described in 1. A first imaging step of imaging the medicine sheet placed on the first mounting table for placing the medicine sheet from the first direction;
A second imaging step of imaging the medicine sheet placed on the first placement table from a second direction different from the first direction;
A third imaging step of imaging the fractional medicine placed on the second mounting table for placing the fractional medicine cut from the medicine sheet;
A first drug name detection step of detecting a drug name of a drug sheet using at least one of optical character recognition and code recognition from a first image which is an image shot by the first shooting step;
A number detection step of detecting the number of drug sheets from a second image that is an image taken by the second imaging step;
A fraction medicine number detection step of detecting the number of fraction medicines from a third image that is an image photographed by the third photographing step;
From the number of medicine sheets and the number of fractional medicines, a total medicine number detecting step for detecting the total number of medicines;
A second drug name detection step of detecting a drug name of the fractional drug from the third image;
The drug name and the number of drugs in the prescription information corresponding to the prescription instruction, the drug name detected in each of the first drug name detection step and the second drug name detection step, and the total drug number detection step An audit result determination step for determining whether or not the total number of drugs matches,
Dispensing audit method including A first image obtaining function for obtaining a first image, which is an image obtained by photographing the medicine sheet placed on the first placement table for placing the medicine sheet by the first photographing means from the first direction;
A second image acquisition function for acquiring a second image, which is an image obtained by photographing the medicine sheet placed on the first placement table from a second direction different from the first direction by a second photographing unit;
A third image acquisition function for acquiring a third image which is an image obtained by photographing the fraction medicine placed on the second mounting table for placing the fraction medicine cut from the medicine sheet by the third photographing means; ,
A first drug name detection function for detecting a drug name of a drug sheet from the first image using at least one of optical character recognition and code recognition;
A number detection function for detecting the number of drug sheets from the second image;
A fraction drug number detection function for detecting the number of fraction drugs from the third image;
From the number of the drug sheets and the number of fractional drugs, a total drug number detection function for detecting the total drug number,
A second drug name detection function for detecting a drug name of the fractional drug from the third image;
Detected by the drug name and the number of drugs in the prescription information corresponding to the prescription instructions, the drug name detected by the respective functions of the first drug name detection function and the second drug name detection function, and the total drug number detection function A program for causing a computer to realize an audit result determination function for determining whether or not the total number of drugs matches.