JP2022025439A - Image processing device, medicine discriminating device, and image processing method - Google Patents

Abstract

To provide an image processing device, a medicine discriminating device and an image processing method, with which desirable photographic image display is realized when photographing a medicine placed on a first plane of a photography table from the first plane and a second plane that is reverse to the first plane.SOLUTION: The present invention acquires a first image obtained by photographing a medicine placed on a support table from the underside of the support table using a photographing device arranged at a lower position of the support table, generates a second image (220) in which the first image is reversed with respect to a medicine movement direction in which the medicine is moved when adjusting the position of the medicine relative to the photographing range of the photographing device, generates a display signal for causing the second image to be displayed in a first region (202) of a screen displayed on a display device, and outputs the display signal.SELECTED DRAWING: Figure 8

Description

The present invention relates to an image processing device, a drug identification device, and an image processing method.

At medical institutions such as hospitals and pharmacies, drug audits and identification of brought-in drugs are carried out. When auditing drugs by applying visual inspection, the burden on workers such as pharmacists is heavy. For this reason, medical institutions have adopted systems that support drug audits.

Patent Document 1 describes a drug imaging device for capturing an image of a drug provided in a drug discrimination system. The apparatus described in the document includes a first camera that captures an image of the drug viewed from above and a second camera that captures an image of the drug viewed from below. The photographed images of the drug taken by the first camera and the second camera are displayed on the screen of the display device.

The tablet image identification window displayed on the screen of the display device includes a first portion, a second portion, and a third portion. The first part displays the entire captured image. The second part enlarges and displays the medicine selected from the medicines displayed in the first part. The third part displays a list of candidate drugs for which discrimination results have been obtained when the discrimination of the selected drug has been completed.

In the first part, when the view tab is selected from above, the image of the drug taken from above is displayed, and when the view tab is selected from the bottom, the image of the drug taken from below is displayed.

Japanese Unexamined Patent Publication No. 2019-76787

However, when shooting a drug placed on the upper side of the shooting table using a camera installed at the lower position of the shooting table, or when moving the position of the drug according to the angle of view of the camera, etc. When the drug is moved to the right, the drug moves to the left on the screen where the photographed image of the drug is displayed, which confuses the operator.

In the system described in Patent Document 1, the position of the tray for accommodating the medicine is determined according to the angles of view of the first camera and the second camera, and the above-mentioned problem does not exist. When taking a picture of each packing paper of a packing paper continuum in which a plurality of packing papers are connected, the above-mentioned problems when moving the packing paper continuous body and aligning each packing paper. Occurs.

The above-mentioned problems may exist not only in the discrimination of drugs brought in by patients, but also in the identification of drugs such as the audit of prescription drugs carried out at pharmacies and the like.

The present invention has been made in view of such circumstances, and display of a preferable photographed image when the drug placed on the first surface of the photographing table is photographed from the side of the second surface opposite to the first surface. It is an object of the present invention to provide an image processing device, a drug identification device, and an image processing method in which the above is realized.

In order to achieve the above object, the following aspects of the invention are provided.

The image processing apparatus according to the present disclosure is an image processing apparatus including one or more processors, in which the processor transfers a drug placed on the first surface of the support base to the opposite side of the first surface of the support base. Using the imaging device located at the position on the side of the second surface, the first image obtained by photographing the drug from the side of the second surface of the support base is acquired, and the drug is taken with respect to the imaging range of the photographing device. A display signal that generates a second image in which the first image is inverted with respect to the direction of movement of the drug to move the drug when adjusting the position of, and displays the second image in the first area of the screen displayed on the display device. Is an image processing device that generates a display signal and outputs a display signal.

According to the image processing apparatus according to the present disclosure, when the position of the drug placed on the first surface of the photographing table is moved, the moving direction of the drug and the moving direction of the second image displayed on the screen of the display device. Can be matched with.

The agent may be tablets, capsules, etc. that can be recognized as one solid.

The drug to be imaged may include a form in which one or more drugs are packaged using a packing paper or the like.

As the first image, a moving image may be applied or a still image may be applied. The moving image may include a through image. The first image may be subjected to various corrections such as lens distortion correction.

In the image processing apparatus according to the other aspect, the processor generates a display signal for displaying the first image and the second image in the first region.

According to such an embodiment, the first image can be displayed on the screen of the display device. As a result, the printing and engraving of the drug can be visually recognized in the correct direction.

In the image processing apparatus according to the other aspect, the processor detects the image of the drug contained in the first image, extracts the image of the drug detected from the first image from the first image, and the image of the extracted drug. Is generated in the second area of the screen.

According to such an embodiment, each drug can be individually recognized from a photographed image of a drug group containing a plurality of drugs.

In the image processing apparatus according to the other aspect, the processor enlarges the image of the drug extracted from the first image and generates a display signal for displaying the enlarged image of the drug in the second region.

According to such an embodiment, the visibility of the image of each drug displayed in the second region can be improved.

In the image processing apparatus according to another aspect, the processor reduces the first image, displays the reduced first image in the first region, and displays the non-reduced image of the drug extracted from the first image. Generate a display signal to be displayed in the second area.

According to such an embodiment, the visibility of the image of each drug displayed in the second region can be improved.

In the image processing apparatus according to the other aspect, the processor detects the image of the drug contained in the second image, extracts the image of the drug detected from the second image from the second image, and moves the image of the drug to the drug. A display signal is generated in which the image of the drug inverted with respect to the direction of movement of the drug is displayed in the second area of the screen.

According to such an embodiment, each drug can be individually recognized from a photographed image of a drug group containing a plurality of drugs.

In the image processing apparatus according to the other aspect, the processor enlarges the image of the drug inverted with respect to the drug moving direction, and generates a display signal for displaying the enlarged image of the drug in the second region.

According to such an embodiment, the visibility of the image of each drug displayed in the second region can be improved.

In the image processing apparatus according to the other aspect, the processor reduces the second image, displays the image of the reduced drug in the first region, and is extracted from the second image and inverted, and the non-reduced drug. Generates a display signal to display the image of.

According to such an embodiment, the visibility of the image of each drug displayed in the second region can be improved.

In the image processing apparatus according to the other aspect, the processor generates a display signal in which the resolution of the image displayed in the second region exceeds the resolution of the image displayed in the first region.

According to such an aspect, the legibility of the image of each drug displayed in the second region can be improved with respect to the image displayed in the first region.

The drug identification device according to the present disclosure comprises one or more processors, and a drug placed on the first surface of the support is placed at a position on the side of the second surface opposite to the first surface of the support. It is a drug identification device that identifies a drug from a photographed image of a drug acquired by using an imaging device, and the processor is obtained by photographing the drug from the second surface side of the support using the imaging device. The first image is acquired, and when adjusting the position of the drug with respect to the imaging range of the imaging device, a second image is generated in which the first image is inverted with respect to the direction of drug movement to move the drug, and the image is displayed on the display device. This is a drug identification device that generates a display signal for displaying a second image in the first area of the screen and outputs the display signal.

According to the drug identification device according to the present disclosure, when the position of the drug placed on the first surface of the photographing table is moved, the drug moving direction and the moving direction of the second image displayed on the screen of the display device are used. Can be matched.

The drug identification device may perform at least one of drug discrimination and drug audit.

In the drug identification device according to another aspect, the processor detects the image of the drug contained in the first image, extracts the image of the drug detected from the first image from the first image, and the image of the extracted drug. Based on, the drug corresponding to the image of the extracted drug is identified.

According to such an embodiment, each drug can be individually identified from a photographed image of a drug group containing a plurality of drugs.

In the drug identification device according to another aspect, the processor detects the image of the drug contained in the second image, extracts the image of the drug detected from the second image from the second image, and extracts from the second image. The image of the drug is inverted with respect to the drug movement direction, and the drug corresponding to the image of the drug extracted from the second image is identified based on the image of the drug inverted with respect to the drug movement direction.

According to such an embodiment, each drug can be individually identified from a photographed image of a drug group containing a plurality of drugs.

In the drug identification device according to another aspect, the processor generates a display signal for displaying information on a candidate drug on the screen when an image of the drug to be identified is selected.

According to such an embodiment, the drug can be identified by using the information of the candidate drug displayed on the screen.

In the drug identification device according to another aspect, a plurality of lighting devices that irradiate the drugs placed on the first surface of the support base with illumination light from different directions are provided, and the processor is a plurality of lighting devices. Of these, the first lighting condition for irradiating the drug with the illumination light using two or more lighting devices is applied, the first image is acquired using the photographing device, and the number is smaller than the first lighting condition. The second lighting condition for irradiating the drug with the illumination light using the lighting device is applied, the first image is acquired using the photographing device, and the first image and the second image obtained by applying the first lighting condition are applied. The drug is identified using at least one of the first images obtained with the lighting conditions applied.

According to such an embodiment, the drug can be identified based on the first image obtained by applying different lighting conditions.

In the drug identification device according to another aspect, the processor applies a second lighting condition to acquire a plurality of first images.

According to such an embodiment, the drug can be identified based on a plurality of first images obtained by applying the second lighting condition.

In the drug identification device according to another aspect, the plurality of lighting devices are arranged so as to be displaced by 90 degrees with respect to the optical axis of the photographing device in a plane orthogonal to the optical axis of the photographing device. The second lighting device, the third lighting device, and the fourth lighting device are provided, and the processor uses the first lighting device, the second lighting device, the third lighting device, and the fourth lighting device as the first lighting condition for the drug. The first image is acquired by irradiating the illuminating light, and as the second illuminating condition, the illuminating light is emitted from each of the first illuminating device, the second illuminating device, the third illuminating device, and the fourth illuminating device to the chemicals. Irradiate and acquire four first images.

According to such an embodiment, the drug can be identified based on the four first images obtained by irradiating the drug with illumination light from four directions orthogonal to each other.

The drug identification device according to claim 15 or 16, wherein in the drug identification device according to another embodiment, the processor uses at least one of a plurality of first images acquired by applying the second lighting condition to identify the drug. ..

According to such an embodiment, the drug can be identified based on one or more first images obtained by applying the second lighting condition.

The image processing method according to the present disclosure uses an imaging device in which a drug placed on the first surface of the support is placed at a position on the side of the second surface opposite to the first surface of the support. The first image obtained by photographing the drug from the side of the second surface of the support base is acquired, and the drug moving direction in which the drug is moved when adjusting the position of the drug with respect to the imaging range of the imaging device is the first. This is an image processing method that generates a second image in which an image is inverted, generates a display signal for displaying the second image in the first area of the screen displayed on the display device, and outputs the display signal.

According to the present invention, when the position of the drug placed on the first surface of the photographing table is moved, the moving direction of the drug can be matched with the moving direction of the second image displayed on the screen of the display device.

FIG. 1 is an explanatory diagram of a problem. FIG. 2 is an overall configuration diagram of a drug identification system according to an embodiment. FIG. 3 is a front view showing a schematic configuration of the drug identification device shown in FIG. 2. FIG. 4 is a plan view of the drug identification device shown in FIG. FIG. 5 is an explanatory diagram of a modified example of the drug. FIG. 6 is a functional block diagram of the drug identification system shown in FIG. FIG. 7 is a flowchart showing the procedure of the drug identification method according to the embodiment. FIG. 8 is a screen configuration diagram showing a configuration example of a screen displayed on the display device. FIG. 9 is a schematic diagram of a photographed image of the drug group 16 displayed on the screen of the display device. FIG. 10 is a screen configuration diagram showing a screen configuration example according to a modified example. FIG. 11 is an overall configuration diagram of a drug identification system according to an application example to an image processing apparatus. FIG. 12 is an overall configuration diagram of a drug identification system according to an application example of a network system.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the present specification, the same components are designated by the same reference numerals, and duplicate description will be omitted as appropriate.

[Explanation of issues]
FIG. 1 is an explanatory diagram of a problem. Reference numeral 1 shown in the figure is a schematic view of the drug 5A and the drug 5B placed on the mounting table as viewed from the surface side. Reference numeral 2 is a schematic view of a display image of the above-mentioned drug group taken by a camera arranged on the back surface side of the mounting table and displayed on the display device.

The surface of the drug group is the surface opposite to the surface of the drug group that comes into contact with the platform. For example, when the drug group is placed parallel to the horizontal plane, the upper surface of the drug is the surface of the drug. The back surface of the mounting table is the surface opposite to the surface on which the drug group of the mounting table is placed.

In the photographed image of the drug group indicated by reference numeral 2, a part of the agent 5B protrudes to the left with respect to the imaged area 6 of the camera. When the operator moves the drug group to the right while looking at the photographed image of the drug group displayed on the display device with the intention of fitting the drug 5B in such a state into the photographing area 6 of the camera, reference numeral 3 is assigned. As shown in the schematic view of the attached drug 5A and drug 5B viewed from the surface side, the drug 5B further protrudes from the photographing area 6 of the camera.

When the camera is rotated 90 degrees in a plane parallel to the light receiving surface of the image sensor provided in the camera, the inversion that occurs in the left-right direction in FIG. 1 occurs in the up-down direction. The left-right direction and the up-down direction referred to here are specified for convenience of explanation. The drug identification system that can solve the above problems and avoid operator confusion will be described in detail below.

[Drug identification system]
[Overall configuration example]
FIG. 2 is an overall configuration diagram of a drug identification system according to an embodiment. The drug identification system 10 shown in the figure includes a drug identification device 12 and a display device 14. The drug identification device 12 photographs the drug group 16 to be identified placed on the mounting table 22, and uses the photographed image of the drug group 16 containing one or more drugs 17 to capture the drug 17 included in the drug group 16. Perform identification.

Inside the housing 20 of the drug identification device 12, a photographing device for photographing the drug group 16 of the mounting table 22 from below is provided. That is, the photographing device is arranged at a position on the side of the photographing surface opposite to the drug placing surface 24 of the mounting table 22.

The photographing device includes an image sensor, an optical lens, and a signal processing circuit. As the image sensor, a CCD image sensor, a CMOS image sensor, or the like can be applied. Examples of the optical lens include a focus lens and a condenser lens.

The signal processing circuit generates a photographed image of the drug group 16 based on the optical image input to the CCD image sensor. The image referred to here may include the concepts of image data and image signals. CCD is an abbreviation for Charge Coupled Device. CMOS is an abbreviation for Complementary Metal-Oxide Semiconductor. In FIG. 2, the imaging surface of the mounting table 22 and the imaging device are not shown.

The mounting table 22 has a structure in which the periphery of the transparent plate is supported by using a frame. As the transparent plate, a plate-shaped member such as a glass plate that transmits the illumination light and the reflected light of the illumination light and has a certain rigidity can be applied. The transmittance referred to here is not limited to 100% transmittance. For example, the transmittance may be 50% or more.

A cover 26 is attached to the upper part of the mounting table 22 of the housing 20. The cover 26 is attached to the back surface of the housing 20. The cover 26 is arranged at a position separated from the mounting table 22 by a predetermined distance.

The drug identification device 12 includes an image processing unit that performs image processing on the captured image of the drug group 16 acquired by using the photographing device. The image processing unit may apply a computer having one or more processors and one or more memories. The image processing unit executes an image processing program and performs image processing on the captured image of the drug group 16. In FIG. 2, the image processing unit is not shown.

The display device 14 displays an image related to the drug group 16 and an identification result of drug identification on the screen 15 based on the display signal transmitted from the image processing unit. Details of the display on the screen 15 of the display device 14 will be described later.

The drug identification system 10 includes an input device used by the operator when inputting various information to the drug identification device 12. The input device may be a keyboard, a mouse, or the like. A touch panel type display device may be applied to integrally configure the display device 14 and the input device. Note that the input device is not shown in FIG.

FIG. 2 shows, as an example of the drug group 16 including the drug 17 to be identified, a form in which a plurality of drugs 17 are contained in each of a plurality of consecutive sachets 18. The drug identification device 12 photographs each of the plurality of packaging bags 18 and identifies the drugs 17 included in the drug group 16 for each packaging bag 18.

As the drug 17, tablets, capsules and the like packaged using a PTP sheet may be applied. The drug 17 may be a tablet or the like to which strip packaging is applied. The tablets and the like may be separated from the state in which a plurality of tablets and the like are integrated. PTP is an abbreviation for Press Through Pack.

Identification of the drug 17 may include a drug audit that matches each of the prescription-prepared drugs 17 with the prescription. The identification of the drug 17 may include a discrimination in which the brought-in drug is collated with the contents described in the medicine notebook, the electronic medical record, and the like.

The arrow line shown in FIG. 2 indicates the moving direction of the drug group 16. The moving direction of the drug group 16 is the moving direction of the drug group 16 displayed on the screen 15 of the display device 14 when the moving direction of the image of the drug group 16 is reversed with respect to the moving direction of the drug group 16 visually recognized by the operator. Represents the direction in which to move. That is, the image pickup device provided in the photographing device is arranged in a direction in which the movement direction of the actual drug group 16 and the movement direction of the displayed image of the drug group 16 are reversed.

The orientation with respect to the arrangement of the image pickup element here indicates the rotation direction on the plane parallel to the image pickup surface of the image pickup element. Further, the moving direction of 16 of the drug group is synonymous with the moving direction of the drug 17.

[Configuration example of drug identification device]
FIG. 3 is a front view showing a schematic configuration of the drug identification device shown in FIG. 2. FIG. 4 is a plan view of the drug identification device shown in FIG. 3 and 4 schematically show the inside of the housing 20 shown in FIG. Hereinafter, a configuration example of the drug identification device 12 will be described with reference to FIGS. 3 and 4 as appropriate.

The reference numeral x shown in FIGS. 3 and 4 is the arrangement direction of the lighting device, and represents the moving direction of the drug group 16. The symbol y shown in FIG. 4 is the arrangement direction of the lighting device, and represents the direction orthogonal to the moving direction of the drug group 16. The symbol z shown in FIG. 3 represents a vertical upward direction.

The moving direction of the drug group 16 is determined according to the installation state of the imaging device 30. For example, the left-right direction shown in FIG. 1 is an example of the movement direction of the drug group 16. The moving direction of the drug group 16 described in the embodiment is an example of a drug moving direction in which the drug is moved when the position of the drug is adjusted with respect to the photographing range of the photographing apparatus.

The drug identification device 12 includes a photographing device 30, a first lighting device 32, a second lighting device 34, a third lighting device 36, and a fourth lighting device 38. In FIG. 3, the second lighting device 34 and the fourth lighting device 38 are not shown.

As shown in FIG. 3, the photographing apparatus 30 is arranged at a position on the side of the photographing surface 28 of the mounting table 22 in the z direction. Similar to the photographing device 30, the plurality of lighting devices including the first lighting device 32, the second lighting device 34, the third lighting device 36, and the fourth lighting device 38 have the photographing surface 28 of the mounting table 22 in the z direction. Placed in a side position.

As shown in FIG. 4, the photographing apparatus 30 is arranged at a position where the optical axis 31 passes through the center position of the mounting table 22 in the xy plane in the x direction and the y direction. The first lighting device 32, the second lighting device 34, the third lighting device 36, and the fourth lighting device 38 are arranged at positions equidistant from the optical axis 31 of the photographing device 30. Further, the first lighting device 32 and the third lighting device 36 are arranged at positions facing each other with the photographing device 30 interposed therebetween in the x direction. Similarly, the second lighting device 34 and the fourth lighting device 38 are arranged at positions facing each other with the photographing device 30 interposed therebetween in the y direction.

In other words, the first lighting device 32, the second lighting device 34, the third lighting device 36, and the fourth lighting device 38 have the optical axis 31 of the photographing device 30 in a plane orthogonal to the optical axis 31 of the photographing device 30. The positions are shifted by 90 degrees as the center.

The photographing device 30 receives the reflected light of the illumination light from different directions, which are sequentially irradiated to the drug group 16 from each of the first lighting device 32 and the like, and captures the photographed image of the drug group 16 for each lighting state. Generate. The photographing device 30 can generate a photographed image for a plurality of drug groups 16 having different lighting conditions corresponding to the lighting state.

As an example of the lighting condition, the first lighting condition for irradiating the drug group 16 with the illumination light by using the first lighting device 32, the second lighting device 34, the third lighting device 36, and the fourth lighting device 38 can be mentioned. Will be. The first lighting condition may include an embodiment in which two or more lighting devices among the first lighting device 32, the second lighting device 34, the third lighting device 36, and the fourth lighting device 38 are applied.

As another example of the lighting condition, any one of the first lighting device 32, the second lighting device 34, the third lighting device 36, and the fourth lighting device 38 is used to irradiate the drug group 16 with the illumination light. The second lighting condition is mentioned. The second lighting condition may include an embodiment in which a smaller number of lighting devices is applied than the number of lighting devices in the first lighting condition.

The mounting table 22 described in the embodiment is an example of a support table. The drug mounting surface 24 of the mounting table 22 described in the embodiment is an example of the first surface. The photographing surface 28 of the mounting table 22 described in the embodiment is an example of the second surface.

FIG. 5 is an explanatory diagram of a modified example of the drug. In the drug group 40 including the drug 17 to be identified shown in FIG. 5, a plurality of drugs 17 are housed in a container 42 such as a petri dish. A material that transmits illumination light and reflected light of the illumination light is applied to the bottom surface 44 of the container 42. In FIG. 5, the support member that supports the container 42 is not shown. The support member that supports the container 42 described in the embodiment is an example of a support base.

The drug group 40 shown in FIG. 5 is applied in identifying a plurality of unpackaged drugs 17. On the other hand, the drug group 16 shown in FIGS. 2 to 4 is applied when identifying a plurality of drugs 17 to be packaged.

The drug identification device 12 includes an input / output port. The drug identification device 12 is communicably connected to the display device 14 shown in FIG. 2, an external device, and the like via the input / output port. The input / output port may be provided with a connector to which a signal transmission cable is connected, or may be provided with a wireless LAN port. Various standards such as USB (Universal Serial Bus) can be applied to the input / output ports. LAN is an abbreviation for Local Area Network.

The drug identification device 12 may include a plurality of input / output ports. Multiple I / O ports may apply different types of hardware and different types of standards. In FIGS. 2 to 5, the input / output ports are not shown.

[Functional block of drug identification system]
FIG. 6 is a functional block diagram of the drug identification system shown in FIG. The drug identification device 12 includes a memory 102, an input interface 104, and an input / output port 106.

The memory 102 stores various data, various parameters, and various programs applied to the drug identification device 12. The drug identification device 12 reads a program applied to various processes from the memory 102, executes the program, and performs various processes. Examples of various programs include a drug identification program applied to drug identification processing and an image processing program applied to various image processing.

When executing various programs, the drug identification device 12 reads parameters and data corresponding to the program to be executed from the memory 102. The drug identification device 12 stores various data generated by executing various programs in the memory 102.

The memory 102 may be configured to include a computer-readable medium or the like which is a tangible object such as a semiconductor memory. The memory 102 may include a magnetic storage device such as a hard disk. The memory 102 may be configured by using a plurality of storage devices and the like. The plurality of storage devices and the like may include a plurality of different types of storage devices and the like. The storage device or the like constituting the memory 102 may be divided into a plurality of storage areas. The memory 102 may include a temporary storage area for various data.

The drug identification device 12 includes a system control unit 120, a lighting control unit 122, an imaging control unit 124, an image processing unit 126, a drug information acquisition unit 128, a drug identification processing unit 130, and a display driver 132. The processor 100 can be applied to the hardware of the various processing units shown in FIG. That is, the various processing units shown in FIG. 6 correspond to various functions of the drug identification device 12 realized by applying signal processing using the processor 100.

The system control unit 120 comprehensively controls various processing units of the drug identification device 12. The system control unit 120 transmits command signals to various processing units based on signals transmitted from various processing units and input signals input via the input interface 104.

The system control unit 120 stores various data generated in various processes in the memory 102. Further, the system control unit 120 transmits data applied to various processes to the processing unit that performs various processes.

The lighting control unit 122 controls the lighting device 140 based on the command signal transmitted from the system control unit 120. The lighting device 140 shown in FIG. 6 is a general term for the first lighting device 32, the second lighting device 34, the third lighting device 36, and the fourth lighting device 38 shown in FIG. 3 and the like. That is, the lighting control unit 122 controls the lighting timing, the extinguishing timing, the amount of illumination light, and the like of the first lighting device 32 and the like.

The imaging control unit 124 controls the imaging device 30 based on the command signal transmitted from the system control unit 120. The shooting control unit 124 sets shooting conditions for the shooting device 30. The shooting control unit 124 controls the shooting timing and the like.

The image processing unit 126 acquires a photographed image of the drug group 16 generated by using the photographing apparatus 30. That is, the image processing unit 126 includes a photographed image acquisition unit that acquires a photographed image of the drug group 16. The image processing unit 126 performs lens distortion correction for correcting the distortion of the lens provided in the photographing device 30 on the photographed image of the drug group 16 acquired from the photographing device 30, and the image processing unit 16 of the drug group 16 to be image-processed. It may be a photographed image. The image processing unit 126 may acquire a photographed image of the drug group 16 after lens distortion correction.

The image processing unit 126 performs image processing on the captured image of the drug group 16. The image processing includes an inversion process of inverting the captured image of the drug group 16 with respect to the moving direction of the drug group 16, a trimming process of cutting out an image of the drug 17 from the captured image of the drug group 16, and a drug clipped from the captured image of the drug group 16. Enlargement processing for enlarging the image of the drug group 17, processing for reducing the captured image of the drug group 16, processing for reducing the inverted image of the captured image of the drug group 16, processing for enhancing the image of the drug 17 in the captured image of the drug group 16, and the like. Can include.

The image processing unit 126 detected the image of the drug 17 contained in the drug group 16 from the inverted image obtained by inverting the captured image of the drug group 16, cut out the inverted image of the drug 17 from the inverted image, and cut out from the inverted image. The inverted image of the drug 17 may be inverted to generate an image of the drug 17.

The image processing unit 126 appropriately stores various images generated by the image processing unit 126 in the memory 102. The image processing unit 126 displays various images on the display device 14 as appropriate.

The photographed image of the drug group 16 is shown in FIG. 9 using reference numeral 222. The inverted image obtained by inverting the photographed image of the drug group 16 is shown in FIG. 8 using reference numeral 220.

The drug information acquisition unit 128 acquires identification information for each drug 17 included in the drug group 16. When conducting a drug audit, the name of the drug 17 or the like described in the prescription may be applied to the identification information of the drug 17. When the carry-on drug is discriminated, the name of the drug 17 described in the drug notebook and the name of the drug 17 input by the operator using the input device 50 can be applied to the identification information of the drug 17. For example, the operator can visually recognize the name of the drug or the like printed on the drug 17 and recognize the name or the like of the drug.

The drug information acquisition unit 128 can use a bar code reader to read a bar code such as a GS1 code printed on the package of the drug 17, and acquire identification information of the drug 17 based on the read data of the bar code. The drug information acquisition unit 128 can analyze the image of the drug 17 and acquire the identification information of the drug 17 based on the analysis result.

As the identification information of the drug 17, a name, a code number, an appearance feature, and the like can be applied. The appearance of the drug may include color and shape. The shape of the drug may include the overall shape of the drug, the position of the marking, the shape of the marking, and the like. As the identification information of the drug 17, a plurality of information may be used in combination.

The drug identification processing unit 130 acquires an image of the drug 17 cut out from the captured image of the drug group 16. The drug identification processing unit 130 acquires a master image of the drug corresponding to the identification information of the drug 17 from the master image database 60.

The drug identification processing unit 130 collates the image of the drug 17 with the master image acquired from the master image database 60, and performs identification processing for each drug 17. The drug identification processing unit 130 causes the display device 14 to display the identification result.

The master image database 60 stores the identification information of the drug 17 in association with the image of the drug 17. The master image database 60 can search for a master image corresponding to the identification information of the drug 17 using the identification information of the drug 17 as a search parameter.

Although FIG. 6 illustrates an embodiment in which the master image database 60 is provided in the drug identification device 12, an external storage device may be applied to the master image database 60. The master image database 60 provided in the drug identification device 12 may be linked with an external master image database.

The display driver 132 transmits to the display device 14 a display signal corresponding to various images to be displayed on the display device 14 and a display signal corresponding to the identification result for each drug 17. The display device 14 displays various images and identification results for each drug 17.

The input interface 104 acquires the input data represented by the signal transmitted from the input device 50. The input interface 104 transmits the acquired input data to the system control unit 120. The system control unit 120 controls the drug identification device 12 based on the input data.

For example, when the operator inputs the name of the drug 17 using the keyboard which is the input device 50, the drug identification processing unit 130 can identify the drug 17 based on the input name of the drug 17.

The input / output port 106 acquires various data transmitted from the external device. For example, the input / output port 106 can acquire various information described in the prescription from server devices such as hospitals and pharmacies. The input / output port 106 may acquire a master image from an external master image database.

[Procedure for drug identification method]
FIG. 7 is a flowchart showing the procedure of the drug identification method according to the embodiment. In the drug information acquisition step S10, the drug information acquisition unit 128 shown in FIG. 6 acquires identification information for each drug 17 to be identified. After the drug information acquisition step S10, the process proceeds to the master image acquisition step S12.

In the master image acquisition step S12, the drug identification processing unit 130 acquires a master image corresponding to the identification information of the drug 17 from the master image database 60 based on the identification information of the drug 17 acquired in the drug information acquisition step S10. After the master image acquisition step S12, the process proceeds to the captured image acquisition step S14.

In the photographed image acquisition step S14, the photographing apparatus 30 photographs the drug group 16. The image processing unit 126 acquires a photographed image of the drug group 16 from the photographing apparatus 30. After the captured image acquisition step S14, the process proceeds to the image processing step S16.

In the image processing step S16, the image processing unit 126 performs various image processing on the captured image of the drug group 16 acquired in the captured image acquisition step S14. After the image processing step S16, the process proceeds to the captured image display step S18.

The various image processes include a reversal process of reversing the captured image of the drug group 16 with respect to the moving direction of the drug group 16. The various processes include a detection process for individually detecting an image for each drug 17 from the captured image of the drug group 16, a cutting process for cutting out the detected image of the drug 17 from the captured image of the drug group 16, and the cut out drug 17. Includes enlargement processing to enlarge the image of.

The various treatments may include an enhancement process that emphasizes the agent 17 detected from the captured image of the agent group 16. Examples of the emphasizing process include a process of superimposing a bounding box for each drug 17, and a process of emphasizing the edges and markings of the drug 17.

For the process of emphasizing the edges and markings of the drug 17, four types of captured images taken when illuminated by each of the first lighting device 32 and the like shown in FIG. 3 and the like can be applied. The captured image of the agent 17 differs in the direction of the shadow, the shape of the shadow, and the intensity of the shadow depending on the illumination direction. The image processing unit 126 can generate a feature image from four types of captured images and integrate the four types of feature images to generate an enhanced image in which the contour and engraving of the drug 17 are emphasized.

In the captured image display step S18, the image processing unit 126 outputs a display signal corresponding to the inverted image obtained by inverting the captured image of the drug group 16 with respect to the moving direction of the drug group 16 to the display device 14 via the display driver 132. .. An inverted image is displayed on the screen 15 of the display device 14.

In the captured image display step S18, the image processing unit 126 outputs a display signal corresponding to the enlarged image of the drug 17 included in the drug group 16 to the display device 14 via the display driver 132. The screen 15 of the display device 14 displays an enlarged image of the drug 17. After the captured image display step S18, the process proceeds to the identification target drug selection step S20.

In the identification target drug selection step S20, the drug information acquisition unit 128 acquires the selection information of the drug 17 to be collated with the master image. That is, when the operator selects any of the enlarged images of the drug 17, the drug information acquisition unit 128 acquires the selection information of the drug 17. After the identification target drug selection step S20, the process proceeds to the drug identification step S22.

In the drug identification step S22, the drug information acquisition unit 128 collates the selected drug 17 with the master image. The master image referred to here is a plurality of types of master images such as a master image of a drug having the same drug name, a master image of a drug having similar morphological characteristics, and a master image of a drug having a relationship between a generic drug and a generic drug. Can be included.

The matching process may be suitable for template matching. As an example of template matching, the method described in JP-A-2014-67342 can be mentioned. In the template matching, the degree of matching such as the degree of matching, the degree of similarity, and the correlation between the image of the drug 17 and the master image can be calculated. In the template matching, processing such as relative movement between the image of the drug 17 and the master image and enlargement or reduction of each can be appropriately performed. It should be noted that the relative movement may include a relative rotation.

The collation process may apply a learned learner. For learning, deep learning such as CNN (Convolutional Neural Network) can be applied. In the collation process, the captured image of the drug 17 acquired by applying the first lighting condition may be applied, or the captured image of the drug 17 acquired by applying the second lighting condition may be applied. Further, both may be used together in the collation process. When the second lighting condition is applied and the photographed images of the plurality of agents 17 are acquired, the collation process may apply one or more of the photographed images of the plurality of agents 17. After the drug identification step S22, the process proceeds to the candidate image display step S24.

In the candidate image display step S24, the drug information acquisition unit 128 outputs a display signal corresponding to the master image that has been collated with the drug 17 to the display device 14 via the display driver 132. On the screen 15 of the display device 14, the master image that has been collated with the drug 17 is displayed as a candidate image.

The master image subjected to the collation process with the drug 17 may be all the master images subjected to the collation process with the drug 17, or may be a part of the master images satisfying the conditions such as a certain degree of matching or more.

The drug identification device 12 may display the drug information for each master image on the screen 15 of the display device 14. The drug identification device 12 may display the degree of matching with the image of the drug 17 for each master image on the screen 15 of the display device 14. After the candidate image display step S24, the process proceeds to the confirmation information acquisition determination step S26.

In the confirmation information acquisition determination step S26, the drug identification processing unit 130 determines whether or not the confirmation button corresponding to the candidate image displayed on the screen 15 of the display device 14 has been operated. In the confirmation information acquisition determination step S26, when the drug identification processing unit 130 determines that the confirmation button has not been operated, a No determination is made. In the case of No determination, the process proceeds to the undetermined information storage step S28.

The drug identification processing unit 130 may determine that the confirmation button has not been operated when the period of waiting for the operation of the confirmation button has elapsed a predetermined period.

On the other hand, in the confirmation information acquisition determination step S26, when the drug identification processing unit 130 determines that the confirmation button has been operated, the determination is Yes. In the case of Yes determination, the process proceeds to the definite information storage step S30.

In the undetermined information storage step S28, the drug identification processing unit 130 stores undetermined information indicating that the master image corresponding to the drug 17 to be identified is not displayed. After the undetermined information storage step S28, the process proceeds to the drug identification end determination step S32.

Further, in the definite information storage step S30, the drug identification processing unit 130 stores definite information indicating that the master image corresponding to the information is confirmed in the drug 17. As the definite information, the degree of agreement calculated in the drug identification step S22 may be stored. After the definite information storage step S30, the process proceeds to the drug identification end determination step S32.

In the drug identification end determination step S32, the drug information acquisition unit 128 determines whether or not the identification process has been performed on all the drugs 17 included in one drug group 16 and whether the confirmed information or the unconfirmed information has been stored. do.

In the drug identification end determination step S32, the drug information acquisition unit 128 determines that the identification process is performed for all the drugs 17 included in one drug group 16 and that the confirmed information or the unconfirmed information is not stored. In that case, it is judged as No. In the case of No determination, the process proceeds to the identification target drug selection step S20, and each step from the identification target drug selection step S20 to the drug identification end determination step S32 is repeatedly carried out until a Yes determination is made in the drug identification end determination step S32.

On the other hand, in the drug identification end determination step S32, the drug information acquisition unit 128 performs identification processing on all the drugs 17 included in one drug group 16, and stores confirmed information or unconfirmed information. When making a judgment, it is a Yes judgment. In the case of Yes determination, the process proceeds to the drug group identification end determination S34.

In the drug group identification end determination S34, the drug information acquisition unit 128 determines whether or not the identification process has been performed for all the drug groups 16. In the drug group identification end determination S34, if the drug information acquisition unit 128 determines that the identification process has not been performed for all the drug groups 16, a No determination is made. In the case of No determination, the process proceeds to the captured image acquisition step S14, and each step from the captured image acquisition step S14 to the drug group identification end determination S34 is repeatedly carried out until a Yes determination is made in the drug group identification end determination S34.

On the other hand, in the drug group identification end determination S34, when the drug information acquisition unit 128 determines that the identification process has been performed for all the drug groups 16, the determination is Yes. In the case of Yes determination, the drug identification device 12 terminates the drug identification method. The drug identification method described in the embodiment is an example of an image processing method.

[Screen configuration example]
FIG. 8 is a screen configuration diagram showing a configuration example of a screen displayed on the display device. FIG. 9 is a schematic diagram of a photographed image of the drug group 16 displayed on the screen of the display device. The character string displayed on the drug shown in FIGS. 8 and 9 is an arbitrary character string. The letters here may include numbers, alphabets and symbols. The same applies to FIG.

The window 200 shown in FIG. 8 is displayed on the screen 15 of the display device 14 shown in FIG. The window 200 includes a first display area 202, a second display area 204, and a third display area 206. The window 200 includes various buttons 210. When multi-window display is applied, tabs are displayed for each window.

In the first display area 202, the inverted image 220 of the drug group 16 is displayed. The inverted image 220 is generated by inverting the captured image 222 of the drug group 16 shown in FIG. 9 with respect to the moving direction of the drug group 16.

As the inverted image 220, the inverted image of the through image of the photographing apparatus 30 shown in FIG. 2 may be applied, or the inverted image of the still image stored at an arbitrary timing may be applied. The inverted image 220 is updated when the drug group 16 is moved. The first display area 202 may display an assist display such as an arrow indicating the moving direction of the captured image 222 of the drug group 16. Note that FIG. 8 illustrates an embodiment in which the bounding box 225 is superimposed and displayed for each drug 17 constituting the drug group 16.

The second display area 204 is an enlarged image corresponding to the untreated drug 17 among all the drugs 17 detected from the captured image 222 of the drug group 16 shown in FIG. 9 and cut out from the captured image 222. A first magnified image 224 is displayed.

The same size image of the image of the drug 17 which has not been identified may be displayed in the second display area 204, and a reduced image obtained by reducing the captured image 222 of the drug group 16 may be displayed in the first display area 202. When displaying the reduced image of the captured image 222 of the drug group 16 in the first display area 202, the first enlarged image 224 may be displayed in the second display area 204.

That is, the resolution of the image displayed in the second display area 204 is set to be higher than the resolution of the captured image 222 of the drug group 16 displayed in the first display area 202. The same applies to the case where the inverted image of the agent 17 cut out from the inverted image 220 is displayed in the second display area 204.

The first enlarged image 224 and the same-magnification image of the drug 17 based on the captured image 222 of the drug group 16 described in the embodiment are examples of non-reduced images of the drug extracted from the first image. Further, the first enlarged image 224 and the same-magnification image of the drug 17 based on the inverted image 220 described in the embodiment are examples of non-reduced images of the inverted drug extracted from the second image.

On the other hand, in the second display area 204, the first enlarged image 224 or the like corresponding to the drug 17 selected as the target of the identification process is hidden. FIG. 8 illustrates an embodiment in which a plurality of first enlarged images 224 are displayed side by side in a row.

In the third display area 206, the second enlarged image 226 corresponding to the drug 17 to be recognized selected by the operator is displayed. Further, in the third display area 206, the master image 228 and the confirmation button 230 to be collated with the second enlarged image 226 corresponding to the drug 17 to be recognized are displayed.

The first display area 202 described in the embodiment is an example of the first area. The second display area 204 described in the embodiment is an example of the second area. The photographed image 222 of the drug group 16 according to the embodiment is an example of the first image. The inverted image 220 described in the embodiment is an example of the second image.

The process of cutting out the image of the drug 17 from the captured image of the drug group 16 according to the embodiment is an example of the process of extracting the image of the drug detected from the first image from the first image.

[Transformation example of screen configuration example]
FIG. 10 is a screen configuration diagram showing a screen configuration example according to a modified example. In the first display area 202A of the window 200A shown in FIG. 10, the inverted image 220 shown in FIG. 8 and the captured image 222 of the drug group 16 shown in FIG. 9 are displayed side by side.

The first display area 202A of the window 200A shown in FIG. 10 may selectively switch the display and non-display of the captured image 222 of the drug group 16. For example, when the operator performs an operation indicating that the captured image 222 of the drug group 16 is displayed in the first display area 202A, the captured image 222 of the drug group 16 may be displayed in the first display area 202A.

The photographed image 222 of the drug group 16 and the inverted image 220 may have different sizes. The captured image 222 of the drug group 16 may have a ratio of the vertical direction and the horizontal direction to the inverted image 220 to be half or less. The photographed image 222 of the drug group 16 may be a still image or a moving image such as a through image.

[Action effect]
According to the drug identification system 10 and the drug identification method according to the embodiment, the following effects can be obtained.

[1]
The drug group 16 is photographed from the lower side of the drug placement surface 24 on which the drug group 16 is placed, and the photographed image of the drug group 16 is inverted with respect to the moving direction of the drug group 16 to generate an inverted image 220, which is a display device. The inverted image 220 is displayed on the screen 15 of 14. As a result, when the drug group 16 is moved to align the position of the drug group 16, the moving direction of the drug group 16 and the moving direction of the inverted image 220 coincide with each other.

[2]
The drug 17 contained in the drug group 16 is detected from the photographed image 222 of the drug group 16, and the image of each drug 17 is cut out from the photographed image 222 and enlarged to generate a first enlarged image 224. The first enlarged image 224 is displayed on the second display area 204 of the screen 15 of the display device 14. Thereby, the operator can select the agent 17 to be identified based on the first enlarged image 224 displayed in the second display area 204. Further, since the image of each drug 17 is enlarged, the visibility of the image of each drug 17 can be improved.

In the case where the reduced image of the captured image 222 of the drug group 16 is displayed in the first display area 202 and the same size image obtained by cutting out the image of each drug 17 from the captured image 222 is displayed in the second display area 204, each drug 17 is also displayed. The visibility of the image can be improved.

[3]
The inverted image of the drug 17 is detected from the inverted image 220, the inverted image of the agent 17 is cut out from the inverted image 220, the inverted image of the agent 17 is inverted and enlarged, and the first enlarged image 224 of the agent 17 is generated. Thereby, the operator can select the agent 17 to be identified based on the first enlarged image 224 displayed in the second display area 204. Further, since the image of each drug 17 is enlarged, the visibility of the image of each drug 17 can be improved.

Even when the reduced image of the inverted image 220 is displayed in the first display area 202 and the first enlarged image 224 of the drug 17 or the same size image of the drug 17 is displayed in the second display area 204, the image of each drug 17 is visually recognized. The sex can be improved.

[4]
The identification process of the drug 17 selected from the plurality of first enlarged images 224 displayed on the screen 15 of the display device 14 is performed. Selective identification processing of the drug 17 based on the operation of the operator or the like can be performed.

[5]
As a result of the identification process of the drug 17, a master image collated with the drug 17 is displayed. Thereby, the master image corresponding to the identification information of the drug 17 can be selected from the master image collated with the drug 17.

[6]
In the first enlarged image 224 for displaying the inverted image 220 of the screen 15 of the display device 14, the captured image 222 of the drug group 16 is displayed side by side with the inverted image 220. As a result, the drug 17 contained in the drug group 16 is displayed in the correct visible direction.

[Modified example of drug identification system]
[Example of application to image processing equipment]
FIG. 11 is an overall configuration diagram of a drug identification system according to an application example to an image processing apparatus. The drug audit system 300 shown in FIG. 11 includes a drug identification device 302, an image processing device 304, a display device 306, a keyboard 308, and a mouse 310. The keyboard 308 and the mouse 310 correspond to the input device 50 shown in FIG. Reference numeral 307 indicates the screen of the display device 306.

The drug identification device 302 has the functions of the photographing device 30, the lighting device 140, and the drug identification processing unit 130 shown in FIG. The image processing device 304 has the function of the image processing unit 126 shown in FIG. The image processing device 304 may have the function of the drug identification processing unit 130.

That is, the drug identification device 12 shown in FIG. 2 corresponds to the components corresponding to the photographing device 30 and the lighting device 140, mainly for acquiring the photographed image of the drug group 16, and the image processing unit 126 and the drug identification processing unit 130. , Mainly can be divided into components that perform signal processing.

As the photographing device 30, a portable photographing device such as a smartphone may be applied. For example, the drug identification device 12 may include a support member that supports the portable imaging device and a communication interface that performs data communication with the portable imaging device.

[Application example to network system]
FIG. 12 is an overall configuration diagram of a drug recognition system according to an application example of the network system. The drug identification system 400 shown in the figure includes a drug identification device 402, a display device 404, a server device 406, and a master image database 408. Reference numeral 405 indicates the screen of the display device 404. The drug identification device 402 is communicably connected to the server device 406 and the master image database 408 via the network 410.

The server device 406 may have the function of the image processing unit 126 shown in FIG. The server device 406 may include the function of the drug identification processing unit 130. The server device 406 may apply cloud computing.

As the network 410, a small-scale network applied to the inside of a medical institution may be applied, or a large-scale network such as the Internet may be applied. The network 410 may be configured to include a plurality of networks.

[Hardware configuration of each processing unit and control unit]
Various processors can be applied to the hardware of the processing unit that performs various processes shown in FIG. The processing unit may be called a processing unit. Various processors include a CPU (Central Processing Unit), a PLD (Programmable Logic Device), an ASIC (Application Specific Integrated Circuit), and the like.

The CPU is a general-purpose processor that executes a program and functions as various processing units. The PLD is a processor whose circuit configuration can be changed after manufacturing. An example of PLD is FPGA (Field Programmable Gate Array). An ASIC is a dedicated electrical circuit having a circuit configuration specifically designed to perform a particular process.

One processing unit may be composed of one of these various processors, or may be composed of two or more processors of the same type or different types. For example, one processing unit may be configured by using a plurality of FPGAs and the like. One processing unit may be configured by combining one or more FPGAs and one or more CPUs.

Further, a plurality of processing units may be configured by using one processor. As an example of configuring a plurality of processing units using one processor, there is a form in which one processor is configured by combining one or more CPUs and software, and one processor functions as a plurality of processing units. Such a form is represented by a computer such as a client terminal device and a server device.

As another configuration example. An example is a mode in which a processor that realizes the functions of the entire system including a plurality of processing units by using one IC chip is used. Such a form is typified by a system on chip and the like. IC is an abbreviation for Integrated Circuit. Further, the system on chip may be described as SoC by using the abbreviation of System On Chip.

As described above, the various processing units are configured by using one or more of the above-mentioned various processors as a hardware-like structure. Further, the hardware-like structure of various processors is, more specifically, an electric circuit (circuitry) in which circuit elements such as semiconductor elements are combined.

[Example of application to programs]
A program corresponding to the drug identification device 12 shown in FIG. 2, the image processing unit 126 shown in FIG. 6, and the drug audit method shown in FIG. 7 may be configured. That is, it is possible to configure a program for realizing the functions of various processing units shown in FIG. 6 and each process shown in FIG. 7 on a computer.

In the embodiment of the present invention described above, the constituent requirements can be appropriately changed, added, or deleted without departing from the spirit of the present invention. The present invention is not limited to the embodiments described above, and many modifications can be made by a person having ordinary knowledge in the art within the technical idea of the present invention. Further, the embodiments, modifications and applications may be combined as appropriate.

1 Schematic diagram of the drug viewed from the surface side 2 Display image of the drug 3 Schematic diagram of the drug group viewed from the surface side 5A Drug 5B Drug 6 Imaging area 10 Drug identification system 12 Drug identification device 14 Display device 16 Drug group 17 Drug 18-pack bag 20 Housing 22 Mounting table 24 Drug mounting surface 26 Cover 28 Imaging surface 30 Imaging device 31 Optical axis 32 First lighting device 34 Second lighting device 36 Third lighting device 38 Fourth lighting device 40 Drug group 42 Container 44 Bottom 50 Input device 60 Master image database 100 Processor 102 Memory 104 Input interface 106 Input / output port 120 System control unit 122 Lighting control unit 124 Imaging control unit 126 Image processing unit 128 Drug information acquisition unit 130 Drug identification processing unit 132 Display Driver 140 Lighting device 200 Window 200A Window 202 First display area 202A First display area 204 Second display area 206 Third display area 210 Button 220 Inverted image 222 Captured image 224 First enlarged image 225 Bounding box 226 Second enlarged image 228 Master image 230 Confirm button 300 Drug audit system 302 Drug identification device 304 Image processing device 306 Display device 307 Screen 308 Keyboard 310 Mouse 400 Drug identification system 402 Drug identification device 404 Display device 405 Screen 406 Server device 408 Master image database 410 From network S10 S34 Each step of the drug identification processing method

Claims (18)

An image processing device with one or more processors
The processor
The second surface of the support is placed on the first surface of the support by using an imaging device arranged at a position on the side of the second surface opposite to the first surface of the support. The first image obtained by photographing the drug from the side of
A second image obtained by reversing the first image with respect to the drug moving direction in which the drug is moved when adjusting the position of the drug with respect to the photographing range of the photographing device is generated.
A display signal for displaying the second image is generated in the first area of the screen displayed on the display device.
An image processing device that outputs the display signal. The image processing device according to claim 1, wherein the processor generates a display signal for displaying the first image and the second image in the first region. The processor
The image of the drug contained in the first image is detected,
The image of the drug detected from the first image is extracted from the first image,
The image processing apparatus according to claim 1 or 2, which generates a display signal for displaying an image of the extracted drug in a second area of the screen. The processor
Enlarge the image of the drug extracted from the first image and
The image processing apparatus according to claim 3, wherein a display signal for displaying the enlarged image of the drug in the second region is generated. The processor
The first image is reduced and
3. The third aspect of the present invention is to generate a display signal for displaying the reduced first image in the first region and displaying a non-reduced image of the drug extracted from the first image in the second region. The image processing device described. The processor
The image of the drug contained in the second image is detected,
The image of the drug detected from the second image is extracted from the second image, and the image of the drug is inverted in the direction of movement of the drug.
The image processing apparatus according to claim 1 or 2, wherein a display signal for displaying an image of the drug inverted with respect to the drug moving direction is displayed in a second region of the screen. The processor
The image of the drug inverted with respect to the drug movement direction is enlarged.
The image processing apparatus according to claim 6, wherein a display signal for displaying the enlarged image of the drug in the second region is generated. The processor
Reduce the second image and
A claim to generate a display signal for displaying a reduced image of a drug in the first region and displaying a non-reduced image of the inverted drug extracted from the second image in the second region. Item 6. The image processing apparatus according to item 6. The processor
The image processing apparatus according to any one of claims 3 to 7, wherein a display signal is generated in which the resolution of the image displayed in the second region exceeds the resolution of the image displayed in the first region. The drug to be mounted on the first surface of the support with one or more processors was obtained using an imaging device located at a position on the side of the second surface opposite the first surface of the support. A drug identification device that identifies the drug from the photographed image of the drug.
The processor
Using the imaging device, the first image obtained by photographing the drug from the side of the second surface of the support base was acquired.
A second image obtained by reversing the first image with respect to the drug moving direction in which the drug is moved when adjusting the position of the drug with respect to the photographing range of the photographing device is generated.
A display signal for displaying the second image is generated in the first area of the screen displayed on the display device.
A drug identification device that outputs the display signal. The processor
The image of the drug contained in the first image is detected,
The image of the drug detected from the first image is extracted from the first image,
The drug identification device according to claim 10, wherein the drug corresponding to the image of the extracted drug is identified based on the image of the extracted drug. The processor
The image of the drug contained in the second image is detected,
The image of the drug detected from the second image is extracted from the second image, and the image of the drug extracted from the second image is inverted with respect to the drug movement direction.
The drug identification device according to claim 11, wherein the drug corresponding to the image of the drug extracted from the second image is identified based on the image of the drug inverted with respect to the drug movement direction. The drug identification device according to claim 11 or 12, wherein the processor generates a display signal for displaying information on a candidate drug on the screen when an image of the drug to be identified is selected. A plurality of lighting devices for irradiating the drug placed on the first surface of the support base with illumination light from different directions are provided.
The processor
Among the plurality of lighting devices, the first lighting condition for irradiating the drug with the illumination light by using two or more of the lighting devices is applied, the first image is acquired by using the photographing device, and the first image is acquired. A second lighting condition for irradiating the drug with illumination light using a smaller number of the lighting devices than the first lighting condition is applied, and the first image is acquired using the photographing device.
13. The drug identification device according to any one of the above. The drug identification device according to claim 14, wherein the processor applies the second lighting condition to acquire a plurality of the first images. The plurality of lighting devices are the first lighting device, the second lighting device, and the third, which are arranged so as to be displaced by 90 degrees with respect to the optical axis of the photographing device in a plane orthogonal to the optical axis of the photographing device. Equipped with a lighting device and a fourth lighting device
The processor uses the first lighting device, the second lighting device, the third lighting device, and the fourth lighting device as the first lighting condition to irradiate the drug with illumination light to acquire the first image. Further, as the second lighting condition, the chemicals are irradiated with illumination light from each of the first lighting device, the second lighting device, the third lighting device, and the fourth lighting device, and the four first images are displayed. The drug identification device according to claim 14 or 15 to be acquired. The drug identification device according to claim 15 or 16, wherein the processor uses at least one of a plurality of the first images obtained by applying the second lighting condition to identify the drug. The second surface of the support is placed on the first surface of the support by using an imaging device arranged at a position on the side of the second surface opposite to the first surface of the support. The first image obtained by photographing the drug from the side of
A second image obtained by reversing the first image with respect to the drug moving direction in which the drug is moved when adjusting the position of the drug with respect to the photographing range of the photographing device is generated.
A display signal for displaying the second image is generated in the first area of the screen displayed on the display device.
An image processing method that outputs the display signal.

Images