JP2015024899A - Medicine picking support system using display - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a medicine picking support system capable of informing an operator of detailed medicine-related information of brand, efficacy and the number of stock, etc. of a medicine for which an operator performs the picking, previously or simultaneously.SOLUTION: A medicine picking support system using a display includes: recording means for recording data regarding respective storage parts in a medicine storage shelf and data regarding medicines respectively stored in respective storage parts; distance image obtaining means for obtaining a distance image of a hand of an operator existing on the front side of the storage shelf; medicine-related information obtaining means for obtaining information related to a medicine stored in the storage part to which the hand of the operator is opposed or extended, based on the distance image and three-dimensional position data of the respective storage parts; and display control means for displaying the obtained medicine-related information on the display located in the vicinity of the storage shelf.

Description

  The present invention relates to a system for supporting drug picking in a dispensing pharmacy or the like, and more particularly to a drug picking support system using a display.

  2. Description of the Related Art Conventionally, in a dispensing pharmacy or the like, a drug picking support system for inspecting whether drug picking has been correctly performed according to a prescription has been proposed. For example, in Patent Document 1, after a pharmacist picks a medicine, an inspector takes out a PTP sheet containing the picked medicine, and captures and recognizes a printing surface on which the barcode of the PTP sheet is described. A system has been proposed in which the name or ID of a drug on the PTP sheet is acquired, and whether or not the picked drug matches the prescription content to prevent dispensing errors.

JP 2004-167158 A

  However, in the system for preventing dispensing mistakes proposed by the above-mentioned Patent Document 1, after the pharmacist picks the medicine, the inspector picks up a plurality of PTP sheets picked up one by one and displays the barcode or the like. Since the image is recognized and the image is recognized, waiting time until the patient receives the dispensed medicine is required after the picking operation by the pharmacist, and extra time and time such as reading of the printed surface of the PTP sheet and image recognition are required. However, there is a problem that a lot of cost is required for providing a reading device for a printing surface of a PTP sheet and an image recognition processing device for obtaining a medicine name from the read image.

  Furthermore, conventionally, when a pharmacist tries to pick a medicine from a storage unit (storage box) in a storage shelf, the name of the drug or the name of the drug is determined by looking at the characters on the printed surface of the PTP sheet taken out from each storage unit. Since there was no choice but to confirm the contents etc., the pharmacist would like to know in advance (or at the same time as picking) detailed related information such as the efficacy, side effects, corresponding generic products, or stock quantity of the medicine in the containment section to be handed out. There was a problem that it was not easy to know in parallel).

  The present invention has been made paying attention to such problems of the prior art, and the brand, efficacy, side effects, pharmaceutical company name, and the name of the pharmaceutical company that the operator is about to pick or is currently picking, To provide a drug picking support system capable of easily knowing in advance or concurrently, corresponding generic products or drug-related information such as the number of stocks (identification information such as drug brands and attribute information such as efficacy) With the goal.

  An example of a drug picking support system using the display according to the present invention for solving the above-described problems will be described with reference to the conceptual block diagram of FIG. 1A (a). Alternatively, a storage shelf 100 (including a combination of a plurality of storage shelves) in which storage units that are stored by brand are arranged in the vertical and horizontal directions, and data on each storage unit in the storage shelf 100 ( A storage unit that records at least three-dimensional position data of each storage unit) and data related to a drug stored in each storage unit (including at least drug-related information such as drug efficacy or inventory number) in association with each other Drug-related information recording unit 101, distance image acquisition unit 102 that acquires at least a distance image of an operator's hand in front of the storage shelf, and the distance image Based on the distance image from the acquisition unit 102 and the three-dimensional position data of each storage unit recorded in the storage unit-drug-related information recording unit 101, “corresponding to the three-dimensional position of the operator's hand, Drug-related information acquisition unit 103 that acquires information related to a drug stored in a storage unit facing or extending a person's hand, and a display 105 (portable or body-mounted) located in the vicinity of the storage shelf 100 And a display control unit 104 that displays the medicine-related information acquired by the medicine-related information acquisition unit 103 on the display 105.

  In addition, another example of the drug picking support system using the display according to the present invention will be described with reference to the conceptual block diagram of FIG. 1A (b). A plurality of types or brands of drugs are accommodated for each type or brand. A storage shelf 100 in which the storage units are arranged in the vertical and horizontal directions (including a combination of a plurality of storage shelves), and data on each storage unit in the storage shelf 100 (at least 3 of each storage unit) Storage unit-to-drug identification data recording unit 111 that records the identification data of each drug stored in each storage unit in association with each other, the identification data of each drug, its efficacy, or the number of stocks, etc. The medicine-related information recording unit 112 that records the medicine-related information in association with each other and the distance image of the hand of the worker who is at least in front of the storage shelf 100 is acquired. Based on the distance image acquisition unit 113, the distance image from the distance image acquisition unit 113, and the three-dimensional position data of each storage unit recorded in the storage unit vs. drug identification data recording unit 111. The storage unit corresponding to the three-dimensional position of the hand, that is, the storage unit facing or extending the operator's hand, or the storage unit specifying unit 114 specifying the medicine stored therein, and the storage unit specifying unit 114 Drug-related information for acquiring, from the drug-related information recording unit 112, information related to the drug stored in the storage unit facing or extending the operator's hand from the specified storage unit or drug data An acquisition unit 115, a display 117 (may be a portable or body-mounted display) located in the vicinity of the storage shelf 100, and a drug acquired by the drug-related information acquisition unit 115 A display control unit 116 for displaying the communication information on the display 117, those having a.

  In the example shown in FIG. 1A (a) of the present invention, the medicine related information acquisition unit 103 includes a distance image from the distance image acquisition unit 102 and each storage unit recorded in the storage unit / drug related information recording unit 101. Based on the three-dimensional position data, the related information (identification information and the information stored in the container corresponding to the three-dimensional position of the worker's hand, that is, the container in which the worker's hand is facing or extending) is stored. Attribute information) is acquired, and the display control unit 104 displays the acquired drug-related information on the storage shelf 100 or on the display 105 arranged in the vicinity thereof.

  Further, in the example shown in FIG. 1A (b) of the present invention, the storage unit or the like specifying unit 114 has each storage unit recorded in the distance image from the distance image acquisition unit 113 and the storage unit versus medicine identification data recording unit 111. Based on the three-dimensional position data, the “accommodating portion corresponding to the three-dimensional position of the worker's hand, that is, the accommodating portion where the operator's hand is facing or extending” or the medicine accommodated therein is specified, and the medicine A storage in which the operator's hand is facing or extending from the medicine-related information recording unit 112 based on the data of the storage part or medicine specified by the specifying part 114 such as the storage part. The related information (identification information and attribute information) of the medicine stored in the section is acquired, and the display control section 116 displays the acquired medicine related information on the display 117 arranged in the storage shelf 100 or in the vicinity thereof. And so as to.

  Therefore, according to the inventions of the present application (see FIG. 1A (a) or (b)), the worker can, for example, contain the intended medicine during the medicine picking operation. Just trying to reach or reach the person, such as the brand, efficacy, side effects, name of the pharmaceutical company, the corresponding generic product, or the number of stocks in the containment that you are about to pick or are currently picking Detailed drug-related information (identification information such as drug brand and attribute information such as efficacy) can be visually observed on the screen. Therefore, according to each of the inventions of the present application, the operator can view the detailed contents of the medicine in the container immediately before taking out the medicine from the container (or in parallel with the medicine removal operation from the container). Since it can be confirmed, the drug picking operation can be performed more easily and efficiently, and mistakes in the picking operation can be further reduced.

(A) And (b) is a conceptual block diagram for demonstrating an example of the chemical | medical agent picking assistance system using the display which concerns on this invention, respectively. It is the schematic which shows the structure of the chemical | medical agent picking assistance system which concerns on Embodiment 1 of this invention. FIG. 5 is a schematic diagram for explaining the operation of the first embodiment. FIG. 5 is a schematic diagram for explaining the operation of the first embodiment. FIG. 5 is a schematic diagram for explaining the operation of the first embodiment. FIG. 5 is a schematic diagram for explaining the operation of the first embodiment. It is the schematic which shows the structure of the chemical | medical agent picking assistance system which concerns on Embodiment 2 of this invention. It is the schematic for demonstrating the operation | movement of this Embodiment 2. FIG.

[Embodiment 1]
Embodiment 1 of the present invention will be described below with reference to the drawings. FIG. 1B is a schematic diagram illustrating a configuration of a drug picking support system according to Embodiment 1 of the present invention. In FIG. 1B, 1 is a storage shelf in which each storage part 2 that stores each drug for each type or brand is arranged in the vertical and horizontal directions, and 3 is for mounting a drug picked by a pharmacist 10 based on a prescription. A mounting table 4 is a work table for placing the mounting table 3 described above, 5 is a display disposed above the storage shelf 1, 6 is a mounting table 3 and a medicine placed therein A visible light camera 7 that acquires RGB images, 7 is a distance that is disposed in the vicinity (for example, above) of the storage shelf 1 and that acquires a distance image of the hand 10a of the pharmacist 10 and its surroundings (which may include the placement basket 3). In the first embodiment, the visible light camera 6 and the distance image sensor 7 are actually arranged in the depth direction of FIG. 1B, but in FIG. 1B, they are shown side by side for convenience of illustration. ing).

  In the first embodiment, the visible light camera 6 and the distance image sensor 7 of FIG. 1B are provided using “Kinect for Windows” (registered trademark; hereinafter referred to as “Kinect”) manufactured by Microsoft Corporation. Yes. Kinect includes an RGB camera that acquires a surrounding color image, an infrared projector that irradiates a predetermined infrared dot pattern to the periphery, and an infrared camera that captures the reflected light of the irradiated infrared, and the infrared camera It incorporates a processor that performs processing to estimate and track the skeletal part of the body based on comparison with a vast number of sample images based on data (distance images). Among these, the RGB camera constitutes the visible light camera 6 in FIG. 1B, the infrared projector and the infrared camera constitute the distance image sensor 7 in FIG. 1B, and the processor constitutes a part of the control unit 11 in FIG. 1B. . The distance image sensor 7 in FIG. 1B obtains a distance image including depth information (depth information) for each pixel for each frame by irradiating infrared rays in a predetermined pattern and capturing the reflected light with an infrared camera. It is.

  Next, in FIG. 1B, 11 controls the display 5, controls the visible light camera 6 and receives and records the image data acquired by it, controls the distance image sensor 7 and acquires it. A control unit (comprising a personal computer or the like) that receives and records the distance image data. Reference numeral 12 denotes an eaves image storage unit that sequentially records and stores the images of the above-described installation cage 3 acquired by the visible light camera 6 at predetermined time intervals, for example, in association with the acquisition date and time, for example, and 13 denotes the distance image sensor 7. For example, the hand position data storage unit 14 that sequentially records and stores the three-dimensional position data of the hand of the pharmacist 10 acquired every predetermined time in association with the acquisition date and the like, for example, 14 is the storage shelf 1 created using the Kinect. 3D position range of each storage unit 2 (x coordinate ○ to ●, y coordinate Δ to ▲, z coordinate □ to ■ are arranged for each storage unit from coordinates based on distance image) and storage in each storage unit 2 Storage unit vs. drug database in which identification data (including brands / names, etc.) of recorded drugs are recorded in association with each other, 15 is the identification data (including brands / names, etc.) of each drug and its efficacy, side effects, and alternatives Goods Generic products), or a drug-related database that recorded in association with each other related information (attribute information), such as inventory.

  Next, the operation of the first embodiment will be described. First, preliminary work will be described. As a preliminary work, Kinect (including the visible light camera 6 and the distance image sensor 7) is positioned above the storage shelf 1 so that the visible light camera 6 can image the mounting rod 3 and the distance image sensor 7. Arranges the distance image of the pharmacist 10 (and the storage shelf 1) performing the picking work at a position where the distance image can be acquired. Next, by using the distance image sensor 7 of Kinect, the respective three-dimensional position ranges (x coordinates ◯ to ●, y coordinates △ to ▲, z coordinates □ to □) of the storage units 2 in the storage shelf 1 are determined. Obtained in each storage unit), and the acquired three-dimensional position range (each three-dimensional position coordinate data) for each storage unit 2 is used to identify the identification data (name and name) of the medicine stored in each storage unit 2 The storage unit vs. drug database 14 is created in association with the brand. In addition, a drug-related database 15 in which related information (attribute information) such as the efficacy, side effect, substitute product (generic product), or inventory quantity of each drug is recorded in association with the identification data of each drug is prepared in advance.

  Next, an operation of detecting and specifying the medicine taken out from each storage unit 2 by the pharmacist 10 when the pharmacist 10 is performing the picking operation will be described with reference to FIGS. 3 and 4, 21, 22, and 23 are PTP sheets (containing a medicine) placed on the table 3 by the pharmacist 10.

  First, the Kinect visible light camera 6 acquires the RGB image of the table 3 described above, for example, every predetermined time. The control unit 11 receives the image data from the visible light camera 6 every predetermined time, and sequentially records / accumulates the image storage unit 12 in association with the acquisition date and time. In addition, the Kinect acquires a distance image obtained by imaging the reflected infrared light irradiated to the object with an infrared camera by the mounted distance image sensor 7, and is further driven by a built-in processor (or by this). Software), the three-dimensional position data of the hand of the pharmacist 10 is acquired, for example, every predetermined time from the acquired distance image. The control unit 11 in FIG. 1A receives the three-dimensional position data of the hand of the pharmacist 10 from the Kinect every predetermined time, and sequentially records and stores the data in the hand position data storage unit 13 in association with the acquisition date and time.

  Further, the control unit 11, for example, based on a distance image transmitted from the distance image sensor 7 every predetermined time (three-dimensional position data of the hand of the pharmacist 10 transmitted every predetermined time from the Kinect), for example, the pharmacist 10 When the three-dimensional distance between the hand 10a and the storage unit 2a (see FIG. 2) approaches a predetermined distance, the pharmacist 10 determines that the hand 10a is opposed to or extended from the storage unit 2.

  Further, the control unit 11 compares the RGB image transmitted from the visible light camera 6 with the immediately preceding RGB image at any time, and compares the image in the previous table 3 (the object placed on the previous table 3). It is determined whether or not the number or area of the item (medicine) placed on the table 3 has increased or decreased. Then, for example, the control unit 11 compares the previously acquired image (see FIG. 3A) with the currently acquired image (see FIG. 3B), and is placed on the table 3 described above, for example. If it is determined that the total area of the sheet (PTP sheet) has “increased”, it extends to the storage portion 2a in the storage shelf 1 immediately before the current image (see FIG. 3B) is acquired. The three-dimensional position data of the hand of the pharmacist 10 (see FIG. 2) is acquired from the hand position data storage unit 13. Then, the control unit 11 refers to the storage unit drug database 14 from the acquired three-dimensional position data, and stores the data (identification) of the storage unit 2 corresponding to the three-dimensional position data and the drug stored therein. Data).

  As described above, the control unit 11 causes the pharmacist 10 to take out the drug from the storage unit 2a in the storage shelf 1 and place it on the mounting basket 3, and to remove the drug from the storage unit 2a and store it in the mounting basket 3 The name and brand name of the medicine placed in (the PTP sheet 22 present in the image of FIG. 3B but not in the image of FIG. 3A) is specified. In addition, when a new image is acquired, the control unit 11 compares the previously acquired image (see FIG. 3B) with the newly acquired image (see FIG. 3C) thereafter. Then, when it is determined that, for example, the number or area of the sheets (PTP sheets) placed on the table 3 is increased, the same operation as described above is repeated.

  As shown in the operation example of FIG. 3 described above, in the first embodiment, when the image of the mounting rod 3 changes, for example, when the total number or area of the objects (medicine) on the mounting rod 3 increases. The control unit 11 reads the corresponding storage unit 2 and the medicine as its contents from the three-dimensional position of the hand of the pharmacist 10 acquired immediately before, “the pharmacist 10 takes out the placement unit 2a It is specified as “the drug placed in 3”. Therefore, according to the first embodiment, the pharmacist 10 removes the medicine taken out from the storage unit 2a and puts it in the placement basket 3 only in parallel with the currently available Kinect, and simultaneously with the picking operation. It becomes possible to specify. Therefore, according to the first embodiment, the picking medicine can be specified without increasing the waiting time of the patient and at a very low cost. As a result, the prevention of the dispensing mistake and the cause investigation of the dispensing mistake can be performed. Etc. can be realized efficiently.

  Next, for example, the control unit 11 compares the previously acquired image (see FIG. 4B) with the currently acquired image (see FIG. 4C), and is placed on the table 3 described above. For example, when it is determined that the number or area of the objects (PTP sheets) is “decreased”, any storage unit in the storage shelf 1 immediately after the current image (see FIG. 4C) is acquired. The three-dimensional position data of the hand of the pharmacist 10 extending to 2 is acquired from the hand position data storage unit 13. Then, the control unit 11 refers to the storage unit drug database 14 from the acquired three-dimensional position data, and stores the storage unit 2 corresponding to the three-dimensional position data and the data (brands) stored therein. Etc.). As described above, the control unit 11 causes the pharmacist 10 to pick up one or a plurality of drugs from the loading basket 3 (for example, to be aware of an error in the picking that has already been performed) and transfer it to the corresponding storage unit 2 in the storage shelf 1. The name and brand related to the returned medicine and the medicine returned to the container 2 (the PTP sheet 22 which was present in the image of FIG. 4B but is no longer the image of FIG. 4C) are specified. .

  As shown in the operation example of FIG. 4 described above, in the first embodiment, when the total number or area of the object (medicine) on the placement basket 3 decreases, the control unit 11 is acquired immediately after that. From the three-dimensional position of the hand of the pharmacist 10, the corresponding storage unit 2 and the drug as its contents are picked up and stored from the mounting cage 3 (for example, when the pharmacist 10 notices an error in picking already performed). It is specified as “the drug returned to part 2”. Therefore, according to the first embodiment, “the pharmacist 10 (for example, notices an error in the picking that has already been performed) picks up the drug from the loading basket 3 and returns it to the storage unit 2, and stores it in that way. It is also possible to specify the “medicine returned to the department”, and as a result, it becomes possible to perform a drug picking inspection (dispensing error inspection), a cause investigation of the dispensing error, and the like with higher accuracy.

  Next, the operation of the portion of the first embodiment according to the present invention will be described with reference to FIG. As described above, the control unit 11 is based on the distance image (three-dimensional position data of the hand of the pharmacist 10 transmitted every predetermined time from the Kinect) transmitted from the distance image sensor 7 every predetermined time. For example, when the distance between the hand 10a of the pharmacist 10 and one of the storage units 2a is closer than a predetermined distance, it is determined that the pharmacist 10 has extended the hand 10a to the storage unit 2a. And the control part 11 specifies the accommodating part 2a corresponding to the three-dimensional position of the said hand 10a with reference to the accommodating part versus chemical | medical agent database 14 from the three-dimensional position of the hand 10a of the pharmacist 10 at the time of the said determination, Furthermore, the medicine corresponding to the container 2a is specified. Then, the control unit 11 refers to the drug related database 15, acquires related information (attribute information) of the specified drug, and displays the related information on the display 5. FIG. 5 shows an example of the screen of the display 5 displayed in this way.

  For example, when the hand 10a of the pharmacist 10 extends close to the storage unit 2-5 (for example, the second storage unit from the left and the fifth storage unit from the top in the storage rack 1 of FIG. 2) (the contents are still from the storage unit 2-5) The control unit 11 identifies the corresponding storage unit 2-5 from the three-dimensional position of the hand 10a, and refers to the drug-related database 15, so that the storage unit 2- The related information of the medicine accommodated in 5 is acquired. Then, this is transmitted to the display 5 to display, for example, “accommodating section 2-5 artist 10 mg blood pressure sclerosing agent generic is in stock in carvedilol tablet accommodating section 2-1.” As a result, the pharmacist 10 looks at the relevant information (identification information such as brands and attribute information such as efficacy) of the contents (medicine) in the container 2-5 that he is about to take out. Makes it easier and more efficient to make sure that the drug you are about to take out (or are currently taking out) is compatible with the contents of the prescription. Can be reduced.

[Embodiment 2]
Next, the configuration and operation of the second embodiment of the present invention will be described with reference to FIGS. 6 and 7, parts common to those in FIGS. 1B and 2 are denoted by the same reference numerals, and description thereof is omitted. In FIG. 6, reference numeral 24 indicates identification data such as ID or name of each pharmacist when each of a plurality of pharmacists performs picking work at the same time, and each mounting rod (the color or shape, etc.) used by each pharmacist. The container-to-worker recording unit records identification data that can be distinguished from each other in association with each other. FIG. 7 shows that two pharmacists 10 and 20 perform drug picking in parallel while using a plurality of mounting rods 3a and 3b that can be distinguished from each other by characteristics such as color or shape. Shows the case.

  In the second embodiment, the control unit 11 (actually, the control unit 11 and the processor built in the distance image sensor 7) is configured to include a part of Kinect. Kinect (Kinct for Windows SDK (registered trademark) provided by Microsoft Corporation in the United States) is a distance image distinguished for each of a plurality of users, that is, a distance associated with each user ID of the plurality of users. It has a function of simultaneously obtaining an image (a distance image labeled with each user ID. A distance image in which each user has an index value for distinguishing each user). In the second embodiment, such a control unit 11 (actually, the control unit 11 and the processor incorporated in the distance image sensor 7) is the infrared camera included in Kinect (part of the distance image sensor 7). The hand 10a, 20a of each of the plurality of pharmacists 10, 20 and the surrounding distance image are acquired in association with the ID of each pharmacist 10, 20 based on the image data such as the hands of each pharmacist from. And the control part 11 is each accommodating part 2a from which the hand 10a, 20a of each pharmacist 10,20 extended or it entered based on the distance image respectively corresponding to the acquired ID of each pharmacist 10,20. , 2b and related information (identification information such as brands and attribute information such as efficacy) related to the drug contained therein is acquired in association with the ID of each pharmacist 10, 20, and the drug related information is acquired for each pharmacist. The information is displayed on the display 5 in association with the IDs 10 and 20. In this case, for example, the display 5 is divided into screens for each pharmacist 10 and 20, and each pharmacist 10 and 20 is about to pick each of the divided screens (the hands 10 a and 20 a of the pharmacists 10 and 20). Related information such as brand name, efficacy, or stock quantity of the medicine in the storage units 2a, 2b is displayed.

  Next, in the second embodiment, the control unit 11 has a function of discriminating the plurality of mounting rods 3a and 3b from each other based on the RGB image from the visible light camera 6 based on the color and shape (image recognition software). It has. Therefore, the control unit 11 identifies the mounting rods 3a and 3b on which the plurality of pharmacists 10 and 20 put the picking drugs from each other based on the image from the visible light camera 6, and each of these mounting rods 3a. , 3b can be detected by distinguishing from each other that there has been a change in the image in the images (increase or decrease in the amount of medicine placed on the mounting rods 3a, 3b).

  In the second embodiment, as described above, the ID or name of each pharmacist 10 and 20 to be picked and each mounting rod 3a and 3b used by each pharmacist 10 and 20 (different from each other by color or shape). A container-to-worker recording unit 24 is provided for recording identification data of possible ones) in association with each other. Therefore, in the second embodiment, the control unit 11 refers to the container-to-worker recording unit 24, so that even when there are a plurality of mounting rods 3 a and 3 b, changes in the mounting rods 3 a and 3 b ( The increase / decrease in area or increase / decrease in medicine) and the picked medicine in each of the mounting rods 3a, 3b obtained thereby can be identified and recorded in association with the ID or name of each pharmacist 10, 20 or the like. it can.

Next, under the above-described configuration, the control unit 11 according to the second embodiment uses the following procedure to pick up drug data picked up by the pharmacists 10 and 20 and placed in the placement baskets 3a and 3b. Like to get.
1. When the pharmacists 10 and 20 bring their hands close to the storage units 2a and 2b in the storage rack 1 or put their hands into the storage units 2a and 2b, the control unit 11 Start tracking the skeleton. And the control part 11 is a stage in which each pharmacist 10 and 20 puts his hand 10a and 20a in each accommodating part 2a and 2b, or the own hands 10a and 20a in each accommodating part 2a and 2b, The data x and y of the medicine to be picked (in this case, only the identification data such as the medicine name and the ID uniquely representing the medicine may be recognized) are recognized as described above. Further, the control unit 11 associates the three-dimensional positions of the hands 10a and 20a with the drug data x and y while tracking the hands 10a and 20a.
2. When the distance between the three-dimensional position of each hand 10a, 20a and the placement basket 3a, 3b is equal to or less than the threshold value, the control unit 11 stores the drug data x, y and the placement basket 3a, 3b or possession thereof. The person (pharmacist 10, 20) is associated.
3. The controller 11 determines that the pharmacists 10 and 20 have performed the picking operation when the area in the mounting rods 3a and 3b increases (adds the data x and y of the drug to the picking history of the pharmacists 10 and 20). ).

Moreover, the control part 11 of this Embodiment 2 carries out the following procedures, and each pharmacist 10 and 20 picks the medicine which was once picked up and placed in the placement baskets 3a and 3b, and then the placement baskets 3a and 3b. When the medicine is taken out from the container and returned to the storage units 2a and 2b, the returned data of the medicine is acquired.
1. The control unit 11 starts tracking the skeletons of the hands 10a and 20a of the pharmacists 10 and 20 when the area in the placement baskets 3a and 3b decreases.
2. Of the hands 10a and 20a recognized for the first time after the start of tracking, the control unit 11 has the respective hands 10a and 20a located closest to the mounting rods 3a and 3b and the owners of the mounting rods 3a and 3b ( The information (ID etc.) of the pharmacists 10 and 20) is linked.
3. When the pharmacists 10 and 20 bring their hands 10a and 20a close to or into the storage units 2a and 2b in the storage shelf 1, the control unit 11 controls the pharmacists 10 and 20 to store the storage units 2a and 2a. It is determined that the medicine of the medicine data x, y corresponding to 2b has been returned from the placement baskets 3a, 3b into the storage units 2a, 2b (in this case, the medicine data is determined from the picking history of the pharmacists 10, 20). delete x and y).

  As described above, in the second embodiment, even when drug picking is performed in parallel by a plurality of pharmacists 10 and 20, increase / decrease of the drugs in the mounting cages 3 a and 3 b and the picked storage units 2 a and 2 2b and the medicine can be specified for each placement basket 3a, 3b and for each pharmacist 10,20. Therefore, according to the second embodiment, it is possible to improve the efficiency of the medicine picking inspection (dispensing mistake inspection) performed in parallel by a plurality of persons and to track the medicine picked for each worker. As a result, investigation of the cause of dispensing errors can be performed more efficiently and with high accuracy.

  The first embodiment of the present invention has been described above, but the present invention is not limited to the one described as the first embodiment, and various modifications and changes can be made. For example, in the first and second embodiments, the infrared projector and the infrared camera provided in Kinect are used as the distance image acquisition unit. However, the present invention is not limited to this, and for example, “Time You may make it use the distance image sensor by a "-of-Flight" system.

  In FIGS. 2 and 7 according to the first and second embodiments, the example in which the medicine is picked from each storage unit 2 in one storage shelf 1 is shown. However, the present invention places a plurality of storage shelves side by side. Even when the present invention is applied to a case where a plurality of storage shelves are arranged, each of the storage units in the plurality of storage shelves Regardless of which storage shelves are included, based on the respective three-dimensional positions, it is determined (specified) whether or not the storage unit is a picked storage part in which the operator's hand is stretched.

  In the first and second embodiments, the control unit 11 changes the medicine (the number or area of medicines) in the placement basket 3 based on the RGB image of the placement basket 3 acquired by the visible light camera 6. However, the present invention is not limited to this. For example, the control unit 11 may use the infrared camera included in the distance image sensor 7 such as FIGS. 1B and 6 or the distance image. Based on the infrared image of the mounting rod 3 picked up by the “infrared camera installed separately from the infrared camera of the sensor 7”, the change of the drug in the mounting rod 3 (increase or decrease in the number or area of the drugs) is determined. (In this case, the visible light camera 6 shown in FIGS. 1B and 6 is unnecessary). Furthermore, in the present invention, for example, the distance image sensor 7 acquires at least the distance images of the “hands 10a and 20a of the workers 10 and 20 and the placement rods 3, 3a and 3b”, and the control unit 11 Based on the distance image of the placement baskets 3, 3a, 3b acquired by the image sensor 7, a change in the medicine in the placement baskets 3, 3a, 3b (increase or decrease in the number, area, or volume of the medicine) is determined. (In this case, since the visible light camera 6 shown in FIGS. 1B and 6 is not necessary, the cost of the apparatus can be reduced).

  Further, in the first embodiment, the configuration (see FIG. 5 and the like) for displaying related information of the drug that the pharmacist is trying to pick on the display is referred to as “inside the mounting rods 3, 3a, 3b”. The determination is made in association with determination of drug change (increase / decrease in the number, area, or volume of the drug) and identification of the drug picked from the container by the pharmacist or the like, but the present invention is limited to this. Instead, for example, “determination of a change in the medicine in the mounting bowl 3, 3a, 3b (increase or decrease in the number, area, or volume of the medicine) and identification of the medicine picked from the container by the pharmacist” Without performing, the pharmacist or the like may acquire the related information of the medicine that is about to be picked (or is being picked) and display it on the display. In this manner, “determination of changes in the drugs in the mounting bowls 3, 3a, 3b (increase or decrease in the number, area, or volume of the drugs) and identification of the drugs picked from the container by the pharmacist” are not performed. The effect of supporting the drug picking work by the pharmacist or the like can be sufficiently exerted only by displaying the related information of the drug that the pharmacist or the like is about to pick (or being picked) on the display.

  Further, in the first embodiment, the storage unit versus drug database 14 that records the three-dimensional position data of each storage unit and the identification data (brand name, etc.) of the drug stored in each storage unit in association with each other, A drug-related database 15 that records drug identification data and attribute information of each drug (attribute data such as efficacy, drug company name, side effect, or inventory quantity) in association with each other is configured separately from each other. However, in the present invention, these may be configured as one database (that is, the relationship between the three-dimensional position data of each storage unit and the medicine stored in each storage unit) Information (identification data such as brands, and attribute data such as efficacy, pharmaceutical company name, side effects, or inventory quantity) is recorded as one database that records them in association with each other. It may be).

  In the first embodiment, the display 5 is installed on the storage shelf 1 together with Kinect (fixedly installed with a bolt or an adhesive tape) (see FIG. 1B). Is not limited to this. For example, it is provided for a wearable type terminal such as a portable terminal or a wristwatch type carried by a pharmacist or the like, such as a display provided in a smartphone or a tablet terminal. Display.

  Furthermore, although not shown in FIG. 7 relating to the second embodiment, in the present invention, when a plurality of pharmacists perform drug picking work in parallel as in the second embodiment, a separate pharmacist is provided for each pharmacist. By providing the display 5, in accordance with the picking work of each pharmacist, each person will be able to display information related to the medicine that the person is about to pick or the medicine stored in the container during picking. It is also possible to display on a portable terminal or a display provided on a wearable terminal that each pharmacist or the like carries or uses.

DESCRIPTION OF SYMBOLS 1,100 Storage shelf 2,2a, 2b Storage part 3,3a, 3b Mounting basket 5 Display 6 Visible light camera 7 Distance image sensor 10,20 Pharmacist 10a, 20a Pharmacist's hand 11 Control part 12 籠 Image storage part 13 Hand Position data storage unit 14 Storage unit vs. drug database 15 Drug related database 21, 22, 23 PTP sheet 24 Container vs. worker recording unit 101 Storage unit vs. drug related information recording unit 102, 113 Distance image acquisition unit 103, 115 Drug related information Acquisition unit 104, 116 Display control unit 105, 117 Display 111 Storage unit versus drug identification data recording unit 112 Drug related information recording unit 114 Identification unit such as storage unit

The drug picking support system using the display according to the present invention for solving such problems includes a plurality of types or brands of medicines each containing a plurality of kinds or brands of medicines arranged vertically and horizontally. Storage shelves (including a combination of a plurality of storage shelves), data on each storage unit in the storage shelf (including at least three-dimensional position data of each storage unit), and each storage unit. Storage unit-drug-related information recording means for recording data relating to the stored drug (including at least drug-related information such as drug efficacy or stock quantity) in association with each other, and at least each worker in front of the storage shelf Distance image acquisition means for acquiring a distance image of a hand, and each three-dimensional position of each worker's hand moving three-dimensionally based on the distance image from the distance image acquisition means Are recorded in the tracking means for tracking each worker separately from each other, the information of each three-dimensional position of each worker's hand acquired by the tracking means, and the storage unit / drug-related information recording means. Based on the three-dimensional position data of each storage unit, it is stored in “each storage unit corresponding to each three-dimensional position of each worker's hand, ie, each worker's hand facing or extending”. Medicine-related information acquisition means for separately acquiring each medicine-related information obtained for each worker, a display located in the vicinity of the storage shelf, and medicine-related information acquired by the medicine-related information acquisition means And display control means for displaying on the display.

In addition, the drug picking support system using the display according to the present invention includes a storage shelf (a plurality of storage racks) in which storage units each storing a plurality of types or brands of drugs are arranged in the vertical and horizontal directions. Including a combination of storage shelves), data relating to each storage unit in the storage shelf (including at least three-dimensional position data of each storage unit), and data relating to a drug respectively stored in each storage unit (at least a drug) Storage unit-drug-related information recording means that records and records at least a distance image of each worker's hand in front of the storage shelf for a predetermined time. Distance image acquisition means for acquiring each worker separately for each distance image, each distance image from the distance image acquisition means, and recorded in the storage unit / drug-related information recording means. Based on the three-dimensional position data of each storage unit, it is stored in “each storage unit corresponding to each three-dimensional position of each worker's hand, ie, each worker's hand facing or extending”. Drug-related information acquisition means for acquiring related information of the drug being used, each display carried by each worker or worn on the body, and drug-related information acquired by the drug-related information acquisition means And display control means for displaying the relevant information of the medicine accommodated in each accommodating part in which each operator's hand is facing or extending, corresponding to each operator on each display. It is characterized by having.

Claims (2)

A storage shelf (including a combination of a plurality of storage shelves) in which each storage unit that stores a plurality of types or brands of drugs is stored in the vertical and horizontal directions;
Data related to each storage unit in the storage shelf (including at least three-dimensional position data of each storage unit) and data related to a drug stored in each storage unit (including at least drug-related information such as drug efficacy or stock quantity) Storage unit vs. drug related information recording means for recording in association with each other;
Distance image acquisition means for acquiring at least a distance image of an operator's hand in front of the storage shelf;
Based on the distance image from the distance image acquisition unit and the three-dimensional position data of each storage unit recorded in the storage unit-drug-related information recording unit, “corresponding to the three-dimensional position of the operator's hand, Drug related information acquisition means for acquiring related information of the drug stored in the storage section facing or extending the operator's hand;
A display located in the vicinity of the storage shelf;
Display control means for displaying the medicine related information acquired by the medicine related information acquiring means on the display;
A drug picking support system using a display characterized by comprising: A storage shelf (including a combination of a plurality of storage shelves) in which each storage unit that stores a plurality of types or brands of drugs is stored in the vertical and horizontal directions;
Storage unit-to-drug identification data that records data relating to each storage unit in the storage shelf (including at least three-dimensional position data of each storage unit) and identification data of a drug stored in each storage unit in association with each other Recording means;
Drug-related information recording means for recording identification data of each drug and drug-related information such as its efficacy or the number of stocks in association with each other;
Distance image acquisition means for acquiring at least a distance image of an operator's hand in front of the storage shelf;
Based on the distance image from the distance image acquisition unit and the three-dimensional position data of each storage unit recorded in the storage unit vs. drug identification data recording unit, “corresponding to the three-dimensional position of the operator's hand, A storage unit in which the operator's hand is facing or extending "or a specifying unit such as a storage unit for specifying a medicine stored in the storage unit;
Based on the data of the storage part or medicine specified by the specifying means such as the storage part, the related information of the medicine stored in the storage part facing or extending the operator's hand from the medicine related information recording means Drug-related information acquisition means for acquiring
A display located in the vicinity of the storage shelf;
Display control means for displaying the medicine related information acquired by the medicine related information acquiring means on the display;
A drug picking support system using a display characterized by comprising:

Images