WO2011145351A1 - 薬液判定装置及び薬液判定方法 - Google Patents
薬液判定装置及び薬液判定方法 Download PDFInfo
- Publication number
- WO2011145351A1 WO2011145351A1 PCT/JP2011/002797 JP2011002797W WO2011145351A1 WO 2011145351 A1 WO2011145351 A1 WO 2011145351A1 JP 2011002797 W JP2011002797 W JP 2011002797W WO 2011145351 A1 WO2011145351 A1 WO 2011145351A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image information
- drug
- container
- pattern
- chemical
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/90—Investigating the presence of flaws or contamination in a container or its contents
- G01N21/9018—Dirt detection in containers
- G01N21/9027—Dirt detection in containers in containers after filling
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
- G01N21/41—Refractivity; Phase-affecting properties, e.g. optical path length
Definitions
- the present invention relates to a chemical solution such as an injection used in hospitals and the like, and a chemical determination device and a chemical determination method for determining a drug container containing the chemical.
- FIG. 14A and 14B show a conventional interface position detection apparatus.
- FIG. 14A is a perspective view illustrating a schematic configuration of the interface position detection apparatus.
- FIG. 14B is a diagram illustrating an example of an image captured to detect the interface position.
- the container 1 contains two kinds of liquids L 1 and L 2 .
- the liquid L 1 at the top the liquid L 2 is on separated at the bottom. Between the liquid L 1 and air interface S 1 is formed. An interface S 2 is formed between the liquid L 1 and the liquid L 2 .
- the liquids L 1 and L 2 are generally colorless and transparent and the container 1 is also a colorless and transparent container, it is difficult to distinguish the two interfaces S 1 and S 2 .
- the background plate 2 in which the left half 2a is black and the right half 2b is painted white. Is arranged behind the container 1.
- An imaging device 3 connected to the image processing device 4 is arranged on the front side to capture an image of the container 1 containing the liquids L 1 and L 2 .
- the distance between the container 1 and the background plate 2 is selected to be longer than the focal length of the cylindrical lens 5 formed by the container 1 and the liquids L 1 and L 2 .
- an image obtained by imaging the color-coded pattern of the background plate 2 from the front side through the cylindrical lens 5 (the container 1 and the liquids L 1 and L 2 ) using the imaging device 3 is a monochrome pattern as shown in FIG. 14B. Flips left and right.
- the position of the vertical line V indicating the boundary of the monochrome pattern of the background plate 2 with respect to the container 1 is detected in the image shown in FIG. 14B. That is, the image of FIG. 14B is scanned in the horizontal direction to detect the position of the vertical line V indicating the boundary of the black and white pattern in the cylindrical lens 5 (container 1). This is sequentially performed along the arrow 6 from the upper part to the lower part of the container 1, for example. Then, as shown in FIG.
- the vertical line V of the background plate 2 in the air portion becomes the vertical line V 0
- the vertical line V of the background plate 2 in the liquid L 1 portion becomes the vertical line V 1
- the liquid L 2 vertical line V is a vertical line V 2 in the part of the background plate 2. Therefore, the positions of the vertical lines V 0 , V 1 , V 2 are clarified.
- the reason why the vertical lines V 0 , V 1 , and V 2 are displaced is that the refractive indexes of the gas and the liquid are different. Thereby, the horizontal positions where the vertical lines V 0 , V 1 , V 2 are discontinuous are detected as the two interfaces S 1 , S 2 , respectively.
- the liquid amounts of the liquids L 1 and L 2 are calculated based on the positions of the two interfaces S 1 and S 2 with respect to the container 1. These operations can be performed by taking an image of the container 1 with the imaging device 3 and analyzing the image with the image processing device 4. Therefore, the position of the interface can be detected, and the amount of liquid contained in the container 1 can be calculated.
- Patent Document 1 In the technique of Patent Document 1 described above, only the interface height of the chemical solution is known, and there is a problem that an error cannot be detected even if the type and amount of the chemical solution and the type of the drug container are different from the intended ones. .
- This invention solves this subject, and it aims at providing the chemical
- the present invention is configured as follows to achieve the above object.
- a pattern projection unit that projects a light and dark pattern
- a placement section for placing a drug container having permeability and having a chemical solution inside
- An imaging camera that captures the bright and dark pattern transmitted through the medicine container as captured image information
- a chemical solution determination apparatus comprising: an image processing unit that acquires reference image information serving as a reference for determination from a database and compares the reference image information and the captured image information to determine a type of the chemical solution or the drug container.
- the medicinal solution that is the determination target is placed inside and the medicinal container having permeability is placed on the placing unit, Obtain reference image information that is a criterion for judgment from the database, A light and dark pattern determined based on the reference image information is projected from the back of the medicine container placed on the placement part, The bright and dark pattern is observed through the drug container and imaged as captured image information, Provided is a chemical solution determination method for comparing the reference image information and the captured image information to determine the type of the chemical solution or the drug container.
- the chemical determination device and the chemical determination method of the present invention it is possible to accurately determine that the types of the chemical and the drug container are intended.
- FIG. 1A is a perspective view showing a chemical determination device according to the first embodiment of the present invention
- FIG. 1B is a block diagram illustrating an image processing unit of the chemical liquid determination device according to the first embodiment of the present invention.
- FIG. 2 is an operation flowchart of the chemical determination method according to the first embodiment of the present invention.
- FIG. 3A is a diagram illustrating an example of captured image information captured by an imaging camera in the example of image information used in the chemical liquid determination device according to the first embodiment of the present invention;
- FIG. 3A is a diagram illustrating an example of captured image information captured by an imaging camera in the example of image information used in the chemical liquid determination device according to the first embodiment of the present invention;
- FIG. 1A is a perspective view showing a chemical determination device according to the first embodiment of the present invention
- FIG. 1B is a block diagram illustrating an image processing unit of the chemical liquid determination device according to the first embodiment of the present invention.
- FIG. 2 is an operation flowchart of the chemical determination method according to the first
- FIG. 3B is a diagram illustrating an example of the reference image information stored in the database in the example of the image information used in the chemical determination device according to the first embodiment of the present invention.
- FIG. 4 is an operation flowchart of a portion related to image information in the chemical determination method according to the first embodiment of the present invention.
- FIG. 5A is a diagram illustrating an example of a captured image of a light and dark pattern viewed through a medicine container on a mounting table of the chemical determination device according to the first embodiment of the present invention; 5B is a side view seen from the direction of the arrow 42 in FIG. 5A, FIG.
- FIG. 6A is a diagram showing information of each captured image taken by the chemical determination device according to the first embodiment of the present invention [in (1) and (2), when the repetition cycle of the striped light-dark pattern is different.
- FIG. 6B is a diagram showing each captured image information photographed in the chemical determination device according to the first embodiment of the present invention [(3) to (5) are chemical containers containing the same chemical liquid but having different diameters.
- Is a diagram showing captured image information in the case of FIG. 7A is a diagram showing information of each captured image taken by the chemical determination device according to the first embodiment of the present invention [in (1) and (2), when the repetition cycle of the striped light-dark pattern is different.
- Figure showing captured image information] FIG.
- FIG. 7B is a diagram showing each captured image information photographed by the chemical determination apparatus according to the first embodiment of the present invention [(3) to (5) are cases in which different chemicals are contained in the same chemical container.
- Figure showing captured image information FIG. 8 is a diagram showing captured image information acquired when the light and dark pattern is displayed in color, and (1) shows the captured image information when color display similar to the chemical solution is used for the light and dark pattern.
- (2) is a diagram showing captured image information in the case of using a color display of a complementary color of a chemical liquid color for a light and dark pattern
- FIG. 9 is a flowchart illustrating an example when a color display of a striped pattern is used, FIG.
- FIG. 10A is a front view of a schematic configuration of another chemical determination device according to the first embodiment of the present invention
- FIG. 10B is a schematic configuration of another chemical determination device according to the first embodiment of the present invention, and is a side view seen from the direction of the arrow 20a in FIG. 10A
- FIG. 11A is a front view of a schematic configuration of a chemical determination device according to a second embodiment of the present invention
- FIG. 11B is a schematic configuration of the chemical determination device according to the second embodiment of the present invention, and is a side view seen from the direction of the arrow 40a in FIG. 11A.
- FIG. 12 is a diagram illustrating an example of imaged image information of a syringe and a medicine container in a state in which a medicine is sucked, which is imaged by the medicine determination device according to the second embodiment of the present invention
- FIG. 13 is a flowchart showing an example of detecting a liquid level of a drug solution in a syringe by projecting a striped pattern onto a syringe integrated with a drug container via a needle
- FIG. 14A is a perspective view showing a schematic configuration of a conventional interface position detection device
- FIG. 14B is a diagram illustrating an example of an image for explaining a conventional interface position detection method.
- FIG. 1A is a perspective view showing a chemical determination apparatus 10 according to the first embodiment of the present invention.
- FIG. 1B is a block diagram illustrating the image processing unit 11 of the chemical determination apparatus 10.
- the chemical determination device 10 of the first embodiment includes a pattern projection unit 12, a placement unit 13, an imaging camera 14, and an image processing unit 11.
- the pattern projection unit 12 projects a bright and dark pattern 12a.
- a projection device that projects a predetermined light / dark pattern 12a from a light source toward a medicine container (for example, a vial) 16 via a plate-like member or a predetermined light / dark pattern 12a is displayed. Any device that projects a bright and dark pattern 12a, such as a liquid crystal display device, can be used.
- the predetermined light and dark pattern 12a is, for example, a strip-shaped bright pattern (for example, a white strip-shaped pattern) that is long and has a uniform brightness in the vertical direction along a direction intersecting the horizontal direction (for example, the vertical direction).
- the width of the pattern does not have to be a constant width, but a constant width is preferable because the load of image processing and the like is reduced.
- the width dimension of the pattern is set so that at least three patterns are included in the medicine container 16 in the captured image information 19. This is because accurate determination is difficult if the number of patterns in the medicine container 16 in the captured image information 19 is less than three. As a result of verification by the inventors, it was found that 3 to 8 patterns in the medicine container 16 in the captured image information 19 are preferable. If there are more than eight patterns in the medicine container 16 in the captured image information 19, the number of image pixels per pattern is reduced, which affects image matching accuracy, which is not preferable.
- an appropriate pattern is selected as the light / dark pattern 12a based on the drug container 16 and the drug solution 15 to be determined.
- a method for selecting an appropriate light / dark pattern 12a there is a method in which relation information between the medicine container 16 and the drug solution 15 and the light / dark pattern 12a is stored in the database 17 and the like, and the selection is made based on the relation information.
- the placement unit 13 is a plate-like member disposed in front of the pattern projection unit 12 and has transparency.
- An example of the placement unit 13 is a transparent plate-like member, for example.
- a medicine container 16 is placed on the placing portion 13 having permeability.
- the drug container 16 is a container having a chemical solution 15 inside (the chemical solution 15 is stored inside).
- the imaging camera 14 is disposed in front of the placement unit 13 so as to face the bright and dark pattern 12 a of the pattern projection unit 12. And this imaging camera 14 images the light and dark pattern 12a of the pattern projection part 12 which permeate
- the image processing unit 11 is connected to the imaging camera 14, processes the captured image information captured by the imaging camera 14, and performs chemical determination.
- the image processing unit 11 includes an image input unit 11a, an information input unit 11b, an image selection unit 11c, an image matching unit 11d, and a storage unit 11e. .
- the image input unit 11a is connected to the imaging camera 14 and inputs captured image information captured by the imaging camera 14.
- the input captured image information is stored in the storage unit 11e.
- drug information including at least information on the types of the drug solution 15 and the drug container 16 is input.
- the information input unit 11b can include not only input by an operator but also input from a higher in-hospital system (such as an electronic medical record) of the chemical determination apparatus, and is included in a higher in-hospital system (such as an electronic medical record). Reference image information or the like may be input to the information input unit 11b.
- the inputted medicine information is stored in the storage unit 11e.
- the drug information is information input as a drug solution to be determined and a drug container from an operator who uses the drug solution determination device.
- an access program access means or access for automatically accessing a personal computer keyboard, mouse, touch panel, voice input device, or external drug information database. Part).
- the database (DB) 17 is a database disposed in the chemical determination device 10 or a database that is disposed outside the chemical determination device 10 and can be connected via a communication line such as the Internet.
- the database 17 stores reference image information 18 that is information on the types of the drug solution 15 and the drug container 16 and serves as a reference for determining the drug solution 15 or the drug container 16.
- the reference image information 18 is image information obtained by imaging the light and dark pattern 12a that has passed through the reference drug container in which the drug solution 15 to be determined is stored (see FIG. 3B).
- the image selection unit 11c is a reference image information that is input in advance from the information input unit 11b or the database (DB) 17 and serves as a determination criterion based on information on a chemical solution to be determined from an operator who uses the chemical determination device. 18 is selected and acquired. The acquired reference image information 18 is stored in the storage unit 11e.
- the image matching unit 11d compares the reference image information 18 acquired by the image selection unit 11c and the captured image information 19 input to the image input unit 11a, respectively stored in the storage unit 11e.
- the image matching unit 11d determines whether the reference image information 18 and the captured image information 19 are the same image information. Thereby, the image matching unit 11d identifies the type or / and shape of the drug solution 15 or / and the drug container 16.
- the type of the drug solution 15 and / or the shape of the drug container 16 are determined instantaneously and accurately.
- FIG. 2 shows an operation flowchart of a chemical determination method using the chemical determination device 10 according to the first embodiment of the present invention.
- 3A and 3B are diagrams illustrating examples of image information used in the chemical determination device 10 according to the first embodiment of the present invention.
- FIG. 3A is a diagram illustrating an example of captured image information captured by the imaging camera 14.
- FIG. 3B is a diagram illustrating an example of the reference image information stored in the database 17.
- FIG. 4 shows an operation flowchart of a portion related to image information in the chemical determination method according to the first embodiment of the present invention.
- FIG. 5A is a diagram illustrating an example of a captured image of the light and dark pattern 12a viewed through the medicine container 16 on the mounting table 13a.
- FIG. 5B is a diagram (a side view seen from the direction of the arrow 42 in FIG. 5A) in a state where the medicine container 16 on the mounting table 13a is allowed to pass therethrough.
- the chemical determination method of the first embodiment includes a placement step S1, an input step S2, a reference image information acquisition step S3, a projection step S4, an imaging step S5, and an image matching step. S6.
- the placing step S1 is a step for placing the medicine container 16 in which the medicinal solution 15 to be determined is stored on the placing unit 13.
- drug information including at least information on the type of the drug container 16 placed on the placement unit 13 in the placement step S1 and the type of the drug solution 15 in the drug container 16 is input to the information input unit 11b.
- the input to the information input unit 11b is an input by an operator from an input unit or an input from a higher hospital system (for example, an electronic medical record).
- the drug information is information input as a drug solution to be determined and a drug container from an operator who uses the drug determination device.
- the image selection unit 11c selects and acquires reference image information serving as a determination reference from the information input unit 11b or the database 17. It is a step to do.
- the projection step S4 based on the reference image information acquired in the reference image information acquisition step S3, the corresponding light / dark pattern 12a is placed on the placement unit 13 by the pattern projection unit 12. Projecting from the back.
- This projection step S4 may be performed simultaneously with the input step S2 or the reference image information acquisition step S3.
- information that the bright and dark pattern 12a is projected by the pattern projection unit 12 in the projection step S4 is transmitted to the imaging camera 14.
- the bright and dark pattern 12a projected by the pattern projection unit 12 in the projection step S4 is observed with the imaging camera 14 via the drug container 16 and the drug solution 15 stored therein, and the captured image information As shown in FIG.
- the timing of imaging is after information obtained by projecting the bright and dark pattern 12a by the pattern projection unit 12 is transmitted to the imaging camera 14 and input.
- the image matching step S6 determines whether or not the reference image information acquired in the reference image information acquisition step S3 and the captured image information acquired in the imaging step S5 are the same image information by the image matching unit 11d. It is a step to do. Whether or not the image information is the same is determined by the image matching unit 11d based on whether or not the similarity between the reference image information and the captured image information is greater than or equal to a preset threshold value.
- the image matching unit 11d determines that the reference image information and the captured image information are the same image information, whereby the type or / and shape of the drug solution 15 and / or the drug container 16 is determined. It is determined whether or not it matches with the object to be handled.
- the image matching step S6 includes a container confirmation step S6A and a chemical solution confirmation step S6B.
- the chemical solution 15 to be determined and the drug container 16 containing the chemical solution 15 are placed on the placement unit 13 of the chemical solution judgment device 10.
- the medicine container 16 is placed at a predetermined position between the pattern projection unit 12 that projects the bright and dark pattern 12a and the imaging camera 14 that takes an image through the medicine container 16 (placement step). S1).
- FIG. 4 is a flowchart regarding specific handling of image information in the flow from the input step S2 to the image matching step S6.
- drug information which is information regarding the type or / and shape of the drug solution 15 and / or drug container 16 to be determined, is input to the information input unit 11b of the image processing unit 11 (input step S2, step S101).
- the drug information there is a color, a viscosity, a refractive index, or a drug solution amount of the drug solution 15.
- Other examples of drug information include the size, color, material, or refractive index of the drug container 16.
- Such drug information is input to the information input unit 11b by a communication unit from a drug information database stored in a personal computer (not shown), for example, and stored in the storage unit 11e.
- the drug information input from the keyboard of this personal computer is input to the information input unit 11b by the same communication means and stored in the storage unit 11e.
- a set of projection pattern and reference image information corresponding to the drug information is acquired from the storage unit 11e and the database 17 (reference image information acquisition step) S3, step S102).
- the image selection unit 11c selects the reference image information 18 serving as a determination reference from the database 17 based on the drug information from the storage unit 11e.
- the reference image information 18 is image information obtained by imaging the light and dark pattern 12a transmitted through the reference drug container in which the drug solution 15 to be determined is stored with the imaging camera 14.
- the reference image information 18 is stored in advance in the database 17. Note that instead of storing in the database 17 in advance, the reference image information 18 may be input from the information input unit 11b.
- the reference image information 18 it is possible to cope with a case where a drug solution 15 having the same or similar shape, color, or material of the drug container 16 is determined. Further, by using the reference image information 18 in this way, it is possible to deal with a case where different types of chemical solutions 15 contained in the same type of drug container 16 are discriminated.
- the reference image information 18 for example, it is preferable to prepare a plurality of combinations of the drug container 16 and the drug solution 15 and to store as many other reference image information 18 as possible. Thereby, even when it is difficult to determine the drug solution 15 or / and the drug container 16, the type or / and shape of the drug solution 15 or / and the drug container 16 can be accurately determined.
- the reference image information 18 is information including image information captured through only the drug container 16 and image information captured through the drug container 16 and the drug solution 15.
- Image information transmitted through only the medicine container 16 and incident on the imaging camera 14 is mainly a color and a refraction image depending on the material and shape of the medicine container 16, and the characteristics of the medicine container 16 appear most.
- the image information transmitted through the medicine container 16 and the medicine liquid 15 and incident on the imaging camera 14 becomes a color and a refraction image depending on the nature of the medicine liquid 15 in addition to the material and shape of the medicine container 16.
- the calculation amount of the determination process can be reduced by sequentially determining the type or / and the shape of the drug solution 15 or / and the drug container 16 based on the image information. That is, by using these pieces of image information, the type or / and shape of the drug solution 15 and / or drug container 16 can be determined quickly and accurately.
- the image matching step S6 includes a container confirmation step S6A and a chemical confirmation step S6B.
- the container confirmation step S6A is to confirm the medicine container 16 containing the medicine such as the medicine solution 15.
- the chemical solution confirmation step S6B is to confirm the chemical solution 15 in the medicine container 16. Since it is very dangerous to erroneously determine the chemical solution 15, confirmation of the chemical solution 15 is particularly important. In order to confirm the medicine container 16 and the medicine solution 15, respectively, it is necessary to acquire the reference image information 18 and the captured image information 19 in, for example, the container confirmation step S6A and the medicine solution confirmation step S6B.
- the shape of the drug container 16 is often characterized around the shoulder 16c of the container.
- the shoulder portion 16c of the medicine container 16 is located above the trunk portion 16b having a constant diameter and extends from the lower surface of the cap 16a to the trunk portion 16b having a constant diameter. Means the part in between.
- the shoulder portion 16 c is a portion that is inclined in a curved shape in the medicine container 16.
- the body portion 16b is a portion having a constant diameter in the medicine container 16.
- the chemical solution 15 is stored in the trunk portion 16b in order to facilitate visual inspection by a pharmacist or the like.
- the bottom part 16d of the medicine container 16 is a part below the body part 16b having a constant diameter and reaching the flat bottom surface 16e.
- the waist 16d is a portion of the drug container 16 where the side surface of the drug container 16 is curved.
- the shoulder 16c of the drug container 16 in the captured image information 19a and the image of the shoulder 16c of the drug container 16 in the reference image information (shoulder peripheral reference image information) 18a previously captured and stored in the database 17 are displayed. Comparison is made by the matching unit 11d. As a result of this determination, when the type of the medicine container 16 is specified by the image matching unit 11d, the process proceeds to the medicinal solution confirmation step S6B.
- the type of the medicine container 16 is more accurately determined by the shoulder 16c of the medicine container 16. However, if the processing speed is increased and there is no particular problem even if the determination accuracy is slightly reduced, the type of the drug container 16 is imaged not only from the shoulder 16c but also from the outline of the drug container 16 as a whole. It can also be determined by the matching unit 11d.
- the liquid surface 15a of the medicinal solution 15 in the medicine container 16 and the region including the body part 16b and the bottom part 16d of the medicine container 16 are taken as imaged image information (liquid surface surrounding imaged image information) 19b.
- An image is captured by the imaging camera 14.
- an area including the bottom 16d of the medicine container 16 is captured by the imaging camera 14 as captured image information (bottom peripheral captured image information) 19c.
- the captured image information (liquid surface peripheral captured image information) 19b and the captured image information (bottom peripheral peripheral captured image information) 19c are reference image information (liquid surface peripheral reference image information) captured in advance and stored in the database 17.
- 18b, the reference image information (bottom peripheral reference image information) 18c, and the image matching unit 11d are respectively compared and determined. As a result of these determinations, when the type of the chemical liquid 15 is specified by the image matching unit 11d, the chemical liquid confirmation step S6B is terminated.
- reference image information 18 and the captured image information 19 as shown in FIG. 3A are image information including an upper part and a lower part of the liquid surface 15a of the chemical solution 15.
- the pattern projection unit 12 projects a bright and dark pattern 12a corresponding to the captured image information 19 from the back surface of the medicine container 16 (projection step S4, step S103).
- FIG. 3A shows an example of a captured image.
- the light / dark pattern 12b on the outside of the drug container 16, the light / dark pattern 12c on the gas portion inside the drug container 16, and the light / dark pattern 12d on the drug solution 15 portion should be seen differently.
- the bright and dark pattern 12f including the upper and lower portions of the liquid surface 15a and the bright and dark pattern 12g including the upper and lower portions of the bottom portion 16d (bottom surface 16e) change characteristically in the vertical and horizontal directions of the captured image. You can see that
- the drug container 16 it is possible to determine various combinations of the shape, material, and color of the drug container 16. Further, for the chemical solution 15, it is possible to determine various combinations of the chemical solution 15 contained in the chemical container 16, the refractive index, and the color. For more accurate determination, it is important to individually determine the drug container 16 and the drug solution 15 contained in the drug container 16.
- step S106 when starting the image matching step S6, as shown in FIGS. 3A and 3B, reference image information (shoulder periphery reference image information) 18a around the shoulder portion 16c of the container 16 and captured image information ( The image matching unit 11d performs pattern matching of the image information of the shoulder periphery captured image information) 19a (image matching step S6, step S105).
- the process proceeds to the next step S106.
- the image matching unit 11d determines that the evaluation value for the periphery of the shoulder does not exceed the threshold value for the periphery of the shoulder, the process proceeds to an error end step (step S119).
- the threshold value for the periphery of the shoulder is a minimum evaluation value for the periphery of the shoulder that is acceptable in the determination of the drug solution 15 and the drug container 16.
- the degree of matching of the image information obtained by pattern matching is quantified by the image matching unit 11d as an evaluation value for the bottom periphery (image matching step S6, step S106).
- image matching step S6, step S106 determines that the evaluation value for the bottom periphery is equal to or greater than the threshold value for the bottom periphery
- the process proceeds to the next step S107. If the image matching unit 11d determines that the evaluation value for the bottom periphery does not exceed the threshold value for the bottom periphery, the process proceeds to an error end step (step S119).
- the threshold value for the periphery of the bottom portion is a minimum evaluation value for the periphery of the bottom portion that is acceptable in the determination of the drug solution 15 and the drug container 16.
- Steps S105 and S106 will be described more specifically.
- the image matching unit 11d performs pattern matching between the reference image information 18a and the captured image information 19a of the region including the shoulder portion 16c of the medicine container 16 in which the characteristics of the container shape of the medicine container 16 tend to appear. To determine (image matching step S6, step S105A).
- the evaluation value for the periphery of the shoulder is digitized by the image matching unit 11d in order to determine the pattern matching in step S105B by the image matching unit 11d. If the evaluation value for the periphery of the shoulder is equal to or greater than the threshold for the periphery of the shoulder, the image matching unit 11d determines that pattern matching is being performed (image matching step S6, step S105B), and proceeds to the next step S106A. If the image matching unit 11d determines that the evaluation value for the periphery of the shoulder does not exceed the threshold value for the periphery of the shoulder, the process proceeds to an error end step (step S119).
- the captured image information (bottom peripheral captured image information) 19c of the region including the bottom 16d and the reference image information (bottom peripheral reference image information) 18c are pattern-matched and compared by the image matching unit 11d.
- the determination is made at 11d (image matching step S6, step S106A).
- the evaluation value for the bottom periphery is digitized by the image matching unit 11d in order to determine the pattern matching in step S106B by the image matching unit 11d. If the evaluation value for the bottom periphery is equal to or greater than the threshold value for the bottom periphery, the image matching unit 11d determines that pattern matching is being performed (image matching step S6, step S106B), and proceeds to the next step S107. When the image matching unit 11d determines that the evaluation value for the bottom periphery does not exceed the threshold value for the bottom periphery, the process proceeds to an error end step (step S119).
- step S107 the image matching unit 11d determines which position matches the reference image information (bottom peripheral reference image information) 18c at the vertical position of the captured image information (bottom peripheral captured image information) 19c, for example. Judge with. More specifically, the image matching unit 11d determines whether the vertical position of the captured image information 19c is within a predetermined allowable range of the vertical position of the reference image information 18c (image matching step). S6, step S107). Here, the matching position of the captured image information 19c and the reference image information 18c is clarified by the image matching unit 11d. This can be used, for example, when determining the position of the bottom 16d (bottom surface 16e) of the medicine container 16.
- the image matching unit 11d When the matching position needs to be determined in detail (in other words, the vertical position of the captured image information 19c is within a predetermined allowable range of the vertical position of the reference image information 18c), the image matching unit 11d. If it is determined at step S108, the process proceeds to the next step S108. If the detailed determination of the matching position is unnecessary (in other words, the vertical position of the captured image information 19c is outside the predetermined allowable range of the vertical position of the reference image information 18c), the image matching unit 11d. When the determination is made, the process proceeds to an error end step (step S119).
- step S105 pattern matching of image information between the reference image information (liquid surface peripheral reference image information) 18b around the liquid surface 15a and the captured image information (liquid surface peripheral captured image information) 19b is performed. This is performed by the matching unit 11d (image matching step S6, step S108).
- the degree of coincidence of the image information obtained by pattern matching is digitized by the image matching unit 11d as an evaluation value for the liquid surface periphery (image matching step S6, step S109).
- image matching step S6, step S109 determines that the evaluation value for the liquid surface periphery is equal to or greater than the threshold value for the liquid surface periphery.
- the process proceeds to the next step S110.
- the image matching unit 11d determines that the liquid surface periphery evaluation value does not exceed the liquid surface periphery threshold value, the process proceeds to an error end step (step S119).
- the threshold value for the liquid surface periphery is a minimum evaluation value for the liquid surface periphery that is acceptable in the determination of the drug solution 15 and the drug container 16.
- step S110 for example, at the position in the vertical direction of the captured image information (liquid surface peripheral captured image information) 19b, at which position it matches the reference image information (liquid surface peripheral reference image information) 18b, the image This is determined by the matching unit 11d. More specifically, the image matching unit 11d determines whether or not the vertical position of the captured image information 19b is within a predetermined allowable range of the vertical position of the reference image information 18b (image matching step S6). Step S110). Here, the matching position between the vertical position of the captured image information 19b and the vertical position of the reference image information 18b is clarified by the image matching unit 11d. This can be used, for example, when determining the position of the liquid surface 15a in order to measure the amount of the chemical in the drug container 16.
- step S111 When detailed determination of the matching position is necessary (in other words, the vertical position of the captured image information 19b is within a predetermined allowable range of the vertical position of the reference image information 18b), The process proceeds to step S111. If detailed determination of the matching position is unnecessary (in other words, the vertical position of the captured image information 19b is outside the predetermined allowable range of the vertical position of the reference image information 18b), the process ends in error. Go to step (step S119).
- step S111 after the position of the liquid surface 15a is clarified in step S110 and, for example, the amount of the chemical solution is calculated, a notification is made that a series of image matching steps S6 has been completed. Specifically, “OK” indicating that a series of image matching steps S6 has been completed is output (step S111), and the process is terminated.
- FIG. 5B which is a side view seen from the direction of the arrow 42 in FIGS. 5A and 5A will be referred to.
- a part of the placement unit 13 adjacent to the drug container 16 (a part that blocks the imaging of the bright and dark pattern 12a behind the imaging camera 14) is made of a transparent member.
- the shape of the member of the mounting portion 13 adjacent to the medicine container 16 is configured so that the area that blocks the imaging of the bright and dark pattern 12a behind is small, and the reference image information 18 and the captured image information 19 are stored in the medicine container.
- the configuration may be image information including 16 bottom portions 16d and the upper and lower portions of the bottom portion 16d.
- the mounting unit 13 is provided with a mounting table 13 a on which the medicine container 16 is mounted.
- the mounting table 13a is thin in the vertical direction in FIGS. 5A and 5B, but a transparent member having a predetermined thickness may be used. Further, by providing a gap between the mounting table 13a and the flat surface (the surface on which the mounting table 13a is placed) 13b, the light and dark pattern 12a behind may be seen as it is. That is, a member having a hollow inside may be used as the mounting table 13a.
- the image information from the bottom 16d where the light-dark pattern 12a changes greatly and the portion adjacent thereto is seen. be able to. Therefore, the type or / and shape of the drug solution 15 or / and the drug container 16 can be more accurately determined based on the image information in which the light / dark pattern 12a is changed.
- a medicine container 16 having a diameter slightly smaller than the standard is placed on the placement unit 13, and from behind it, the horizontal stripe width is slightly thicker than the standard light-dark pattern 12a.
- the captured image information 19 when the pattern 12h is projected is shown.
- the standard diameter of the medicine container 16 is the diameter of the medicine container when stored as a reference image. Since the drug container differs depending on the manufacturer, drug name, and quantity, using the standard diameter of the drug container 16 is effective for determining the drug container.
- the light / dark pattern of the chemical solution 15 in the drug container 16 the light / dark pattern in the space above the chemical solution 15, and the projected light / dark pattern appear to be characteristically different from each other. I understand that.
- the pattern projection unit 12 changes the light / dark pattern to a light / dark pattern 12i having a narrower stripe width than the light / dark pattern 12h.
- the light and dark pattern in the chemical solution 15, the light and dark pattern on the top of the chemical solution 15, and the projected light and dark pattern 12i are striped so that they can be distinguished from each other.
- the captured image information 19 is captured again by the imaging camera 14 and acquired by the image input unit 11a. That is, in the chemical solution 15 of (1) in FIG.
- the repetition cycle of the striped bright and dark patterns is changed (the stripes of the striped bright and dark patterns).
- the pattern is changed so that a plurality (preferably three or more) of bright or dark stripes in the bright / dark pattern can be seen in the chemical solution 15.
- the light / dark pattern 12h is changed to the light / dark pattern 12i so that three dark portions and two bright portions can be seen.
- a plurality of patterns are prepared in advance, and the pattern is changed according to the medicine container 16 and used, or the pattern is projected by adjusting the width of the pattern stripes. Possible methods. In the case of projection, it is conceivable to prepare a plurality of patterns in advance and select and use them according to the medicine container 16.
- (3) to (5) of FIG. 6B show the respective captured image information 19 obtained by projecting the same bright and dark pattern 12a from the back of the drug containers 16-1, 16-2, 16-3 having different diameters.
- FIG. The same drug solution 15 is contained in each drug container 16 of (3) to (5) in FIG. 6B.
- the diameter of the drug containers 16-1, 16-2, 16-3 increases from the small diameter to the standard diameter, and increases from the standard diameter to the large diameter. It can be seen that the appearance of the striped light-dark pattern is different.
- the light and dark patterns 12a, 12h, and 12i are striped patterns of two colors (for example, white and black). By making the pattern two colors, it becomes easier to determine the state of the pattern change, and the continuity feature appears more strongly in the refraction image of the striped pattern depending on the shape of the medicine container 16. Thereby, it is possible to accurately determine that the type or / and size (shape) of the drug solution 15 and / or the drug container 16 is correct.
- the position of the liquid surface 15a or / and the bottom portion 16d (bottom surface 16e) is clarified by determining the position in the stripe direction in which the light and dark pattern of the captured image information 19 changes greatly in the diameter direction of the container. Can do.
- (1) and (2) of FIG. 7A are the situations where the light and dark patterns 12a, 12h, and 12i similar to (1) and (2) of FIG. 6A are used, and the drug container 16 having a diameter slightly larger than the standard. -4 is illustrated.
- the refractive index of the drug solution 15 in the drug container 16-4 is large, and a stripe pattern may not appear in the bright and dark pattern in the drug solution 15.
- the bright / dark pattern 12h at the time of capturing the reference image is changed to the bright / dark pattern 12i to narrow the width of the projected bright / dark pattern stripes.
- the same striped light / dark pattern is generated even at the time of determination, and the captured image information 19 is again obtained.
- the image is captured by the imaging camera 14 and acquired by the image input unit 11a.
- (3) to (5) in FIG. 7B are obtained by projecting the same pattern 12a from the back of the drug container 16 containing the drug solutions 15-1, 15-2, and 15-3 having different refractive indexes. It is a figure which shows the captured image information.
- medical agent container 16 in (3) to (5) of FIG. 7B is the same diameter.
- the refractive index of the striped light-dark pattern increases as the refractive index of the chemical solution 15 increases from a low refractive index to a high refractive index standard and from a refractive index standard to a high refractive index. You can see how it looks different.
- FIG. 8 is a diagram showing captured image information 19 acquired by the image input unit 11a when using the light and dark patterns 12k and 12m in which the light and dark pattern 12a is displayed in color.
- (1) of FIG. 8 is a diagram showing the captured image information 19 when a similar color display is used for the light and dark pattern 12k.
- (2) of FIG. 8 is a diagram showing the captured image information 19 when complementary color display is used for the light and dark pattern 12m.
- FIG. 9 shows an example of a flowchart when color display of a striped pattern is used.
- the similar color is a color in which the direction represented by the hue circle is within a certain range.
- a color or the like whose direction represented by the color correlation is within a range of ⁇ 30 deg is a similar color.
- the complementary color is a color in which the direction represented by the hue circle is within a certain range centered on the position opposite to 180 deg.
- a color or the like whose direction represented by the color correlation is within a range of 180 deg ⁇ 30 deg is a complementary color.
- the bright and dark pattern 12a projected from the back surface of the drug container 16 containing the drug solution 15 is set as a black and white stripe pattern (step S201).
- captured image information captured by the imaging camera 14 using this light / dark pattern 12a is acquired as comparison source image information (step S202).
- a striped light / dark pattern 12k of the same color as the determination target drug solution 15 and the determination target drug container 16 is projected, and the captured image information 19 is acquired by the image input unit 11a (step S203).
- the state of pattern change is determined by a combination of colors suitable for the type or / and material of the drug solution 15 and / or drug container 16. It becomes easy to do. Therefore, the type or / and shape of the drug solution 15 and / or drug container 16 can be determined more accurately.
- the image matching unit 11d determines whether the captured image has a lower contrast than the comparison source image (step S204). At this time, when the image matching unit 11d determines that the contrast of the captured image is not lower than that of the reference image, the process proceeds to an error output step (step S299), and the error ends (step S119). When the image matching unit 11d determines that the contrast of the captured image is lower than that of the comparison source image, the process proceeds to step S205.
- step S205 the striped light / dark pattern 12m of color display having a complementary color relationship with the determination target drug solution 15 and the determination target drug container 16 is based on the information on the determination target drug solution 15 and the determination target drug container 16. Are projected from the pattern projection unit 12 (step S205).
- the image matching unit 11d determines whether or not the contrast is lower than that of the comparison source image (step S206). As a result, when the image matching unit 11d determines that the contrast does not improve compared to the comparison source image, the process proceeds to an error output step (step S299), and the error ends (step S119).
- Step S207 the high-contrast captured image information 19 is acquired, and the step is completed.
- the colors of the two striped patterns projected in steps S203 and S205 have a complementary color relationship.
- the pattern change becomes clear and fine changes can be determined. That is, since the colors of the two stripe patterns are complementary to each other, the type or / and shape of the drug solution 15 and / or drug container 16 can be determined more accurately. Specifically, it is possible to more clearly determine the change in the light / dark pattern near the liquid surface 15a or / and near the bottom 16d.
- FIG. 10A and FIG. 10B are schematic configuration diagrams of a chemical determination device 20 of another modification according to the first embodiment of the present invention.
- FIG. 10A is a front view of a chemical determination device 20 of another modification.
- FIG. 10B is a side view seen from the direction of the arrow 20a in FIG. 10A.
- the chemical determination device 20 includes a pattern projection unit 12, a placement unit 13, an imaging camera 14, and an image processing unit 11.
- the pattern projection unit 12 has a horizontally long shape and that a plurality of drug containers 16 are arranged on a horizontally long mounting table 13a. And it differs from the chemical
- the imaging camera 14 of the drug solution determination apparatus 20 captures the light and dark patterns projected on the plurality of drug containers 16 by the support member 214G supporting the imaging camera 14 reciprocating along the guide rail 22 in the direction of the arrow 21.
- the image information 19 can be taken.
- the amount of the chemical solution 15 can be more accurately determined, and the types and / or shapes of the plurality of chemical solutions 15 and / or the plurality of drug containers 16 can be accurately determined at a time.
- the medicine container 16 can be collectively imaged without moving the imaging camera 14.
- FIG. 11A and 11B are schematic configuration diagrams of a chemical liquid determination device 40 according to the second embodiment of the present invention.
- FIG. 11A is a front view of the chemical determination device 40.
- FIG. 11B is a side view of the chemical determination device 40 viewed from the direction of the arrow 40a in FIG. 11A.
- the chemical determination apparatus 40 has a configuration partially different from the chemical determination apparatuses 10 and 20 according to the first embodiment described above.
- the chemical determination device 40 includes a pattern projection unit 12, a placement unit 13, an imaging camera 14, and an image processing unit 11.
- the syringe 30 integrated with the medicine container 16 is supported by the four support columns 41 a of the syringe support portion 41 included in the placement portion 13.
- the image processing unit 11 is configured in the same manner as in FIG. 1B of the first embodiment, and includes an image input unit 11a, an information input unit 11b, an image selection unit 11c, an image matching unit 11d, and a storage unit 11e. is doing.
- the image input unit 11a is connected to the imaging camera 14, and the captured image information 19 captured by the imaging camera 14 is input thereto.
- the information input unit 11b is input with drug information to be determined from the operator, that is, drug information including at least information regarding the types of the drug solution 15 and the drug container 16, and stores the drug information in the storage unit 11e.
- the database (DB) 17 is a database arranged in the chemical determination device 40 or a database arranged outside the chemical determination device 40 and connectable via a communication line such as the Internet.
- the image selection unit 11c selects reference image information 18 that is input in advance and serves as a determination reference from the information input unit 11b or the database 17 based on information on the chemical solution to be determined from an operator who uses the chemical determination device. And get.
- the image matching unit 11d compares the reference image information 18 acquired by the image selection unit 11c with the captured image information 19 input to the image input unit 11a.
- the image matching unit 11d determines that the reference image information 18 and the captured image information 19 are the same image information, thereby determining the type or / and the drug solution 15 and / or the drug container 16. The shape is identified.
- the type or / and shape of the drug solution 15 and / or the shape of the drug container 16 can be accurately determined.
- the placement unit 13 holds the syringe 30 in which the injection needle 32 is inserted into the drug container 16 by the syringe support unit 41 in an integrated state with the drug container 16. is doing.
- the pattern projection unit 12 projects a light and dark pattern 31 d onto the medicine container 16 and the syringe 30 in an integrated state.
- the striped pattern 31 b is for the drug container 16
- the striped pattern 31 c is for the syringe 30.
- This configuration makes it possible to accurately determine the type or / and shape of the drug solution 15 and / or drug container 16 even when the drug solution 15 is sucked into the syringe 30 from the drug container 16.
- the image matching unit 11d illustrated in FIG. 1B integrates the reference image in order to determine that the reference image information 18 and the captured image information 19 of the medicine container 16 and the syringe 30 are the same image information.
- Information 18 and captured image information 19 are used.
- the reference image information 18 and the captured image information 19 of the medicine container 16 and the reference image information 18 and the captured image information 19 of the syringe 30 may be determined to be the same image information.
- the type or / and shape of the drug solution 15 or / and the drug container 16 can also be determined that the drug solution 15 in the drug container 16 is reliably sucked into the syringe 30. Whether or not the drug solution 15 in the drug container 16 is reliably sucked into the syringe 30 is determined from changes in the drug solution amounts inside the drug container 16 and the syringe 30.
- FIG. 12 is a diagram illustrating an example of the captured image information 31 of the syringe 30 and the medicine container 16 in a state in which the medicine liquid 15 is sucked by the medicine determination device 40 of the second embodiment.
- FIG. 13 projects the striped patterns 31 b and 31 c on the syringe 30 integrated with the drug container 16 via the needle 32 of the syringe 30 to detect the liquid level 33 a of the drug solution 33 in the syringe 30.
- An example of a flowchart at the time is shown.
- the striped pattern 31 b projected toward the medicine container 16 the light and dark pattern 34 a that has passed through the medicine container 16, and the chemical solution 15 is imaged as a different pattern from the light and dark pattern 34 b that has passed through 15.
- the pattern changes in a complicated manner in the boundary region between these patterns.
- the position of the liquid surface 15a or / and the bottom 16d (bottom surface 16e) can be detected by detecting the region where the pattern changes in a complicated manner.
- a striped pattern 31 c projected onto the syringe 30 a light / dark pattern 35 a transmitted through the syringe 30, and a light / dark pattern 35 b transmitted through the chemical solution 33.
- the pattern changes in a complicated manner in the boundary region between these patterns.
- the position of the liquid surface 33a and / or the tip part 30a of the syringe 30 can be detected by detecting the region where the pattern changes in a complicated manner.
- step S300 weighing is started (step S300). Then, a striped pattern 31b is projected from behind the drug container 16, and the initial liquid level 15a in the drug container 16 is detected based on the position where the pattern changes greatly. ) Is measured by the chemical determination device 40 (step S301).
- Step S302 When the chemical liquid 33 is not sucked into the syringe 30, the position of the gasket surface 30b is detected.
- step S303 in order to suck the drug solution 33 from the drug container 16 by the syringe 30, the plunger 30c of the syringe 30 is moved by a predetermined amount to drive the syringe 30 (step S303).
- step S304 the liquid level 15a of the drug container 16 at this time is detected by the image matching unit 11d (step S304), and the liquid level position difference A from the liquid level 15a of the drug container 16 in the initial state is calculated by the image matching unit 11d. .
- the liquid level position difference A from the image matching unit 11d and the inner diameter information of the medicine container 16 input from the database 17 or the information input unit 11b via the image selection unit 11c are used to calculate the suction fluid amount SA. 43 (step S305).
- the calculation unit 43 receives the output information from the image matching unit 11d and the output information from the image selection unit 11c.
- the liquid level 33a of the syringe 30 at this time is detected by the image matching unit 11d (step S306), and the liquid level position difference B from the liquid level 33a of the syringe 30 in the initial state is calculated by the image matching unit 11d.
- the suction liquid amount SB is calculated by the calculation unit 43. (Step S307).
- step S308 it is determined whether the amount of the chemical liquid sucked from the drug container 16 and the amount of the chemical liquid sucked into the syringe 30 are equal within a predetermined error range. Judgment by That is, the difference between the suction fluid amount SA and the suction fluid amount SB calculated by the calculation unit 43 and the standard liquid amount in the needle input from the database 17 or the information input unit 11b via the image selection unit 11c is predetermined.
- the liquid amount determination unit 44 determines whether the error is within the error range (step S308). Therefore, the output information from the calculation unit 43 and the output information from the image selection unit 11c are input to the liquid amount determination unit 44.
- step S309 If the liquid volume determination unit 44 determines that the difference between the suction liquid volume SA and the suction liquid volume SB and the standard liquid volume in the needle is within a predetermined error range, the process proceeds to step S309, and the suction liquid volume SB is set to the intra-needle volume The liquid volume to which the standard liquid volume has been added is output from the liquid volume determination unit 44 of the chemical liquid determination device 40, and the measurement is completed (step S311).
- step S308 if the liquid volume determination unit 44 determines that the difference between the suction liquid volume SA, the suction liquid volume SB, and the in-needle standard liquid volume is outside the predetermined error range, the process proceeds to step S310, where After outputting an error from the determination apparatus 40 (step S310), the error ends (step S119).
- the amount of the drug solution sucked from the drug container 16 and the amount of the drug solution sucked into the syringe 30 can be accurately measured.
- the left halves of the light and dark pattern 12a of the pattern projection unit 12 are similar colors. Are used, and the right half of the light and dark pattern 12a is a two-color striped pattern in a complementary color relationship.
- the light / dark pattern of the two-color striped pattern having a similar color relationship and the light / dark pattern of the two-color striped pattern having a complementary color relationship may be switched. Also good.
- the evaluation value is lower than a reference evaluation value in which the light and dark pattern 12a is a black and white two-color striped pattern. Further, in the two-color striped pattern having a complementary color relationship, the evaluation value is higher than the reference evaluation value. In this case, it is important that at least one or two stripes can be detected on each of the left and right sides. By using such a pattern, it is possible to determine the color of the shoulder 16c of the drug container 16, that is, the color of the drug container 16 in step S105B of FIG.
- step S106B the determination of the color of the peripheral portion of the bottom portion 16c of the drug container 16, that is, the determination of both the color of the drug container 16 and the color of the drug solution 15 can be performed. it can. Furthermore, by using such a pattern, it is possible to determine the color of the peripheral portion of the liquid surface 15a, that is, the color of both the color of the drug container 16 and the color of the drug solution 15 in step S109. . Since the appearance is different depending on the similar color or complementary color of the medicine container 16, the judgment of the color of the medicine container 16 and the color of the medicine liquid 15 is effective in determining the type and amount of the medicine container 16 and the medicine liquid 15. is there.
- the stripes are not limited to being vertical but may be slanted and not parallel to the liquid surface 15a. This is because it is difficult to detect the liquid level 15a with stripes parallel to the liquid level 15a.
- the image is not limited to a horizontal image, and may be a vertical image.
- the shoulder portion 16c and the bottom portion 16d may be included in one vertical image.
- the shoulder portion 16c it is preferable to image at least from above the drug container 16 or from the lateral direction of the drug container 16.
- the chemical determination apparatus and the chemical determination method of the present invention it is possible to significantly reduce the work load of a nurse or pharmacist in a hospital or the like by accurately determining the type or / and shape of the chemical or / and the drug container. In addition, work mistakes can be prevented, which is useful.
- the chemical determination apparatus and the chemical determination method of the present invention can be applied not only to medical fields such as hospitals but also to industrial fields (such as agriculture or industry) using biochemicals and the like.
Landscapes
- General Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- Biochemistry (AREA)
- Health & Medical Sciences (AREA)
- General Physics & Mathematics (AREA)
- Immunology (AREA)
- Pathology (AREA)
- Medical Preparation Storing Or Oral Administration Devices (AREA)
- Image Analysis (AREA)
- Investigating Or Analysing Materials By Optical Means (AREA)
- Image Processing (AREA)
Abstract
Description
内部に薬液を有すると共に透過性を有する薬剤容器を載置する載置部と、
前記薬剤容器を透過した前記明暗のパターンを撮像画像情報として撮像する撮像カメラと、
データベースから判定の基準となる基準画像情報を取得し、前記基準画像情報と前記撮像画像情報とを比較して前記薬液又は前記薬剤容器の種類を判定する画像処理部と、を備える薬液判定装置を提供する。
データベースから判定の基準となる基準画像情報を取得し、
前記基準画像情報に基づいて決定された明暗のパターンを、前記載置部に載置された前記薬剤容器の背面から投影し、
前記明暗のパターンを前記薬剤容器を透過させて観察して撮像画像情報として撮像し、
前記基準画像情報と前記撮像画像情報とを比較して、前記薬液又は前記薬剤容器の種類を判定する、薬液判定方法を提供する。
図1Aは、本発明の第1実施形態にかかる薬液判定装置10を示す斜視図である。図1Bは、薬液判定装置10の画像処理部11を示すブロック図である。
図11A及び図11Bは、本発明の第2実施形態にかかる薬液判定装置40の概略構成図である。図11Aは、薬液判定装置40の正面図である。図11Bは、図11Aの矢印40aの方向から見た薬液判定装置40の側面図である。
Claims (17)
- 明暗のパターンを投影するパターン投影部と、
内部に薬液を有すると共に透過性を有する薬剤容器を載置する載置部と、
前記薬剤容器を透過した前記明暗のパターンを撮像画像情報として撮像する撮像カメラと、
データベースから判定の基準となる基準画像情報を取得し、前記基準画像情報と前記撮像画像情報とを比較して前記薬液又は前記薬剤容器の種類を判定する画像処理部と、を備える
薬液判定装置。 - 前記撮像カメラで前記薬剤容器の肩部を少なくとも撮像して前記撮像画像情報を取得する
請求項1に記載の薬液判定装置。 - 前記基準画像情報及び前記撮像画像情報は、それぞれ、前記薬剤容器のみを透過して撮像された画像情報と前記薬剤容器及び前記薬液を透過して撮像された画像情報とを含む情報である
請求項1又は2に記載の薬液判定装置。 - 前記基準画像情報及び前記撮像画像情報は、それぞれ、前記薬液の液面と前記液面の上部及び下部とを含む画像情報である
請求項1又は2に記載の薬液判定装置。 - 前記薬剤容器の底部と隣接する前記載置部の一部は、透明な部材又は空洞であり、
前記基準画像情報及び前記撮像画像情報は、それぞれ前記薬剤容器の前記底部と前記底部の上部及び下部とを含む画像情報である
請求項4に記載の薬液判定装置。 - 前記載置部は、前記薬液が充填された前記薬剤容器に加えて、前記薬剤容器に注射針を挿入したシリンジが、前記薬剤容器と一体化した状態で載置され、
前記パターン投影部は、一体化した状態の前記薬剤容器と前記シリンジとに前記明暗のパターンを投影する
請求項1又は2に記載の薬液判定装置。 - 前記明暗のパターンは、水平方向と交差する方向沿いの2色の縞状のパターンである
請求項1又は2に記載の薬液判定装置。 - 前記2色の縞状のパターンの色は、互いに同系色の関係にある
請求項7に記載の薬液判定装置。 - 前記2色の縞状のパターンの色は、互いに補色の関係にある
請求項7に記載の薬液判定装置。
- 判定対象である薬液を内部に有すると共に透過性を有する薬剤容器を載置部に載置し、
データベースから判定の基準となる基準画像情報を取得し、
前記基準画像情報に基づいて決定された明暗のパターンを、前記載置部に載置された前記薬剤容器の背面から投影し、
前記明暗のパターンを前記薬剤容器を透過させて観察して撮像画像情報として撮像し、
前記基準画像情報と前記撮像画像情報とを比較して、前記薬液又は前記薬剤容器の種類を判定する
薬液判定方法。 - 前記撮像画像情報が、前記薬剤容器の肩部を含む画像情報である
請求項10に記載の薬液判定方法。 - 前記基準画像情報及び前記撮像画像情報は、それぞれ前記薬液の液面と前記液面の上部及び下部とを含む画像情報である
請求項10又は11に記載の薬液判定方法。 - 前記基準画像情報及び前記撮像画像情報は、それぞれ前記薬剤容器のみを透過して撮像された画像情報と、前記薬剤容器及び前記薬液を透過して撮像された画像情報とを含む情報である
請求項10又は11に記載の薬液判定方法。 - 前記薬剤容器の底部と隣接した前記載置部の一部は、透明な部材又は空洞であり、
前記基準画像情報及び前記撮像画像情報は、前記薬剤容器の底部と前記底部の上部及び下部とを含む画像情報である
請求項12に記載の薬液判定方法。 - 前記明暗のパターンは、水平方向と交差する方向沿いの2色の縞状のパターンである
請求項10又は12に記載の薬液判定方法。 - 前記2色の縞状のパターンの色は、互いに補色の関係にある
請求項15に記載の薬液判定方法。 - 前記2色の縞状のパターンの色は、互いに補色の関係にある
請求項15に記載の薬液判定方法。
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2012515762A JP5260793B2 (ja) | 2010-05-20 | 2011-05-19 | 薬液判定装置及び薬液判定方法 |
US13/387,818 US20120127290A1 (en) | 2010-05-20 | 2011-05-19 | Liquid medicine identification apparatus and liquid medicine identification method |
EP11783288A EP2573547A1 (en) | 2010-05-20 | 2011-05-19 | Drug solution determination device and drug solution determination method |
CN201180003078.3A CN102472707B (zh) | 2010-05-20 | 2011-05-19 | 药液判定装置及药液判定方法 |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2010115994 | 2010-05-20 | ||
JP2010-115994 | 2010-05-20 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2011145351A1 true WO2011145351A1 (ja) | 2011-11-24 |
Family
ID=44991469
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2011/002797 WO2011145351A1 (ja) | 2010-05-20 | 2011-05-19 | 薬液判定装置及び薬液判定方法 |
Country Status (5)
Country | Link |
---|---|
US (1) | US20120127290A1 (ja) |
EP (1) | EP2573547A1 (ja) |
JP (1) | JP5260793B2 (ja) |
CN (1) | CN102472707B (ja) |
WO (1) | WO2011145351A1 (ja) |
Cited By (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2017106924A (ja) * | 2012-05-14 | 2017-06-15 | ガウス サージカル, インコーポレイテッドGauss Surgical, Inc. | 流体キャニスタ中の血液成分量を測定するシステム及び方法 |
JP2018080990A (ja) * | 2016-11-16 | 2018-05-24 | 群馬県 | 濃度測定システム |
JP2018525169A (ja) * | 2015-08-28 | 2018-09-06 | バイエル・ヘルスケア・エルエルシーBayer HealthCare LLC | シリンジ流体充填検証および自動注入器システム機構の画像認識のためのシステムおよび方法 |
US10424060B2 (en) | 2012-07-09 | 2019-09-24 | Gauss Surgical, Inc. | Method for estimating blood component quantities in surgical textiles |
US10426356B2 (en) | 2011-07-09 | 2019-10-01 | Gauss Surgical, Inc. | Method for estimating a quantity of a blood component in a fluid receiver and corresponding error |
US10528782B2 (en) | 2011-07-09 | 2020-01-07 | Gauss Surgical, Inc. | System and method for estimating extracorporeal blood volume in a physical sample |
JP2020050528A (ja) * | 2014-02-28 | 2020-04-02 | アイシーエム エアポート テクニクス オーストラリア プロプライエタリー リミテッドICM Airport Technics Australia Pty Ltd | 荷物処理ステーションおよびそのシステム |
US10641644B2 (en) | 2012-07-09 | 2020-05-05 | Gauss Surgical, Inc. | System and method for estimating an amount of a blood component in a volume of fluid |
US10789710B2 (en) | 2015-05-15 | 2020-09-29 | Gauss Surgical, Inc. | Methods and systems for characterizing fluids from a patient |
US10863933B2 (en) | 2012-05-14 | 2020-12-15 | Gauss Surgical, Inc. | System and methods for managing blood loss of a patient |
WO2021010277A1 (ja) * | 2019-07-16 | 2021-01-21 | 富士フイルム富山化学株式会社 | 薬剤識別装置、薬剤識別方法及びプログラム |
US11109941B2 (en) | 2017-01-02 | 2021-09-07 | Gauss Surgical, Inc. | Tracking surgical items with prediction of duplicate imaging of items |
US11229368B2 (en) | 2017-01-13 | 2022-01-25 | Gauss Surgical, Inc. | Fluid loss estimation based on weight of medical items |
US11504037B2 (en) | 2015-05-15 | 2022-11-22 | Gauss Surgical, Inc. | Systems and methods for assessing fluids from a patient |
Families Citing this family (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
USD1031029S1 (en) | 2003-11-25 | 2024-06-11 | Bayer Healthcare Llc | Syringe plunger |
US9514131B1 (en) | 2010-05-30 | 2016-12-06 | Crisi Medical Systems, Inc. | Medication container encoding, verification, and identification |
US10492991B2 (en) | 2010-05-30 | 2019-12-03 | Crisi Medical Systems, Inc. | Medication container encoding, verification, and identification |
CN103226814B (zh) * | 2013-04-02 | 2015-09-30 | 湖南大学 | 一种基于医药视觉检测机器人图像校正的药瓶异物检测方法 |
US10806852B2 (en) | 2014-03-19 | 2020-10-20 | Bayer Healthcare Llc | System for syringe engagement to an injector |
US10378949B2 (en) | 2014-06-10 | 2019-08-13 | Bayer Healthcare Llc | Syringe with indicator float |
DE102014220598B4 (de) * | 2014-10-10 | 2023-07-13 | Krones Aktiengesellschaft | Inspektionsvorrichtung und Verfahren zur Durchlichtinspektion von Behältern |
GB2538539A (en) * | 2015-05-20 | 2016-11-23 | Airbus Operations Ltd | Measuring surface of a liquid |
US10532166B2 (en) | 2016-07-08 | 2020-01-14 | Bayer Heatlhcare Llc | System and method for identifying a fill volume of a fluid chamber |
CN107041843B (zh) * | 2017-02-09 | 2021-03-26 | 深圳市卫邦科技有限公司 | 药品抽吸控制方法及装置 |
CN106964022B (zh) * | 2017-03-13 | 2023-05-26 | 西南交通大学 | 输液监控装置 |
US10751259B1 (en) * | 2017-10-09 | 2020-08-25 | Banpil Photonics, Inc. | Smart bottle system and methods thereof |
CN113301883A (zh) * | 2019-02-08 | 2021-08-24 | 富士胶片富山化学株式会社 | 药剂识别系统、药剂识别装置、药剂识别方法以及程序 |
US11435215B2 (en) * | 2019-11-14 | 2022-09-06 | Pixart Imaging Inc. | Electric pot and liquid level determining method which can determine liquid level and solid height by light with different wave lengths |
CR20220648A (es) | 2020-06-18 | 2023-07-03 | Bayer Healthcare Llc | Sistema y método para el acoplamiento del émbolo de la jeringa con un inyector |
DE102022130665A1 (de) | 2022-11-21 | 2024-05-23 | Endress+Hauser Conducta Gmbh+Co. Kg | Verfahren und Sensor zur optischen Messung von Messgrößen von transparenten Medien |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0645845Y2 (ja) * | 1988-10-03 | 1994-11-24 | トヨタ自動車株式会社 | 表面平滑度自動検査装置 |
JPH11194096A (ja) * | 1997-10-29 | 1999-07-21 | Toyota Motor Corp | 塗装面の評価方法および塗装面の検査装置 |
JP2000241229A (ja) | 1999-02-18 | 2000-09-08 | Moritex Corp | 界面位置検出装置及び方法 |
JP2002267612A (ja) * | 2001-03-13 | 2002-09-18 | Hitachi Eng Co Ltd | 透明容器等の充填液体中の異物検査装置及びシステム |
JP2004354100A (ja) * | 2003-05-27 | 2004-12-16 | Matsushita Electric Works Ltd | 容器内液体中の異物検出方法及びその装置 |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS5546172A (en) * | 1978-09-29 | 1980-03-31 | Kirin Brewery Co Ltd | Detector for foreign material |
JPS6362757U (ja) * | 1986-10-15 | 1988-04-25 | ||
JPH0645845B2 (ja) * | 1987-03-12 | 1994-06-15 | 株式会社神戸製鋼所 | 高強度磁気デイスク用Alサブストレ−トの製造方法 |
NO322775B1 (no) * | 2004-09-24 | 2006-12-11 | Tomra Systems Asa | Anordning og fremgangsmate for detektering av et medium |
CN101501693B (zh) * | 2005-05-16 | 2011-09-14 | 智能医院体系有限公司 | 自动化药房配药系统 |
EP1931973B1 (en) * | 2005-09-09 | 2008-12-31 | Sacmi Cooperativa Meccanici Imola Societa' Cooperativa | Method and apparatus for visually inspecting an object |
CN101592621A (zh) * | 2009-05-18 | 2009-12-02 | 济南佳美视觉技术有限公司 | 一种使用折射栅格光源检验玻璃瓶表面缺陷及内部缺陷的自动光学检验设备 |
-
2011
- 2011-05-19 CN CN201180003078.3A patent/CN102472707B/zh not_active Expired - Fee Related
- 2011-05-19 US US13/387,818 patent/US20120127290A1/en not_active Abandoned
- 2011-05-19 JP JP2012515762A patent/JP5260793B2/ja not_active Expired - Fee Related
- 2011-05-19 EP EP11783288A patent/EP2573547A1/en not_active Withdrawn
- 2011-05-19 WO PCT/JP2011/002797 patent/WO2011145351A1/ja active Application Filing
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0645845Y2 (ja) * | 1988-10-03 | 1994-11-24 | トヨタ自動車株式会社 | 表面平滑度自動検査装置 |
JPH11194096A (ja) * | 1997-10-29 | 1999-07-21 | Toyota Motor Corp | 塗装面の評価方法および塗装面の検査装置 |
JP2000241229A (ja) | 1999-02-18 | 2000-09-08 | Moritex Corp | 界面位置検出装置及び方法 |
JP2002267612A (ja) * | 2001-03-13 | 2002-09-18 | Hitachi Eng Co Ltd | 透明容器等の充填液体中の異物検査装置及びシステム |
JP2004354100A (ja) * | 2003-05-27 | 2004-12-16 | Matsushita Electric Works Ltd | 容器内液体中の異物検出方法及びその装置 |
Cited By (35)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11670143B2 (en) | 2011-07-09 | 2023-06-06 | Gauss Surgical, Inc. | Method for estimating a quantity of a blood component in a fluid receiver and corresponding error |
US11783503B2 (en) | 2011-07-09 | 2023-10-10 | Gauss Surgical Inc. | Systems and method for estimating extracorporeal blood volume in a physical sample |
US11222189B2 (en) | 2011-07-09 | 2022-01-11 | Gauss Surgical, Inc. | System and method for estimating extracorporeal blood volume in a physical sample |
US10426356B2 (en) | 2011-07-09 | 2019-10-01 | Gauss Surgical, Inc. | Method for estimating a quantity of a blood component in a fluid receiver and corresponding error |
US10528782B2 (en) | 2011-07-09 | 2020-01-07 | Gauss Surgical, Inc. | System and method for estimating extracorporeal blood volume in a physical sample |
US10957179B2 (en) | 2011-07-09 | 2021-03-23 | Gauss Surgical, Inc. | Method for estimating a quantity of a blood component in a fluid receiver and corresponding error |
US11836915B2 (en) | 2012-05-14 | 2023-12-05 | Gauss Surgical Inc. | System and method for estimating a quantity of a blood component in a fluid canister |
US10282839B2 (en) | 2012-05-14 | 2019-05-07 | Gauss Surgical, Inc. | System and method for estimating a quantity of a blood component in a fluid canister |
JP2017106924A (ja) * | 2012-05-14 | 2017-06-15 | ガウス サージカル, インコーポレイテッドGauss Surgical, Inc. | 流体キャニスタ中の血液成分量を測定するシステム及び方法 |
US10706541B2 (en) | 2012-05-14 | 2020-07-07 | Gauss Surgical, Inc. | System and method for estimating a quantity of a blood component in a fluid canister |
US11712183B2 (en) | 2012-05-14 | 2023-08-01 | Gauss Surgical Inc. | System and methods for managing blood loss of a patient |
US10863933B2 (en) | 2012-05-14 | 2020-12-15 | Gauss Surgical, Inc. | System and methods for managing blood loss of a patient |
US10424060B2 (en) | 2012-07-09 | 2019-09-24 | Gauss Surgical, Inc. | Method for estimating blood component quantities in surgical textiles |
US10641644B2 (en) | 2012-07-09 | 2020-05-05 | Gauss Surgical, Inc. | System and method for estimating an amount of a blood component in a volume of fluid |
JP2020050528A (ja) * | 2014-02-28 | 2020-04-02 | アイシーエム エアポート テクニクス オーストラリア プロプライエタリー リミテッドICM Airport Technics Australia Pty Ltd | 荷物処理ステーションおよびそのシステム |
JP2022001482A (ja) * | 2014-02-28 | 2022-01-06 | アイシーエム エアポート テクニクス オーストラリア プロプライエタリー リミテッドICM Airport Technics Australia Pty Ltd | 荷物処理ステーションおよびそのシステム |
US11410311B2 (en) | 2015-05-15 | 2022-08-09 | Gauss Surgical, Inc. | Methods and systems for characterizing fluids from a patient |
US11504037B2 (en) | 2015-05-15 | 2022-11-22 | Gauss Surgical, Inc. | Systems and methods for assessing fluids from a patient |
US12002211B2 (en) | 2015-05-15 | 2024-06-04 | Gauss Surgical Inc. | Methods and systems for characterizing fluids from a patient |
US11727572B2 (en) | 2015-05-15 | 2023-08-15 | Gauss Surgical Inc. | Methods and systems for characterizing fluids from a patient |
US10789710B2 (en) | 2015-05-15 | 2020-09-29 | Gauss Surgical, Inc. | Methods and systems for characterizing fluids from a patient |
JP2018525169A (ja) * | 2015-08-28 | 2018-09-06 | バイエル・ヘルスケア・エルエルシーBayer HealthCare LLC | シリンジ流体充填検証および自動注入器システム機構の画像認識のためのシステムおよび方法 |
JP2022107632A (ja) * | 2015-08-28 | 2022-07-22 | バイエル・ヘルスケア・エルエルシー | シリンジ流体充填検証および自動注入器システム機構の画像認識のためのシステムおよび方法 |
JP2021100584A (ja) * | 2015-08-28 | 2021-07-08 | バイエル・ヘルスケア・エルエルシーBayer HealthCare LLC | シリンジ流体充填検証および自動注入器システム機構の画像認識のためのシステムおよび方法 |
JP7434409B2 (ja) | 2015-08-28 | 2024-02-20 | バイエル・ヘルスケア・エルエルシー | シリンジ流体充填検証および自動注入器システム機構の画像認識のためのシステムおよび方法 |
JP7092909B2 (ja) | 2015-08-28 | 2022-06-28 | バイエル・ヘルスケア・エルエルシー | シリンジ流体充填検証および自動注入器システム機構の画像認識のためのシステムおよび方法 |
US11790637B2 (en) | 2015-12-23 | 2023-10-17 | Gauss Surgical Inc. | Method for estimating blood component quantities in surgical textiles |
US11333545B2 (en) | 2015-12-23 | 2022-05-17 | Gauss Surgical, Inc. | System and method for estimating an amount of a blood component in a volume of fluid |
US11282194B2 (en) | 2015-12-23 | 2022-03-22 | Gauss Surgical, Inc. | Method for estimating blood component quantities in surgical textiles |
US11176663B2 (en) | 2015-12-23 | 2021-11-16 | Gauss Surgical, Inc. | Method for estimating blood component quantities in surgical textiles |
JP2018080990A (ja) * | 2016-11-16 | 2018-05-24 | 群馬県 | 濃度測定システム |
US11922646B2 (en) | 2017-01-02 | 2024-03-05 | Gauss Surgical Inc. | Tracking surgical items with prediction of duplicate imaging of items |
US11109941B2 (en) | 2017-01-02 | 2021-09-07 | Gauss Surgical, Inc. | Tracking surgical items with prediction of duplicate imaging of items |
US11229368B2 (en) | 2017-01-13 | 2022-01-25 | Gauss Surgical, Inc. | Fluid loss estimation based on weight of medical items |
WO2021010277A1 (ja) * | 2019-07-16 | 2021-01-21 | 富士フイルム富山化学株式会社 | 薬剤識別装置、薬剤識別方法及びプログラム |
Also Published As
Publication number | Publication date |
---|---|
CN102472707B (zh) | 2014-03-12 |
JPWO2011145351A1 (ja) | 2013-07-22 |
CN102472707A (zh) | 2012-05-23 |
JP5260793B2 (ja) | 2013-08-14 |
US20120127290A1 (en) | 2012-05-24 |
EP2573547A1 (en) | 2013-03-27 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP5260793B2 (ja) | 薬液判定装置及び薬液判定方法 | |
US11568537B2 (en) | Enhanced platen for pharmaceutical compounding | |
US7499581B2 (en) | Vision system to calculate a fluid volume in a container | |
US9128051B2 (en) | Optical imaging system for air bubble and empty bag detection in an infusion tube | |
US10739364B2 (en) | Liquid surface inspection device, automated analysis device, and processing device | |
EP2641085B1 (en) | Method and apparatus for detecting foam on a liquid surface in a vessel | |
EP3044537B1 (en) | Contact lens inspection system and method | |
CN101839832B (zh) | 维氏硬度检测系统及方法 | |
JP2006276003A (ja) | 分注装置 | |
KR20220101101A (ko) | 분석 측정을 수행하기 위한 방법 및 장치 | |
TW201404878A (zh) | 自動快速分析生物細胞的裝置和其相關的方法 | |
JP2019015541A (ja) | レンズ測定装置 | |
US20160274366A1 (en) | Device, System And Method For The Visual Alignment Of A Pipettor Tip And A Reference Point Marker | |
JP2013142589A (ja) | 被検査体の検査装置及び検査方法 | |
CN105044086A (zh) | 一种压力蒸汽灭菌化学指示卡变色判断设备 | |
JP5370077B2 (ja) | 薬液混合支援システムおよび薬液混合検査方法 | |
EP3989823B1 (en) | Determination of a concentration of an analyte in a bodily fluid by using a mobile device with a camera | |
JP6358040B2 (ja) | 内径測定装置の最適測定位置の検出方法 | |
CN115931868A (zh) | 表面检查装置、存储介质及表面检查方法 | |
CN203550907U (zh) | 高精度尺寸检测装置 | |
CN113592803B (zh) | 一种螺纹圈数测量方法和装置 | |
JP2000308618A (ja) | 視線計測方法、視線計測装置 | |
JP2013183857A (ja) | 水薬調剤装置 | |
KR101587560B1 (ko) | 차량용 광각 렌즈 모듈의 검사 장치 | |
CN110174646A (zh) | 相对位置检测方法及检测系统 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 201180003078.3 Country of ref document: CN |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2012515762 Country of ref document: JP |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 11783288 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2011783288 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 13387818 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |