WO2022092147A1 - 識別装置、識別方法、およびプログラム - Google Patents
識別装置、識別方法、およびプログラム Download PDFInfo
- Publication number
- WO2022092147A1 WO2022092147A1 PCT/JP2021/039642 JP2021039642W WO2022092147A1 WO 2022092147 A1 WO2022092147 A1 WO 2022092147A1 JP 2021039642 W JP2021039642 W JP 2021039642W WO 2022092147 A1 WO2022092147 A1 WO 2022092147A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- information
- stored
- recognition
- display
- collation
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims description 96
- 238000003860 storage Methods 0.000 claims abstract description 137
- 238000012850 discrimination method Methods 0.000 claims 1
- 238000007726 management method Methods 0.000 description 108
- 238000012545 processing Methods 0.000 description 27
- 238000010586 diagram Methods 0.000 description 25
- 238000005520 cutting process Methods 0.000 description 18
- 230000007717 exclusion Effects 0.000 description 12
- 238000004891 communication Methods 0.000 description 8
- 238000004519 manufacturing process Methods 0.000 description 7
- 238000013473 artificial intelligence Methods 0.000 description 6
- 230000005484 gravity Effects 0.000 description 6
- 229910000831 Steel Inorganic materials 0.000 description 5
- 238000013528 artificial neural network Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 5
- 239000010959 steel Substances 0.000 description 5
- 238000007796 conventional method Methods 0.000 description 4
- 239000000284 extract Substances 0.000 description 4
- 238000003384 imaging method Methods 0.000 description 4
- 238000012015 optical character recognition Methods 0.000 description 4
- 230000000295 complement effect Effects 0.000 description 3
- 230000014509 gene expression Effects 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 229910052799 carbon Inorganic materials 0.000 description 2
- 239000000470 constituent Substances 0.000 description 2
- 238000010438 heat treatment Methods 0.000 description 2
- 230000010365 information processing Effects 0.000 description 2
- 229910052760 oxygen Inorganic materials 0.000 description 2
- 230000007704 transition Effects 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 238000003708 edge detection Methods 0.000 description 1
- 229910052739 hydrogen Inorganic materials 0.000 description 1
- 238000012804 iterative process Methods 0.000 description 1
- 238000010330 laser marking Methods 0.000 description 1
- 230000000873 masking effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 229910052757 nitrogen Inorganic materials 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 229910052717 sulfur Inorganic materials 0.000 description 1
- 238000011282 treatment Methods 0.000 description 1
- 229910052721 tungsten Inorganic materials 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/11—Region-based segmentation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0004—Industrial image inspection
- G06T7/001—Industrial image inspection using an image reference approach
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/60—Analysis of geometric attributes
- G06T7/62—Analysis of geometric attributes of area, perimeter, diameter or volume
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/25—Determination of region of interest [ROI] or a volume of interest [VOI]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
- G06V10/761—Proximity, similarity or dissimilarity measures
Definitions
- the present invention relates to an identification device, an identification method, and a program, and is particularly suitable for use in identifying an article.
- Patent Document 1 after masking a part or all of the product number related to the product displayed on the screen of the crane machine, the crane operator visually confirms the serial number of the product and inputs the confirmed product number by voice or characters. It is disclosed to do.
- the technique described in Patent Document 1 is premised on the fact that the crane operator can visually recognize the serial number of the product. Therefore, when a part of the information displayed on the product is indistinguishable or difficult due to rubbing, dirt, etc., the crane operator may not be able to recognize the serial number of the product. Also, the information displayed on the product cannot be identified unless the crane operator is near the product.
- Patent Documents 2 to 6 there is a technique described in Patent Documents 2 to 6.
- the character string of the collation destination is stored, the character string of the collation source is recognized from the collation source image, and the character string of the collation source and the character string of the collation destination are collated.
- the recognition process and the collation process are executed a plurality of times by using a plurality of temporally continuous collation source images.
- the article information in which the overall image information representing the overall appearance of each article is associated with each article is stored in advance. Then, the image obtained by capturing a plurality of collation target articles is collated with the article information.
- a plurality of article candidates included in the article candidate group are group-based. Collate with.
- the collation condition in this collation is a condition that the number of collation target articles extracted from the article candidate group and the number of each article candidate included in the plurality of article candidate groups are mutually matched.
- attribute information representing a predetermined type of numerical value related to an article is associated with the article information for each article, and the attribute information is extracted and collated for each article candidate.
- Patent Document 4 includes, for a plurality of articles, overall image information showing the overall appearance of each article, position information of a part of the appearance of each article, and attribute information of each article included in the part.
- the partial feature information is associated and stored. Then, the image of the article to be collated is collated with the whole image information of each article.
- a part of the image of the collation target article corresponding to the attribute information included in the partial feature information of the plurality of article candidates and the position information included in the partial feature information. And compare.
- the technique described in Patent Document 5 includes, for a plurality of articles, overall image information showing the overall appearance of each article, position information of a part of the appearance of each article, and attribute information of each article included in the part.
- the partial feature information is associated and stored. Then, the character information in the image of the collation target article matches the character information representing the content of the attribute information included in the partial feature information, and the position of the character information in the image in the image of the collation target article is captured.
- An article whose information matches the position information included in the partial feature information is extracted as a target article candidate. Then, from the extracted target article candidates, attribute-limited target article candidates including the types of attribute information preset in the partial feature information are extracted. Then, overall collation is performed based on the extracted overall image information of the attribute-limited target article candidate and the captured image.
- the present invention has been made in view of the above problems, and when the article is identified based on a captured image obtained by capturing the information displayed on the article, the information shown on the article is used.
- the purpose is to enable identification of the article even if it cannot be extracted correctly.
- the identification device of the present invention is an identification device for identifying an article, and is an image acquisition unit that acquires one or two or more captured images of a region containing the first information which is information displayed on the article. At least one of the recognition unit that recognizes at least one of the first information and the first recognition information that is the first information recognized by the recognition unit based on the captured image acquired by the image acquisition unit. Based on the collation unit that collates a part of the information with the first storage information that is the first information stored in advance in the storage medium as one of the storage information, and the collation result by the collation unit.
- the collation unit has a specific unit that identifies at least one candidate of the article, and the collation unit stores the recognition information that is partially different from the first recognition information and the information corresponding to the recognition information in a storage medium in advance. It is characterized in that it can be collated with the stored stored information.
- the identification method of the present invention is an identification method for identifying an article, which includes an image acquisition step of acquiring one or two or more captured images of a region containing the first information which is information displayed on the article. At least one of the recognition step of recognizing at least one of the first information and the first recognition information which is the first information recognized by the recognition step based on the captured image acquired by the image acquisition step. Based on the collation step of collating a part of the information with the first storage information which is the first information stored in advance in the storage medium as one of the storage information, and the result of the collation by the collation step.
- the collation step comprises a specific step of identifying at least one candidate for the article, and the collation step stores the recognition information partially different from the first recognition information and the information corresponding to the recognition information in a storage medium. It is characterized in that it can be collated with the stored information stored in advance.
- the program of the present invention is a program for causing a computer to execute a process for identifying an article, and is one or two or more captured images of a region containing the first information which is information displayed on the article.
- the image acquisition step of acquiring the image the recognition step of recognizing at least one of the first information based on the captured image acquired by the image acquisition step, and the first information recognized by the recognition step.
- a computer is made to execute a specific step of identifying at least one candidate of the article based on the result of collation by the step, and the collation step includes the recognition information partially different from the first recognition information and the recognition information. It is characterized in that it can be collated with the storage information stored in advance in the storage medium as the information corresponding to the recognition information.
- FIG. 1A is a diagram showing a first example of a display area and a display form for a plank.
- FIG. 1B is a diagram showing a second example of a display area and a display form for a plank.
- FIG. 1C is a diagram showing an example of a state in which a plurality of thick plates are stacked.
- FIG. 2A is a diagram showing a first example of display contents by stencil and engraving.
- FIG. 2B is a diagram showing a second example of display contents by stencil and engraving.
- FIG. 3 is a diagram showing an example of display contents by a label.
- FIG. 4 is a diagram showing an example of a functional configuration of the identification device.
- FIG. 5 is a diagram showing an example of a management table.
- FIG. 1A is a diagram showing a first example of a display area and a display form for a plank.
- FIG. 1B is a diagram showing a second example of a display area and a display form for
- FIG. 6 is a diagram showing an example of the original plank and the plank after cutting.
- FIG. 7 is a diagram showing an example of the position of the stencil and the marking in the article and the position of the component of each display item in the display by the stencil and the marking.
- FIG. 8 is a diagram showing an example of the position of the label in the article and the position of the component of each display item in the display by the label.
- FIG. 9A is a diagram showing a first example of information stored in the management table.
- FIG. 9B is a diagram showing a second example of information stored in the management table.
- FIG. 10 is a flowchart illustrating an example of processing of the identification device when creating and updating a management table.
- FIG. 11 is a flowchart illustrating an example of processing of the identification device when identifying a thick plate.
- FIG. 12 is a diagram showing an example of the hardware configuration of the identification device.
- the transport vessel then berths at the quay near the factory.
- the planks are unloaded from the transport ship and loaded onto transport vehicles (trucks, etc.).
- transport vehicles trucks, etc.
- the planks transported by the transport vehicle arrive at the factory, they are placed in the storage area in the factory.
- the planks placed in the storage area are placed in the warehouse after being subjected to heat treatment, cutting (gas cutting), and the like.
- the planks are then shipped from the factory to the consumer. In such a case, the plank can be identified at any time between the time when the plank is manufactured at the steel mill and the time before the plank is shipped to the customer at the factory.
- FIGS. 1A to 1B are views showing an example of a display area and a display form for a plank.
- the x-axis, y-axis, and z-axis shown in FIG. 1 indicate the relationship between the orientations of FIG. 1 and FIGS. 7 and 8 described later.
- FIG. 1A is a diagram showing a first example of a display area and a display form for a plank.
- the display area 101 is a stencil display area.
- the display area 102 is a display area by engraving.
- the display areas 101 and 102 exist on the plate surface of the thick plate.
- the broken lines shown in FIGS. 1A to 1C are virtual lines and are not actually displayed.
- the label (side label) 103 is attached to the side surface (thick portion) of the thick plate.
- FIG. 1B is a diagram showing a second example of a display area and a display form for a plank.
- the display area 111 is a stencil display area.
- the display area 112 is a display area by engraving.
- the display areas 111 and 112 exist on the plate surface of the plank.
- the label 113 is attached to the side surface (thick portion) of the thick plate.
- the arrangement of the display areas 101 and 111 by stencils, the display areas 102 and 112 by engraving, and the display areas by labels 103 and 113 differs depending on the steelworks and the like that manufacture the planks.
- the actual product management (management of the position of each plank) is performed based on at least one of the display by the stencil, the display by the engraving, and the display by the labels 103 and 113.
- the display area and display form for the plank are not limited to those shown in FIGS. 1A and 1B.
- the display area by the stencil and the display area by the engraving may be separated from each other, or the display area by the engraving may not be displayed.
- FIG. 1C is a diagram showing an example of a state in which a plurality of planks are stacked. As shown in FIG. 1C, it may not be possible to visually recognize the display by the stencil and the display by the engraving on the thick plate located below among the plurality of stacked thick plates. In this case, the actual product can be managed based on the display by the labels 123 and 133. Note that FIG. 1C illustrates a case where a plurality of thick plates are placed on top of each other so that the plate surface of the thick plate is parallel to the surface on which the thick plate is placed.
- the method of stacking the planks is not limited to such a method. For example, a plurality of planks may be placed on top of each other so that the plate surface of the planks is perpendicular to or close to the angle on which the planks are placed.
- FIG. 2A is a diagram showing a first example of display contents by stencil and engraving.
- FIG. 2B is a diagram showing a second example of display contents by stencil and engraving.
- the stencil display may include marks 201, 211, consumer names 202, 212, standards 203, 213, sizes 204, 214, ID 205, 215, consumer codes 206, 216, orders. Includes numbers 207, 217, and identification information 208, 218.
- the engraved display includes ID 209, 219.
- Marks 201 and 211 are marks indicating the manufacturer of the thick plate.
- Demander names 202 and 212 are information indicating consumers (purchasers) of planks.
- Standards 203 and 213 are information indicating the standard of the thick plate.
- the sizes 204 and 214 are information indicating the size (thickness x width x length) of the plank.
- ID 205, 215, 209, and 219 are information for uniquely identifying the plank, and in the examples shown in FIGS. 2A and 2B, they are plate numbers (identification numbers of the planks). Therefore, the same ID is not attached to different planks.
- the consumer code 206 and 216 are information specified by the manufacturer of the plank to be attached to the plank by the consumer.
- Order numbers 207 and 217 are part of a number for identifying a plank order from a consumer.
- Marks 201, 211, consumer names 202, 212, standards 203, 213, sizes 204, 214, ID 205, 215, 209, 219, consumer codes 206, 216, and order numbers 207, 217 are for planks.
- Information other than ID 205, 215, 209, and 219 may not be included in the stencil display and the engraved display.
- information other than the above-mentioned information may be included in the display by the stencil and the display by the stamp.
- a display item equivalent to a display item by a stencil for example, at least one of a mark, a consumer name, a standard, a size, a consumer code, an order information, and identification information
- a display item equivalent to a display item by a stencil for example, at least one of a mark, a consumer name, a standard, a size, a consumer code, an order information, and identification information
- the identification information 208 and 218 are dedicated information for identifying a thick plate (thick plate ID) by the identification device 400 described later.
- the identification information 208 and 218 a case where information having a high identification rate by character recognition processing is used is exemplified.
- Information with a high identification rate by character recognition processing includes, for example, A, B, D, E, F, G, H, K, M, N, S, W, X, Y, Z, 2, 3, 4, 5 , 6 and 8.
- the identification information does not have to be composed only of the information having a high identification rate by the character recognition process. This will be described later (see ⁇ Second variant >>). Further, it is preferable that the contents of the identification information 208 and 218 are different for each plate.
- 2A and 2B illustrate the case where the positions of the marks 201 and 211 are different and the sizes of the consumer names 202 and 212 are different.
- the number of digits of the consumer code 206 and 216 differs depending on the consumer
- the notation method of the standard 203 and 213 differs depending on the steelworks that manufacture the thick plate.
- the order numbers 207 and 217 may or may not be attached by the consumer.
- the content, position, and size of the stencil and the marking are different depending on the steelworks and consumers who manufacture the planks.
- the meaning of the same display item for the same plank is the same for the display by stencil and the display by engraving. Therefore, ID 205, 215 displayed by the stencil and ID 209, 219 displayed by engraving mean the same contents.
- 218 is information that can be identified by a person. Information that can be identified by a person means that the person can understand the meaning of the information when he / she sees the information.
- Information that requires machine encoding and decoding to create and read information is not human identifiable information.
- Information 208 and 218 include at least one of letters, numbers, and symbols as information that does not require machine decoding for reading, and does not include information that requires machine decoding for reading.
- FIG. 3 is a diagram showing an example of display contents by a label.
- the label display includes standard 301, ID 302, size 303, delivery date 304, consumer code 305, and identification information 306.
- the delivery date 304 is information indicating the delivery date of the plank.
- Standard 301, ID 302, size 303, consumer code 305, and identification information 306 are standard 203, 213, size 204, 214, ID 205, 215, 209, 219, consumer code 206, 216, and identification information 208, respectively. It is the same as 218.
- Information other than ID 302 may not be included in the label display.
- information other than the above-mentioned information may be included in the label display.
- the content, position, and size of the label label, as well as the stencil and engraved label will vary depending on the steelworks and consumers who manufacture the planks.
- the content that the same display item for the same plank means is the same for the display by stencil, the display by engraving, and the display by label. Therefore, when the display by the stencil and the marking shown in FIGS. 2A and 2B and the display by the label shown in FIG. 3 are performed on the same thick plate, the ID 205 and 215 displayed by the stencil and the marking are displayed. ID 209 and ID 302 and ID 302 displayed by the label mean the same contents. Further, the standard 203 and 213 displayed by the stencil and the standard 301 displayed on the label mean the same contents. The size 303 and the consumer code 305 also mean the same contents as the sizes 204 and 214 and the consumer code 206 and 216, respectively.
- standards 203, 213, ID 205, 215, 209, 219, sizes 204, 214, consumer codes 206, 216, and identification information 208, 218 are information managed by the plank manufacturer. be. Therefore, the standard 301, the ID 302, the size 303, the consumer code 305, and the identification information 306 are also information managed by the plate manufacturer. Further, the delivery date 304 of the thick plate is also information managed by the manufacturer of the thick plate. Further, the standard 301, the ID 302, the size 303, the delivery date 304, the consumer code 305, and the identification information 306 are information that can be identified by a person.
- information 208 and 218 may be attached to the plank separately.
- the identification information 208 and 218 may be attached to the thick plate by a stencil, or may be attached to the thick plate by a method other than the stencil (for example, handwriting).
- the thick plate (thick plate ID) having the above display is automatically recognized by using the identification device 400.
- FIG. 4 is a diagram showing an example of a functional configuration of the identification device 400.
- the hardware of the identification device 400 is realized by using, for example, a CPU, a ROM, a RAM, an HDD, an information processing device having various interfaces, or dedicated hardware.
- FIG. 5 is a diagram showing an example of a management table 500 managed by the identification device 400. Before explaining an example of the function of the identification device 400, the management table 500 will be described.
- the stored information stored in the management table 500 includes information managed by the manufacturer of the plate. However, a part of the stored information stored in the management table 500 may be information that can be utilized also in distribution and the like.
- the information managed by the thick plate manufacturer is the information set or acquired by the thick plate manufacturer.
- the information managed by the plate manufacturer includes information that allows an operator who is an employee of the plate manufacturer to understand the meaning of the information. More specifically, the information managed by the thick plate manufacturer is, for example, information created by the thick plate manufacturer and stored in the management table 500.
- the information in the same column is the information for the same plank (the column below the same No.
- the storage information about the stencil is stored in the column of the stencil.
- the ID column of the stencil column storage information indicating the contents and positions of the components of ID 205 and 215 included in the display by the stencil and storage information indicating other attributes of the components are stored.
- the components of ID 205 and 215 included in the display by the stencil refer to individual information constituting the display items such as characters, numbers, symbols, and marks. Further, even if the storage information indicating other attributes of the component is stored in association with the content and position of the component in the identification device 400 (storage unit 403) or an external device capable of communicating with the identification device 400. good.
- the consumer name column of the stencil column storage information indicating the contents and positions of the components of the consumer names 202 and 212 included in the display by the stencil is stored.
- the size column of the stencil column storage information indicating the contents and positions of the components of sizes 204 and 214 included in the display by the stencil is stored.
- the standard column of the stencil column storage information indicating the contents and positions of the components of the standards 203 and 213 included in the display by the stencil is stored.
- the consumer code column of the stencil column storage information indicating the contents and positions of the components of the consumer code 206 and 216 included in the display by the stencil is stored.
- the order number column of the stencil column storage information indicating the contents and positions of the components of order numbers 207 and 217 included in the display by the stencil is stored.
- the identification information column of the stencil column storage information indicating the contents and positions of the components of the identification information 208 and 218 included in the display by the stencil is stored.
- the contents of the display items that may be displayed as the display items displayed by the stencil are also stored in the management table 500.
- the "" under the identification information column in the stencil column of FIG. 5 indicates this. Also, the display item itself may be added and / or deleted.
- the storage information regarding the marking is stored in the column for marking.
- the ID column of the engraved column storage information indicating the content and position of the component of ID 209 and 219 included in the display by engraving and storage information indicating other attributes of the component are stored.
- the storage information indicating other attributes of the component may be associated with the content and position of the component in the identification device 400 (storage unit 403) or an external device capable of communicating with the identification device 400.
- the contents of the display items that may be displayed as the display items in the marking display are also stored in the management table 500.
- the "" under the ID column in the engraved column of FIG. 5 indicates this.
- the display item itself may be added and / or deleted.
- the storage information about the label is stored in the field of the label.
- the ID column of the label column storage information indicating the content and position of the component of ID 302 included in the display by the label and storage information indicating other attributes of the component are stored. Even if the storage information indicating other attributes of the component is stored in association with the content and position of the component in the identification device 400 (storage unit 403) or an external device capable of communicating with the identification device 400. good.
- the size column of the label column storage information indicating the content and position of the component of size 303 included in the display by the label is stored.
- the standard column of the label column storage information indicating the contents and positions of the components of the standard 301 included in the display by the label is stored.
- the delivery date column of the label column storage information indicating the contents and positions of the components of the delivery date 304 included in the display by the label is stored.
- the consumer code column of the label column storage information indicating the content and position of the component of the consumer code 305 included in the display by the label is stored.
- the identification information column of the label column storage information indicating the contents and positions of the components of the identification information 306 included in the display by the label is stored.
- the contents of the display items that may be displayed as the display items displayed by the labels are also stored in the management table 500 as storage information.
- the "" under the consumer code column in the label column of FIG. 5 indicates this.
- the display item itself may be added and / or deleted.
- the stored information stored in the non-actual product display column of the management table 500 will be described.
- the column of the position in the article storage information indicating the position of the display area when a predetermined position on the plank is set as the origin (reference) is stored.
- the stencil column of the column of the position in the article storage information indicating the position of the display area by the stencil when a predetermined position on the plate is set as the origin (reference) is stored.
- the engraved column of the column of the position in the article storage information indicating the position of the display area by engraving when a predetermined position on the plank is set as the origin (reference) is stored.
- the label column of the column of the position in the article storage information indicating the position of the display area by the label when a predetermined position on the plank is set as the origin (reference) is stored.
- the weight column storage information indicating the weight of the plank is stored.
- the size column storage information indicating the size of the plate (for example, thickness ⁇ width ⁇ length) is stored.
- the size stored in the size column of the actual product display column is used for collation with the sizes 204, 214, and 303 recognized by the character recognition process as described later.
- the size stored in the size column of the non-actual product display column is used for collation with the measured value such as the weight of the thick plate. Specifically, the size stored in the size column of the non-actual product display column may be compared with the actual size.
- Storage information indicating the position of the plank is stored in the storage position column.
- storage information indicating the position of the thick plate grasped by the operator by managing the actual product and the position of the thick plate grasped by using various sensors such as a load sensor is stored in the storage position column.
- stored information indicating the date and time (timing determined by the date and time) when the plank was placed at the current storage position is stored.
- the parent ID column stored information indicating the ID of the original plank is stored. Plates may be cut at the factory.
- the original plank refers to the plank before cutting. Therefore, when the storage information indicating the ID of the original plate is stored in the column of the parent ID, the stored information stored in the column of the same column as the column of the parent ID is the plate after cutting. It becomes the memory information for.
- FIG. 6 is a diagram showing an example of the original plank and the plank after cutting.
- FIG. 6 illustrates a case where the thick plate 600 is cut to produce the thick plates 610, 620, 630, and 640.
- indications are given to the planks 610, 620, 630, 640, respectively.
- FIG. 6 shows display areas 611, 621, 631, 641 for the planks 610, 620, 630, 640.
- Information including the IDs of the planks 610, 620, 630, and 640 is displayed in the display areas 611, 621, 631, and 641.
- a stencil is used for display.
- at least one of the engraved display and the label display may be performed.
- the display in the display areas 611, 621, 631 and 641 may be handwritten.
- the display areas 611, 621, 631, and 641 are displayed in the actual product display column for the thick plates 610, 620, 630, and 640 in the management table 500. Storage information indicating the contents and positions of the components of the display items displayed in is stored.
- the storage information indicating the ID of the planks 600 is stored.
- the case where the information on the thick plate after cutting is managed as a new row (No.) in the management table 500 shown in FIG. 5 is exemplified.
- information on the thick plate after cutting is stored in the columns of the actual product display and the non-actual product display.
- Information on the thick plate after cutting is obtained, for example, by acquiring an image captured image of the display performed before or after cutting by the image acquisition unit 411 described later, and recognizing the captured image by the recognition unit 412 described later. To be acquired.
- Information about the plank after cutting does not necessarily have to be obtained in this way.
- the operator may specify information about the plate after cutting from the manufacturing conditions, operate the user interface of the identification device 400, and input the specified information into the identification device 400. Further, by combining both, information on the thick plate after cutting may be acquired.
- the plank 610 may be cut to produce yet another plurality of planks.
- information indicating the ID of the plate 610 is stored in the column of the parent ID for the other plurality of plate plates.
- the column of the parent ID for the plate 610 storage information indicating the ID of the plate 600 is stored.
- the arrangement of the thick plates obtained by tracing the information stored in the column of the parent ID is referred to as a cut plate series of the thick plates.
- the cut plate series of the thick plate 610 is the thick plates 600 and 610.
- the column of the parent ID of each plank for example, not only the information indicating the ID of the latest plank but also the IDs of all the planks belonging to the cut series are shown so that the cut board series can be known.
- the stored information may be stored. In this case, any ID defined by the manufacturer is used.
- the information of the ID of the plate 610, 620, 630, 640 additionally displayed in the display areas 611, 621, 631, 641 of the plate 610, 620, 630, 640 and the parent of the ID.
- the information of the planks 610, 620, 630, 640 and the information of the original planks 600 can be linked.
- the information added to the planks 610, 620, 630, 640 is used not only to identify the planks, but also to make transitions for each plank (ID).
- the information in the non-actual item display column only when the information of the item is acquired, the information is stored as storage information in the column of the item, and when the information of the item is not acquired, the information of the item is not acquired. No information is stored in the field of the item. Also, at the same position, the plank with the registration time earlier does not move earlier than the plank with the registration time later (that is, if there is overlap of the boards, the board underneath does not suddenly disappear. not). When the plank is moved to a new storage place, the storage information indicating the storage position is stored in the storage position column, and the storage information indicating the date and time when the plate is placed in the storage position is stored in the registration time column.
- the ID of the captured image including the display areas 101 and 111 by the stencil, the display areas 102 and 112 by the engraving, and the ID of the captured image including the display area by the labels 103 and 113 are shown.
- Stored information is stored.
- the identification device 400 (storage unit 403) or an external device capable of communicating with the identification device 400 is associated with the ID and is recognized by the captured image specified by the ID and the captured image by character recognition processing or the like. Storage information indicating the components of each display item is stored in advance. Since the captured image stored in this way is collated with the captured image acquired by the image acquisition unit 411 described later, the captured image is captured in the best possible condition. Is preferable.
- the display contents of the display areas 101 and 111 by the stencil, the display areas 102 and 112 by the engraving, and the display areas by the labels 103 and 113 can be visually recognized as clearly as possible, and the thick plate can be visually recognized. It is preferable that the captured image is imaged in a state where the surface is not contaminated as much as possible and the lighting conditions at the time of imaging are as suitable as possible for imaging.
- FIG. 7 is a diagram showing an example of the position of the stencil and the marking in the article and the position of the component of each display item in the display by the stencil and the marking.
- FIG. 7 illustrates a case where the display position shown in FIG. 1A and the content shown in FIG. 2A are displayed by a stencil and an engraving.
- the origin is the vertex 104 shown in FIG.
- the direction along the width direction of the plate is the positive direction of the x-axis and the length of the plate from the vertex 104.
- the xy coordinates with the direction along the vertical direction as the positive direction of the y-axis represent the position in the article of the stencil and the marking and the position of the component of each display item by the stencil and the marking.
- the circumscribed circle is determined by the position of the maximum value of the x-axis, the minimum value of the x-axis, the maximum value of the y-axis, and the minimum value of the y-axis.
- the xy coordinates of the two vertices on the diagonal line are set as the positions in the article of the stencil.
- FIG. 7 shows that the xy coordinates (Ws10, Ls10) and (Ws11, Ls11) of the two vertices 701a and 701b of the circumscribed rectangle 701 are the positions in the article of the stencil.
- the circumscribed rectangle is assumed to be a rectangle parallel to the coordinate axes (x-axis and y-axis in the example shown in FIG. 7) representing the position inside the article.
- the xy coordinates of the position of the center of gravity (or the center of gravity) of the component (character, number, symbol, mark) of each display item in the display by the stencil is set as the position of the component.
- the x-axis coordinates of 5, 6, 3, 4, 9, 7, 7, 0, and 1, which are the components of ID 205 included in the display by the stencil are Ws1, Ws2, Ws3, Ws4, and Ws5, respectively.
- Ws6, Ws7, Ws8, Ws9 indicating that the y-axis coordinates are all Ls1.
- the position of each component of each display item displayed by the stencil is represented by xy coordinates.
- the display by engraving is the maximum value of x-axis, the minimum value of x-axis, the maximum value of y-axis, and the minimum of y-axis among the positions of the components of each display item in the display by engraving.
- the xy coordinates of the two vertices 711a and 711b on the diagonal line are set as the positions in the article of the stencil.
- the xy coordinates of the position of the center of gravity (or the center of gravity) of the component of each display item in the display by engraving are set as the position of the component.
- FIG. 8 is a diagram showing an example of the position of the label in the article and the position of the component of each display item in the display by the label.
- FIG. 8 illustrates a case where labels are displayed at the display positions shown in FIG. 1A and the display contents shown in FIG.
- the apex 105 shown in FIG. 1A is set as the origin, and the direction along the width direction of the thick plate from the apex 105 is the positive direction of the x-axis, and the thick plate plate.
- the x-z coordinates with the direction along the thickness direction as the positive direction of the z-axis represent the position in the article of the label and the position of the component of each display item by the label.
- the label has a rectangular shape.
- the xz coordinates of the two vertices on the diagonal line are set as the positions in the article of the label.
- the xz coordinate of the position of the center of gravity (or the center of gravity) of the component of each display item displayed by the label is set as the position of the component.
- FIG. 8 it is shown that the x-z coordinates of the two vertices 801a and 801b of the label are the positions in the article of the label.
- the contents, positions, and other attributes of the components of ID 205 and 215 included in the display by the stencil are included.
- the positions of the components are (Ws1, Ls1), (Ws2, Ls1), (Ws3, Ls1), (Ws4, Ls1), (Ws5). , Ls1), (Ws6, Ls1), (Ws7, Ls1), (Ws8, Ls1), (Ws9, Ls1) are stored.
- FIG. 9A illustrates a case where the identification target exclusion category, the size, the number of dots, and the identification limit pixel number are included as other attributes of the components of ID 205 and 215 included in the display by the stencil.
- the identification target exclusion category is information for identifying some components excluded from the identification target, Y indicates that the component is not excluded from the identification target, and N is excluded from the identification target. Show that.
- the component excluded from the target of identification is, for example, a component excluded from the target of collation by the collation unit 413 described later. In this case, the component recognized by the recognition unit 412 is excluded from the collation target by the collation unit 413. However, the components excluded from the identification target are not limited to such components.
- the component excluded from the object of identification may be, for example, a component excluded from the object of recognition by the recognition unit 412.
- the size is information indicating the size of the component
- L indicates that the size of the component is relatively large
- M indicates that the size of the component is medium
- S Indicates that the size of the component is relatively small.
- the number of dots is information indicating the number of dots constituting the component.
- the number of dots D5 indicates the number of dots constituting the content "5" of the component.
- the identification limit pixel number is information indicating a range of the number of pixels that can be identified with respect to the captured image.
- the identification limit number of pixels N5 indicates a range of the number of pixels that can identify the content "5" of the component.
- the information such as these identification target exclusion categories is information on the attributes of the components, and is information that cannot be known to a person who is not a party involved in the display by the stencil.
- the information such as the identification target exclusion classification is stored in the management table 500 as the storage information used for identifying the plate. Information such as the identification target exclusion classification used for identifying these planks can be added / corrected, for example, in the flowchart of FIG. 10 described later.
- the identification target exclusion category is Y and that the number of pixels is equal to or greater than the identification limit pixel is an example of the conditions for recognition accuracy.
- the component whose identification target exclusion category is Y and the component whose number of pixels of the captured image is within the range of the identification limit pixels are examples of information satisfying the condition of recognition accuracy.
- the number of pixels of the captured image is the value in the column of the number of identification limit pixels (N5, N6, The components within the range of N3, N4, N ⁇ ) are information that satisfy the condition for recognition accuracy.
- the other display item column of the actual product display column also stores information indicating the content, position, and other attributes of the component of the display item. ..
- the information indicating the position of the component of each display item in the engraved column is the xy coordinate as well as the information indicating the position of the component of each display item in the stencil column.
- the information indicating the position of the component of each display item in the label column is not the xy coordinate but the xx coordinate.
- the information indicating the position inside the article of the stamp is xy coordinates, like the information indicating the position inside the article of the stencil.
- the information indicating the position of the label in the article is not the xy coordinate but the xx coordinate.
- the operator may operate the user interface of the identification device 400 to input information to be stored in each column of the management table 500 into the identification device 400. .. Further, the identification device 400 may receive information to be stored in each column of the management table 500 from an external device such as a computer that manages the operation of the factory.
- the information stored in the actual product display column of the management table 500 and the information stored in the article position, weight, size, and parent ID column in the non-actual product display column are displayed after the plate is displayed. In some cases it is set, and in other cases it is set before the marking on the plank is made. Therefore, when the information to be stored in the column is determined before the display on the plate is performed, the identification device 400 acquires, for example, the information to be stored in the column as described above. , Store in each column of the management table 500.
- the identification device 400 acquires the information to be stored in the column at the timing when the information to be stored in the column is obtained, and stores the information in each column of the management table 500.
- FIG. 10 is a flowchart illustrating an example of processing of the identification device 400 when creating and updating the management table 500.
- FIG. 11 is a flowchart illustrating an example of processing of the identification device 400 when identifying a thick plate. An example of the function of the identification device 400 will be described with reference to FIGS. 10 and 11.
- step S1001 of FIG. 10 the information acquisition unit 401 determines whether or not the information to be stored in the management table 500 has been input to the identification device 400.
- the information input to the identification device 400 in step S1001 of FIG. 10 includes all the information to be stored in the management table 500 for identifying the plate, and the information obtained before executing the flowchart of FIG. , Information obtained during the execution of the flowchart of FIG. 11 and information obtained after the execution of the flowchart of FIG. 11 is included.
- the information stored in the actual product display column and the information in the non-actual product display in-article position / weight / size column may be input to the identification device 400 before executing the flowchart of FIG.
- these information may be input to the identification device 400 after the execution of the flowchart of FIG. 11 is started.
- the identification information 208, 218, 306 may be input to the identification device 400 at any timing as long as the timing is after the identification information 208, 218, 306 is obtained.
- the information in the fields of the non-actual product display column, the registration time, the image ID, and the parent ID is input to the identification device 400 after the information is obtained. Further, when the information is stored in the column of the parent ID, the information becomes the information of the plank after cutting, so that a new column (No.) is added in the management table 500 of FIG. The information to be stored is stored in the column. As described above, the process according to the flowchart of FIG. 10 is assumed to be executed even while the flowchart of FIG. 11 is being executed.
- step S1001 if the information to be stored in the management table 500 is not input to the identification device 400, the process according to the flowchart of FIG. 10 ends.
- step S1002 when the information to be stored in the management table 500 is input to the identification device 400, the process of step S1002 is executed.
- step S1002 the update unit 402 stores the information determined to have been input to the identification device 400 in step S1001 as storage information in the corresponding column of the management table 500 stored in the storage unit 403. If the information is not stored in the corresponding column, the information determined to have been input to the identification device 400 in step S1001 is newly registered in the management table 500.
- the update unit 402 may leave or delete the information already stored in the corresponding column. Then, the process according to the flowchart of FIG. 10 is completed. Further, the update of the stored information in the management table 500 is executed not only in the flowchart of FIG. 10 but also in the process according to the flowchart of FIG. 11 (see step S1110 of FIG. 11).
- step S1101 of FIG. 11 the image acquisition unit 411 acquires an captured image.
- the first captured image and the second captured image are acquired.
- the first captured image is an captured image including display areas 101 and 111 by stencil and display areas 102 and 112 by engraving.
- the second captured image is an captured image including the display area according to the labels 103 and 113.
- the captured image acquired in step S1101 is captured using, for example, an image pickup device installed in a factory, an image pickup device on hand by an operator (worker), or an image pickup device provided in an unmanned aerial vehicle (drone). ..
- the image pickup device on hand by the operator (worker) may be, for example, an information terminal device (tablet terminal, smartphone, or the like) provided with the image pickup device. If the image pickup device installed in the factory cannot image the desired area, the operator (worker) may perform the position and image pickup condition (angle of view, etc.) of the image pickup device prior to the processing in step S1101. Is adjusted.
- the recognition unit 412 recognizes the display information displayed on the plank from the captured image acquired in step S1101.
- the display information includes a component of the display item in the display by the stencil, a component of the display item in the display by the stamp, and a component of the display item in the display by the label.
- the display information is an example of the first information.
- the first information is information displayed on the article (thick plate in the example of the present embodiment).
- the recognition unit 412 as the display information included in the captured image (first captured image or second captured image) acquired in step S1101, is a component of a display item in the display by stencil and engraving, or , Recognize the components of the display item in the label display. Since the process of recognizing the contents of the components of the display item can be realized by, for example, a technique using known OCR (Optical character recognition), detailed description thereof will be omitted here.
- the process of step S1102 may be realized by using a technique using AI (Artificial Intelligence) such as NN (Neural Network) or a technique using a combination of AI and OCR (so-called AI OCR).
- the NN is configured so that, for example, when a captured image is input to the input layer of the NN, information indicating a component is output from the output layer of the NN.
- the recognition unit 412 cannot recognize the content of the component of the display item (the component is not any of the predetermined characters, numbers, symbols, and marks). If it is recognized), the recognition result is that the component cannot be recognized. Further, the recognition unit 412 may calculate the reliability of the recognition result.
- the recognition unit 412 specifies the display format according to the contents of the recognized components. For example, in FIG. 2A, the mark 201 is in the upper left, and the character size of the customer name 202, which is a subsequent character string, is the same as the other characters. On the other hand, in FIG. 2B, the character size of the consumer name 212, which is the character string on the first line with the mark 211 on the upper right, is about half that of the other characters.
- the recognition unit 412 can specify the display format from the possible formats and specify the display item by using such a feature.
- the process of step S1103 is executed without executing the processes of steps S1101 and S1102. Will be done.
- the display information recognized in step S1102 is also referred to as recognition information.
- the display information recognized in step S1102 is an example of the first recognition information.
- the information acquisition unit 401 acquires and recognizes the non-display information that is not displayed on the plate.
- the non-display information is information to be collated with the information stored in each column of the non-actual product display and the image ID column of the management table 500 shown in FIG. A specific example of the hidden information will be described below.
- the non-display information recognized in step S1103 is also referred to as recognition information.
- the hidden information is an example of the second information.
- the second information is information that is not displayed on the article (thick plate in this embodiment). Further, the non-display information recognized in step S1103 is an example of the second recognition information.
- the information acquisition unit 401 derives the position of the display item.
- An example of a method in which the information acquisition unit 401 derives the position of a display item will be described.
- the information acquisition unit 401 performs edge detection processing based on the captured image acquired in step S1101, detects the edge of the thick plate, and identifies the region of the thick plate based on the detected result.
- the information acquisition unit 401 determines whether the specified region is the plate surface portion of the thick plate or the side surface (plate thickness) portion of the thick plate. This determination is realized, for example, based on the aspect ratio of the specified area.
- the information acquisition unit 401 determines that the captured image acquired in step S1101 is the first captured image.
- the information acquisition unit 401 determines that the captured image acquired in step S1101 is the second captured image.
- the information acquisition unit 401 detects the origin of the position in the article (predetermined position on the plank) in the first captured image.
- the information acquisition unit 401 is, for example, in the first captured image based on the positional relationship preset as the positional relationship between the display area by the stencil and the origin of the position in the article among the eight vertices of the rectangular parallelepiped plate.
- the origin of the position inside the article (predetermined position on the stencil) is derived.
- the following information may be preset in the identification device 400 as the positional relationship between the display area by the stencil and the origin of the position in the article.
- the apex on the lower left side of the display by the stencil is the article on the same surface as the display by the stencil.
- Information that it is the origin of the internal position may be preset in the identification device 400.
- the information acquisition unit 401 derives a position based on the origin of the position in the article in the first captured image as the position of the component of the display item in the display by the stencil and the position of the component of the display item in the display by engraving. ..
- the component of the display item is displayed by a stencil based on the information including at least one of the luminance value of the component of the display item and the distance between the components adjacent to each other. It is determined whether it is a component of the display item in the above or a component of the display item in the display by engraving.
- the identification device 400 determines, for example, whether the component of the display item is the component of the display item in the display by the stencil or the component of the display item in the display by the engraving as follows. You may judge. That is, the identification device 400 is a rectangle in which the positions of the components recognized as described above are specified by the information stored in the stencil column of the column of the position in the article in the column of the non-actual product display of the management table 500. Which rectangular area is closer to the area and which rectangular area of the rectangular area specified by the information stored in the engraved column of the item internal position column of the non-actual item display column of the management table 500. Is specified for each plank (for each column of the management table 500).
- the identification device 400 recognizes the positions of the components as described above by the information stored in the stencil column of the column of the position in the article in the column of the non-actual product display of the management table 500. When it is close to the specified rectangular area, it is determined that the component of the display item is the component of the display item in the display by the stencil. On the other hand, when the position of the component recognized as described above is close to the rectangular area specified by the information stored in the engraved column of the column of the position in the article in the column of the non-actual item display of the management table 500. The identification device 400 determines that the component of the display item is the component of the display item in the display by engraving.
- the component of the display item is the display item in the display by the stencil. It is not necessary to determine which of the constituent elements of the above and the constituent elements of the display item in the display by engraving.
- the information acquisition unit 401 detects the origin of the position inside the article (predetermined position on the plank) in the second captured image. Then, the information acquisition unit 401 derives a position based on the origin of the position in the article in the second captured image as the position of the component of the display item in the display by the label. The position of the component of the display item in the display by the label is derived in the same manner as the position of the component of the display item in the display by the stencil.
- the information acquisition unit 401 determines the position of the component of the display item in the display by the stencil, which is the maximum value of the x-axis, the minimum value of the x-axis, the maximum value of the y-axis, and the minimum value of the y-axis. Derive the position of the circumscribed rectangle to be determined.
- the information acquisition unit 401 uses the xy coordinates of the two vertices on the diagonal line among the four vertices of the derived circumscribed rectangle as the recognition information of the position in the article of the stencil.
- the information acquisition unit 401 determines the position of the component of the display item in the display by engraving, which is the maximum value of the x-axis, the minimum value of the x-axis, the maximum value of the y-axis, and the minimum value of the y-axis. Derive the position of the circumscribed rectangle to be determined.
- the information acquisition unit 401 uses the xy coordinates of the two vertices on the diagonal line among the four vertices of the derived circumscribed rectangle as the recognition information of the position in the article of the engraving.
- the information acquisition unit 401 determines the position of the component of the display item in the display by the label, which is the maximum value of the x-axis, the minimum value of the x-axis, the maximum value of the z-axis, and the minimum value of the z-axis. Derive the position of the circumscribed rectangle to be determined.
- the information acquisition unit 401 uses the x-z coordinates of the two vertices on the diagonal line among the four vertices of the derived circumscribed rectangle as the recognition information of the position in the article of the label.
- the information acquisition unit 401 acquires the ID of the thick plate and the measured value of the weight of the thick plate of the ID as recognition information of the weight of the thick plate.
- the information acquisition unit 401 acquires the ID of the thick plate and the measured value of the size of the thick plate of the ID as the recognition information of the size of the thick plate.
- the information acquisition unit 401 acquires information indicating the position of the image pickup device that has captured the captured image (first captured image or second captured image) acquired in step S1101 as recognition information of the storage position.
- the parent ID of the cut planks 610 to 640 is the ID of the original plank 600. It is automatically specified from the processing conditions. By inkjet, laser marking, or the like, the display area 611 to 641 is displayed including the IDs of the thick plates 610 to 640 after cutting. The display including the ID may be a handwritten display. Further, in the information acquisition unit 401, the image acquisition unit 411 acquires the captured image of the display areas 611 to 641, and the recognition unit 412 recognizes the captured image, so that the thick plates 610 to 640 are the same as the original thick plate 600. ID and the like may be acquired.
- the association between the IDs of the planks 610 to 640 and the parent ID, which is the ID of the original planks 600, may be performed automatically or manually. Further, the indication for the original plank 600 may remain on the planks 610 and 620 after cutting.
- the information acquisition unit 401 can also acquire the ID included in the display for the original plate 600 as the recognition information of the parent ID. It should be noted that such an ID is stored, for example, in the column of the position in the article (the column of the stencil and the column of the stamp) in the column of the non-actual product display of the management table 500 among the components recognized in step S1102. It is specified based on a component that is not included in any of the rectangular areas specified by the information.
- the information acquisition unit 401 acquires the ID of the captured image (first captured image or second captured image) acquired in step S1101 as recognition information of the image ID.
- the information acquisition unit 401 acquires, for example, an ID added to the captured image acquired by the image acquisition unit 411 as recognition information of the image ID of the captured image.
- the non-display information (recognition information) recognized in step S1103 is collated with the stored information stored in each column of the non-actual product display of the management table 500 shown in FIG. 5 in step S1106 described later. Further, the captured images (first captured image and second captured image) acquired in step S1101 are among the IDs stored in the image ID column of the management table 500 shown in FIG. 5 in step S1106 described later. It is collated with the captured image stored in association with the same ID as the ID acquired together with the captured image.
- the process of step S1104 is executed. If the information acquisition unit 401 does not acquire the hidden information even after a predetermined time has elapsed from the start of the process of step S1103, the process of step S1104 is executed without executing the process of step S1103. To.
- the collation unit 413 selects one unselected collation target among the collation targets.
- the collation target selected in step S1104 is information in each column (each item) of the management table 500 shown in FIG.
- the collation target selected first is the information in the column of the actual product display. Further, it is preferable that the collation target to be selected first is the information defined for each plate (information unique to each plate). If the recognition information of the collation target matches the storage information stored in the management table 500, the recognition information of the collation target is the thick plate of the column (No.) in which the storage information is stored. This is because the information of is specified without using other recognition information.
- the case where the ID in the stencil column (ID included in the display by the stencil) is the collation target to be selected first is illustrated.
- the ID in the engraved column or the ID in the label column may be the first selected collation target.
- the selection order of the collation target is not particularly limited. In this embodiment, a case where collation targets are selected one by one in order from the upper column of the management table 500 is illustrated.
- step S1105 the collation unit 413 acquires the information whose accuracy is guaranteed from the recognition information of the collation target selected in step S1104.
- the information whose accuracy is guaranteed is information on components that are not excluded from the collation target due to the identification target exclusion category and the identification limit pixel number shown in FIG. 9A.
- the information whose accuracy is guaranteed which is an example of the information satisfying the condition of recognition accuracy, is a component that is not excluded from the collation target by the identification target exclusion category and the identification limit pixel number shown in FIG. 9A. It is not limited to the information of.
- the identification rate by character recognition processing such as 1, 7, 9, 0, C, I, L, O, P, Q, R, T, U, V, etc.
- the components that are said to be low are predetermined. In this case, the components other than the components whose identification rate by the character recognition process is low are the information whose accuracy is guaranteed.
- the accuracy is guaranteed for both the components that are not excluded from the collation target by the identification target exclusion category and the identification limit pixel number, and the components other than the components that are said to have a low identification rate by the character recognition process.
- Information may be used.
- the collation unit 413 may handle the components that could not be recognized in the process of step S1102 as the information whose accuracy is not guaranteed.
- the collation unit 413 collates the recognition information of the collation target selected in step S1104 with the stored information of the collation target.
- the stored information to be collated is selected one by one from each column (No. 1, 2, 3 ...) Of the management table 500. That is, the stored information collated with the recognition information of the collation target selected in step S1104 is each of the stored information stored in each column of the management table 500.
- the recognition information of the collation target is the recognition information for the same article (thick plate in the present embodiment) in any step S1106.
- the stored information to be collated is the stored information for a plurality of articles (thick plates in this embodiment) stored in the management table 500.
- the collation unit 413 stores only the information whose accuracy is guaranteed among the recognition information of the selected collation target. Match with.
- the collation unit 413 extracts a column (No.) in the management table 500 that stores stored information that matches the recognition information of the collation target selected in step S1104, and extracts information indicating the extracted column. Output to the specific unit 414.
- the collation unit 413 determines whether or not the recognition information of the collation target and the stored information of the collation target match.
- the recognition information to be collated is the information recognized in the process of step S1102 or S1103.
- the stored information to be collated is the information stored in the management table 500.
- the match means that there is a part in which the content and the order of the components of the recognition information of the collation target and the components of the stored information of the collation target are completely matched. ..
- the collation target is a part of the ID
- the part where the content and the arrangement order of the component of the recognition information of the collation target and the component of the storage information of the collation target completely match is the part. If so, it is assumed that they match.
- the contents of the components of the ID in the display by the stencil are 5, 6, 3, 4, 9, 7, ⁇ , 0, 1, and the order is 5, 6, from the left.
- the order is 3, 4, 9, 7,-, 0, 1. It is assumed that such information is stored in the ID column of the stencil column of the management table 500. Further, it is assumed that the information whose accuracy is not guaranteed is 0, 1, 7, and 9. Taking such a case as an example, when the collation target is all of the ID (when all the accuracy of the ID is guaranteed) and when the collation target is a part of the ID (part of the ID). Only when accuracy is guaranteed), a specific example will be described.
- the information in which 5, 6, 3, 4, 9, 7, ⁇ , 0, and 1 are arranged in this order from the left is the ID recognition information in the display by the stencil.
- the ID recognition information and the stored information in the display by the stencil match.
- the contents and order of the ID recognition information and storage information in the stencil display are It is assumed that they do not match.
- the collation target is a part of the ID
- the contents of the components whose accuracy is guaranteed among the components stored in the ID column of the stencil column in the actual product display column are 5, 6, and 3. 4, -, and the order is 5, 6, 3, 4, -from the left. Therefore, in the ID recognition information displayed by the stencil, 5, 6, 3, 4, and-are arranged in this order from the left, and there are two components between 4 and-and there are two components.
- the recognition information and the storage information of a part of the ID in the display by the stencil will match.
- the recognition unit 412 is a component that cannot be recognized by the process of step S1102, and a component whose reliability of the recognition result is equal to or less than the threshold value (for example, “0”, “1”, “7”, “9”. ) May be blank, and information indicating the result recognized in step S1102 may be configured. In this case, it becomes information indicating that the blank is out of the collation target.
- the collation unit 413 can execute collation for each component in the order in which the components are arranged. By outputting the collation result for each component by the output unit 415, the operator can easily confirm that the collation is performed correctly. In the example here, it is stored in the management table 500 that the ID has 9 digits.
- the size of the area where the components whose accuracy is not guaranteed or the number of components whose accuracy is not guaranteed are stored in, for example, the size column of the stencil column of the management table 500. It is specified based on the information provided and the information stored in the size column of the label column of the management table 500.
- the stored information in each column (each item) of the actual product display of the management table 500 is an example of the first stored information. Further, the stored information in each column (each item) of the non-actual product display of the management table 500 is an example of the second stored information.
- step S1104 When the collation target selected in step S1104 is the information in each column (each item) of the non-actual display of the management table 500 and the information in the image ID column of the management table 500, the accuracy is guaranteed. Information acquisition is not executed (the process of step S1105 is omitted). In this case, in step S1106, the collation unit 413 collates all the recognition information of the collation target selected in step S1104 with all the stored information of the collation target. However, the collation target selected in step S1104 is set with information whose accuracy is guaranteed for the information in each column of the non-actual product display of the management table 500 and the information in the image ID column of the management table 500. It may have been done.
- the information whose accuracy is guaranteed is a value within the range assumed as the value of the information in each column.
- the collation target selected in step S1104 is the information in each column of the non-actual display of the management table 500 (the information and the information in the image ID column of the management table 500), the accuracy is correct.
- the acquisition of the guaranteed information is performed.
- the recognition information of the storage position is information indicating the position of the image pickup device that has captured the captured image (first captured image or second captured image) acquired in step S1101.
- the storage information of the storage position is information indicating the position of the plank. Therefore, the collating unit 413 captured the position of the thick plate specified from the information indicating the position of the thick plate stored in the storage position column of the non-actual product display column and the captured image acquired in step S1101. It is determined whether or not the distance from the position of the image pickup device is equal to or less than the threshold value.
- the collation unit 413 determines that the recognition information and the storage information of the storage position match when the distance is equal to or less than the threshold value, and if not, the recognition information and the storage information of the storage position do not match. judge.
- the identification device 400 stores, for example, information indicating the position of the image pickup device in advance.
- the identification device 400 uses the position information detected by the GPS (Global Positioning System) of the information processing terminal of the image pickup device or the operator (worker) as the position of the image pickup device. You may get it and update it.
- the identification device 400 may acquire, for example, position information detected by using GPS provided in the unmanned aerial vehicle as the position of the image pickup device. ..
- the registration time collation is executed as follows.
- the plank having the shortest elapsed time among the planks having the same xy coordinate position is stacked on the top, so that it is displayed by a stencil. It can be considered that the regions 101 and 111 can be imaged. Therefore, when the captured image acquired in step S1101 is the first captured image (that is, when the captured image includes the display areas 101 and 111 by the stencil), the collation unit 413 executes the following collation.
- the collation unit 413 contains information (x-) indicating the position of the thick plate stored in the storage position column of the non-actual product display column among the thick plate candidates specified at the time when step S1106 starts.
- the registration times stored in the registration time column of the non-actual product display column for a plurality of plank candidates having the same y-coordinate) are collated with each other.
- the plank having the latest registration time is identified as the plank captured by the first captured image acquired in step S1101.
- the registration time is Except for the slowest plank candidates, they are excluded from the plank candidates.
- a specific example of a method for specifying a thick plate candidate will be shown in the description of the process in step S1107.
- the collation unit 413 extracts the same ID as the ID specified by the recognition information of the image ID acquired in step S1103 from the image ID column of the management table 500, and the captured image associated with the extracted ID and stored. To get.
- the collation unit 413 collates the captured image acquired in this way with the captured image acquired in step S1101. For example, the collation unit 413 extracts one or two or more feature points from each captured image, and whether or not there are common feature points as the extracted feature points, or at what ratio the feature points are common. It is determined whether or not the captured images match or disagree with each other based on whether or not they are (approximate) or the like. Such discrimination can be performed by a known image identification processing technique such as face authentication or fingerprint authentication.
- the match means that the meaning indicated by the recognition information of the collation target and the meaning indicated by the stored information of the collation target are the same.
- the weight recognition information is 10000 g and the weight storage information is 10 kg
- the meaning indicated by the weight recognition information and the meaning indicated by the weight storage information are the same, and the weight recognition information and the weight are shown. It will match the stored information of.
- the collation unit 413 uses, for example, a conversion formula for converting the unit indicated by the weight recognition information into the unit indicated by the weight storage information, so that whether or not the weight recognition information and the weight storage information match. To judge.
- step S1106 executed as described above, the collation unit 413 stores stored information that matches the recognition information of the collation target selected in step S1104 in the column (No.) of the management table 500.
- the information indicating the column is output to the specific unit 414.
- step S1107 the specifying unit 414 determines whether or not only one plate is specified from the plate managed in the management table 500 based on the information output from the collating unit 413 in step S1106. judge. As a result of the determination in step S1107, if only one plank is not specified from the planks managed in the management table 500, the process of step S1108 is executed.
- step S1108 the collation unit 413 determines whether or not all the collation targets have been selected. If it is determined that all the collation targets have not been selected as a result of the determination in step S1108, the process of step S1101 is executed again. Then, the processes of steps S1101 to S1107 are executed again. In this way, the processes of steps S1101 to S1108 are repeatedly executed. The processing after step S1107 will be described in detail below.
- step S1107 when only one plank is not specified from the planks managed in the management table 500, the identification unit 414 is a column specified by the information output from the collation unit 413 in step S1106. No.) is specified and stored as a candidate for a thick plate to be identified. Then, the process of step S1108 is executed.
- Whether or not only one plank is specified from the planks managed in the management table 500 is determined, for example, as follows.
- the specifying unit 414 when the number of columns specified by the information output in step S1106 immediately before this step is one, only one thick plate is specified from the thick plates managed in the management table 500. It may be determined that it was.
- the plank specified in this case is a plank corresponding to the row.
- the specifying unit 414 is one thick plate from the thick plate managed in the management table 500 when the information specifying the same column is output two or more times in the past multiple times step S1106. It may be determined that only have been identified. In this case, the number of columns specified by the information output in one step S1106 may be 1 or 2 or more. Further, the plank specified in this case is a plank corresponding to the row.
- the specifying unit 414 recognizes the collation target selected in step S1104 in the column (No.) of the management table 500.
- a column in which storage information that partially matches the information may be specified and stored as a candidate for a plate to be identified.
- the collation unit 413 stores stored information in the column (No.) of the management table 500 that partially matches the recognition information of the collation target selected in step S1104. The information indicating the column is output to the specific unit 414.
- the specific portion 414 may narrow down the candidates for the thick plate to be identified. For example, in the specific unit 414, among the columns (No.) stored as candidates for the planks to be identified, only the columns whose ratio to the total number of columns stored as candidates for the planks to be identified is equal to or greater than the threshold value. May be a candidate for a thick plate to be identified. When counting the total number of columns, the same No. If there are a plurality of columns, the number of the columns is 1. Further, the specific unit 414 is output in step S1106 (latest step S1106) immediately before this step among the columns (No.) already stored at the start of this step as candidates for the thick plate to be identified. Columns other than the same columns identified by the information may be excluded from the candidate planks to be identified. Two or more of the above-mentioned methods for identifying candidates for thick plates to be identified may be combined.
- step S1108 the collation unit 413 determines whether or not all the collation targets have been selected. For example, the collation unit 413 may determine that all the collation targets have been selected when all the columns (items) of the management table 500 are selected. Further, the collation unit 413 determines that all the collation targets have been selected when one or two or more columns preset as collation targets are selected from all the columns (items) of the management table 500. May be good.
- the collation unit 413 may limit the collation target depending on the location position of the plank. For example, the actual collation is performed at the storage position of each process. Therefore, when the collation unit 413 targets at least one of the IDs displayed by the stencil, the stamp, and the label as the collation target, and the plank is not specified as one (NO in step S1107). In this case), only the storage position of the management table 500 may be the collation target. Further, when specifying the thick plate after shipment from the factory, the collation unit 413 may select non-display information such as the storage position of the management table 500 as the collation target before the display information.
- step S1101 is executed again. Then, the processes of steps S1101 to S1107 are executed again.
- the first process executed when it is determined that all the collation targets have not been selected is not limited to the process in step S1101. For example, when the information (captured image and non-display information) that needs to be acquired in steps S1001 and S1003 to obtain the recognition information of all the selection targets is acquired at once in steps S1001 and S1003, the determination in step S1108 is performed.
- the first process executed when it is determined that all the collation targets have not been selected may be step S1104.
- step S1104 one collation target is selected. Therefore, when the recognition information of one collation target and the stored information of the one collation target match, at least one candidate of the thick plate to be identified is specified.
- step S1109 the output unit 415 outputs the article identification information.
- the article identification information includes, for example, information (for example, ID) of a plank determined to be identified in step S1107.
- the form of the output is, for example, at least one of display on a computer display, storage in an internal or external storage medium of the identification device 400, and transmission to an external device of the identification device 400.
- the operator may also be able to confirm the information (for example, ID) of the thick plate output by the output unit 415.
- the operator determines whether or not the information on the thick plate output by the output unit 415 is different from the actual information based on the captured image or the like. As a result of this determination, the information is output by the output unit 415.
- the operator operates the user interface of the identification device 400 to input the display information of the actual plate to the identification device 400.
- the identification device 400 uses the input display information of the plank as correct answer data to execute AI learning. As a result, the recognition accuracy in the recognition unit 412 can be improved.
- step S1109 is, for example, when the operator performs an operation corresponding to the confirmation of the thick plate information (for example, ID) output in this step to the user interface of the identification device 400, or.
- the process ends when a certain time has elapsed since the process of step S1109 started.
- step S1110 the update unit 402 updates the management table 500.
- the update unit 402 updates the image ID column of the management table 500 when the collation target when it is determined in step S1107 that only one thick plate is specified is the information in the column for displaying the actual product.
- the update unit 402 obtains the storage information of the image ID of the column corresponding to the thick plate specified in step S1107 among the columns (No.) of the management table 500 in the first imaging acquired in step S1101. Update to the image ID. Further, the updating unit 402 updates the captured image associated with the image ID and stored to the first captured image. Further, the updating unit 402 updates the component of each display item associated with the image ID and stored, to the component of each display item of the first captured image. The components of each display item of the first captured image are specified, for example, from the result of the process of step S1102.
- the update unit 402 obtains the storage information of the image ID of the column corresponding to the thick plate specified in step S1107 among the columns (No.) of the management table 500 in the second imaging acquired in step S1101. Update to the image ID. Further, the updating unit 402 updates the captured image associated with the image ID and stored to the second captured image. Further, the updating unit 402 updates the component of each display item associated with the image ID and stored, to the component of each display item of the second captured image. The components of each display item of the second captured image are specified, for example, from the result of the process of step S1102.
- the update column of the management table 500 is not limited to the image ID column.
- the collation target when it is determined in step S1107 that only one plank is specified is the weight.
- the updating unit 402 converts the stored information of the weight of the column corresponding to the plank specified in step S1107 among the columns (No.) of the management table 500 into the measured value of the weight acquired in step S1103. You may update it.
- the process of step S1110 is completed, the process according to the flowchart of FIG. 11 is completed. If there is no information to be updated in the process of step S1110, the process of step S1110 is omitted.
- step S1111 the output unit 415 outputs the article candidate information.
- the article candidate information includes, for example, information (for example, ID) of a plank candidate specified by the specific unit 414 at the time when step S1111 starts.
- the form of the output is, for example, at least one of display on a computer display, storage in an internal or external storage medium of the identification device 400, and transmission to an external device of the identification device 400.
- the operator confirms the information (for example, ID) of the thick plate candidate output by the output unit 415, and identifies the thick plate.
- ID information of the thick plate candidate output by the output unit 415
- identifies the thick plate By presenting the information of a plurality of candidates for the thick plate to the operator, it is possible to reduce the burden on the operator when specifying the thick plate.
- the identification device 400 acquires a captured image of a region including the display information displayed on the plank, and recognizes at least one display information based on the acquired captured image. do.
- the identification device 400 collates at least a part of the recognition information, which is the recognized information, with the stored information stored in the management table 500 corresponding to the recognition information.
- the identification device 400 identifies at least one candidate for the plank based on the result of the collation.
- the identification device 400 collates the recognition information partially different from the recognition information with the stored information stored in the management table 500 as the information corresponding to the recognition information. Therefore, when the thick plate is identified based on the captured image obtained by capturing the information displayed on the thick plate, even if all the information shown on the thick plate cannot be correctly extracted, the identification of the thick plate is performed. Is possible.
- the recognition information (recognition information that does not match the stored information) and the recognition information that is partially different from the recognition information are information for the same article (the same thick plate in the example of the present embodiment). Therefore, in steps S1102, S1103, and S1106 executed in the iterative process of FIG. 11, the display information displayed on the same article (the same thick plate in the example of the present embodiment) is recognized. Further, there is no recognition information that is partially different from the recognition information (recognition information that does not match the stored information) and that completely matches one of the recognition information (recognition information that does not match the stored information).
- the recognition information that is partially different from the recognition information is information that includes a part of the components of the recognition information but does not include all the components of the recognition information.
- the display information is correctly recognized even if the display information (component) is known on the manufacturer side. That is, in the conventional technique, it is premised that the display is clear and there is no rubbing or dirt on the display. Therefore, even if the display is scratched or dirty, the displayed information includes an error that the display information is correctly recognized. Therefore, if the displayed display information is not in the desired state, the display information cannot be recognized correctly. That is, in the conventional technique, since the display information is correctly displayed on the article, it is not possible to process the erroneous recognition. Further, in the conventional technique, if all the display information constituting the collation target is not correctly collated, it is determined that the collation has failed.
- the information stored in the management table 500 is the information managed by the thick plate manufacturer. Therefore, even if the recognition information and the storage information do not completely match, the recognition information that is partially different from the recognition information and the storage information stored in the management table 500 as the information corresponding to the recognition information. By collating , the candidates for thick plates can be narrowed down. Therefore, even if the display information displayed on the thick plate is not in the desired state in the manufacturing process, it is possible to prevent the collation from failing and improve the identification accuracy of the thick plate. can.
- the identification device 400 collates the information that satisfies the condition for accuracy among the recognition information with the information corresponding to the information that satisfies the condition for the accuracy among the stored information. Therefore, even if the collation fails when all the recognition information is collated, the thick plate can be identified as accurately as possible.
- the identification device 400 collates the non-display information not displayed on the plate with the stored information stored in the management table 500 as the information corresponding to the non-display information. Therefore, when the information shown on the plank cannot be correctly extracted, the information not shown on the plank can be utilized to identify the plank.
- Preferred examples of non-display information not displayed on the plank include at least one of the position inside the article, the weight of the plank, the size of the plank, the storage position, and the registration time.
- the identification device 400 is stored in association with the acquired image and the same ID as the ID of the captured image among the IDs stored in the image ID column of the management table 500. Combine with the captured image. Therefore, when the information shown on the thick plate cannot be correctly extracted, the thick plate can be identified by utilizing the captured image of the thick plate.
- the identification device 400 collates the recognition information of the display information different from the display information that failed to collate with the stored information stored in the management table 500 as the information corresponding to the recognition information. do. Therefore, when the information shown on the plank cannot be correctly extracted, another information displayed on the plank can be utilized to identify the plank.
- Second variant the case where the identification information 208 and 218 are configured by using the information having a high identification rate by the character recognition process is illustrated.
- the identification information is not limited to the case where the information having a high identification rate by the character recognition process is used.
- the components of the identification information may be determined according to predetermined rules such as four arithmetic operations and functions so that a person can understand the meaning of the identification information. For example, when the component of the plate ID includes a number, the value obtained by adding the number of each digit constituting the plate ID and the number of the same digit as the number is the smallest multiple of the predetermined value.
- the numbers constituting the identification information may be determined so as to be the value of. For example, ID 205, 215 displayed by the stencil is "563497-01".
- the information including the complement of the number (the complement of the radix in the decimal system) in the component may be used as the identification information.
- the information obtained by adding such a complement to the digit following the last digit of the plate ID may be used as the identification information.
- information including the remainder value when the last digit of the plate ID is divided by a predetermined value in the component may be used as the identification information.
- ID 205, 215 displayed by the stencil is "563497-01". Therefore, when the predetermined value is 5, the information including 1 (the remainder of 1/5 is 1) is used as the identification information.
- the information obtained by adding such a residual value to the digit following the last digit of the plate ID may be used as the identification information.
- the components of the identification information may be determined according to a predetermined rule. For example, among the components of the ID of the thick plate, the component having a low identification rate by the character recognition process may be changed to the component having a high identification rate as the identification information. For example, 1, 7, 9, 0, C, I, L, O, P, Q, R, T, U, V may be replaced with characters, numbers, or symbols having a high identification rate by character recognition processing. ..
- the identification information may be displayed in a form different from other information. For example, at least one of the color, character type, character size, and number of dots of the character in the identification information may be different from the other information.
- the number of image pickup pixels of the identification information may be different from the number of image pickup pixels of other information by taking close-up images of the identification information.
- the information for identifying the ID of the thick plate and the information of different colors is very good.
- the information obtained by changing the character type of the ID of the thick plate may be used as the identification information.
- the ID of the plate is a number
- the information obtained by changing the number into an alphabet may be used as the identification information.
- the case where the ID 205 displayed by the stencil, the ID 209 displayed by the engraving, and the ID 302 displayed by the label are the same is illustrated. ..
- the expressions and description contents of these IDs may differ. For example, some formats do not have a "hyphen" in the ID.
- the management table 500 stores information indicating that these IDs (ID displayed by the stencil, ID displayed by engraving, ID displayed by the label) are for the same plank. ..
- the expressions and description contents of the same display items may differ depending on the display by stencil, the display by engraving, and the display by label.
- the label may display the abbreviation of the standard.
- the number of digits of the consumer code may differ between the display by stencil and the display by label, but the consumer code is managed by the manufacturer.
- the size all the digits of the dimension may not be shown. Even in such a case, information indicating that the different expressions and description contents have the same meaning is stored in the management table 500.
- non-display information As in the present embodiment because the thick plate can be identified more reliably. However, it is not always necessary to use non-display information when identifying the thick plate. In this case, each column of the non-actual product display of the management table 500 shown in FIG. 5 is unnecessary, and the process of step S1103 of FIG. 11 becomes unnecessary.
- ⁇ Fifth variant a case where the plank is identified at an arbitrary timing before the plank is shipped to the customer in the factory is illustrated. However, the identification of the planks may be performed after the planks are shipped. In addition, the information displayed for the plank for identifying the plank may be given after the plank has been shipped to the consumer.
- step S1104 when the collation target selected in step S1104 is information in each column (each item) of the actual product display of the management table 500, recognition of the collation target selected in step S1104 in step S1106.
- An example is shown in which the collation is performed using only the information whose accuracy is guaranteed. However, it is not always necessary to do this.
- the collation unit 413 determines the number of information whose accuracy is guaranteed and the accuracy. Information whose accuracy is not guaranteed is extracted from the recognition information to be collated so that the sum of the number with the non-guaranteed information becomes the predetermined number. The collation unit 413 executes collation using the information whose accuracy is guaranteed and the extracted information whose accuracy is not guaranteed. For example, it is assumed that 10 is set as the predetermined number. Further, it is assumed that the number of recognition information whose accuracy is guaranteed is 6 among the recognition information to be collated.
- the information whose accuracy is not guaranteed from the recognition information to be collated so that the sum of the number of information whose accuracy is guaranteed and the number of information whose accuracy is not guaranteed is 10.
- the number of recognition information to be collated whose accuracy is guaranteed is 10 or more
- all the information whose accuracy is guaranteed is used for collation. Is done.
- the collation unit 413 selects one unselected collation target from the collation targets. After that, in step S1106, the collation unit 413 executes collation using all of the recognition information of the collation target. After that, when NO is determined in step S1107 and step S1108, in step S1104, the collation unit 413 selects the same collation target as the collation target selected in the previous step S1104. After that, in step S1106, the collation unit 413 executes collation using only the information whose accuracy is guaranteed among the recognition information of the collation target.
- the present embodiment is not limited to the case where the collation unit 413 executes collation using only the information whose accuracy is guaranteed among the recognition information of the collation target. That is, the collation unit 413 can perform collation using only a part of the recognition information (information whose accuracy is guaranteed in the example of the present embodiment) among the recognition information to be collated. It should be.
- ⁇ 7th variant In this embodiment, the case where the management table 500 is stored in the identification device 400 is illustrated. However, the management table 500 may be outside the identification device 400.
- the article is not limited to planks.
- the article may be a product other than a plank.
- the article may be a product on which information managed by a manager such as a manufacturer is displayed.
- the product may be, for example, a slab, a billet, a sheet coil, or a steel pipe. Further, it may be an article other than the manufactured product.
- the article may be, for example, a container.
- the embodiment of the present invention described above can be realized by executing a program by a computer. Further, a computer-readable recording medium on which the program is recorded and a computer program product such as the program can also be applied as an embodiment of the present invention.
- the recording medium for example, a flexible disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a magnetic tape, a non-volatile memory card, a ROM, or the like can be used.
- the embodiment of the present invention may be realized by a PLC (Programmable Logic Controller) or by dedicated hardware such as an ASIC (Application Specific Integrated Circuit).
- the identification device 400 includes a CPU 1201, a main storage device 1202, an auxiliary storage device 1203, a communication circuit 1204, a signal processing circuit 1205, an image processing circuit 1206, an I / F circuit 1207, a user interface 1208, a display 1209, and a bus. Has 1210.
- the CPU 1201 controls the entire identification device 400 in an integrated manner.
- the CPU 1201 uses the main storage device 1202 as a work area to execute a program stored in the auxiliary storage device 1203.
- the main storage device 1202 temporarily stores the data.
- the auxiliary storage device 1203 stores various data in addition to the program executed by the CPU 1201.
- the communication circuit 1204 is a circuit for communicating with the outside of the identification device 400.
- the communication circuit 1204 may perform wireless communication or wired communication with the outside of the identification device 400.
- the signal processing circuit 1205 performs various signal processing on the signal received by the communication circuit 1204 and the signal input according to the control by the CPU 1201.
- the image processing circuit 1206 performs various image processing on the signal input according to the control by the CPU 1201.
- the signal subjected to this image processing is output to, for example, the display 1209.
- the user interface 1208 is a portion where the operator gives an instruction to the identification device 400.
- User interface 1208 includes, for example, buttons, switches, dials, and the like. Further, the user interface 1208 may have a graphical user interface using the display 1209.
- the display 1209 displays an image based on the signal output from the image processing circuit 1206.
- the I / F circuit 1207 exchanges data with a device connected to the I / F circuit 1207.
- FIG. 12 shows a user interface 1208 and a display 1209 as devices connected to the I / F circuit 1207.
- the device connected to the I / F circuit 1207 is not limited to these.
- a portable storage medium may be connected to the I / F circuit 1207.
- at least a part of the user interface 1208 and the display 1209 may be outside the identification device 400.
- the output unit 415 is realized by using, for example, at least one of a communication circuit 1204 and a signal processing circuit 1205, an image processing circuit 1206, an I / F circuit 1207, and a display 1209.
- the CPU 1201, the main storage device 1202, the auxiliary storage device 1203, the signal processing circuit 1205, the image processing circuit 1206, and the I / F circuit 1207 are connected to the bus 1210. Communication between these components takes place via bus 1210. Further, the hardware of the identification device 400 is not limited to that shown in FIG. 12 as long as the functions of the identification device 400 described above can be realized.
- the present invention can be used, for example, to identify an article.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Computing Systems (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Software Systems (AREA)
- Evolutionary Computation (AREA)
- Databases & Information Systems (AREA)
- Artificial Intelligence (AREA)
- Health & Medical Sciences (AREA)
- Geometry (AREA)
- Quality & Reliability (AREA)
- Warehouses Or Storage Devices (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
Description
しかしながら、特許文献1に記載の技術では、クレーン操作者が目視で製品の製造番号を認識することができることが前提となっている。従って、製品に表示されている情報の一部が、擦れや汚れ等により識別不能または困難になっている場合に、クレーン操作者が、製品の製造番号を認識することができない虞がある。また、クレーン操作者が製品の近くにいないと、製品に表示されている情報を識別することができない。
特許文献2に記載の技術では、照合先の文字列を記憶しておき、照合元画像から照合元の文字列を認識し、照合元の文字列と照合先の文字列とを照合する。また、特許文献2に記載の技術では、時間的に連続する複数の照合元画像を用いて、前記認識の処理と前記照合の処理とを複数回実行する。
以上のように特許文献2~6に記載の技術では、物品に表示されている情報が所期の状態になっていない場合に、当該物品を識別することができない虞がある。
従って、特許文献1~6に記載の技術では、物品に表示されている情報を撮像した撮像画像に基づいて当該物品を識別する際に、当該物品に示されている情報が正しく抽出できない場合には、当該物品を識別することができない虞がある。
尚、長さ、位置、大きさ、間隔等、比較対象が同じであることは、厳密に同じである場合の他、発明の主旨を逸脱しない範囲で異なるもの(例えば、設計時に定められる公差の範囲内で異なるもの)も含むものとする。
本実施形態では、複数の製鉄所で製造された各種の厚板(例えば厚鋼板)に対して、熱処理や切断等の各種の処理を行う工場において、当該厚板が当該厚板の需要家に出荷される前に当該厚板を識別する場合を例示する。例えば、製鉄所で製造された厚板は輸送船に荷積みされる。その後輸送船は、工場の近くの岸壁に着岸する。厚板は、輸送船から荷下ろしされ、輸送車両(トラック等)に荷積みされる。輸送車両により輸送された厚板は、工場に入荷すると、工場内の置場に置かれる。置場に置かれた厚板は、熱処理や切断(ガス切断)等の処理が施された後、倉庫に置かれる。その後、厚板は、工場から需要家に向けて出荷される。このような場合、製鉄所で厚板が製造された後から、工場において需要家に向けて厚板が出荷される前までの間の任意のタイミングで、当該厚板を識別することができる。
図1Aは、厚板に対する表示領域および表示形態の第1の例を示す図である。図1Aにおいて、表示領域101は、ステンシルによる表示領域である。表示領域102は、刻印による表示領域である。表示領域101、102は、厚板の板面に存在する。尚、図1A~図1Cに示す破線は仮想線であり、実際には表示されない。ラベル(サイドラベル)103は、厚板の側面(板厚部分)に貼り付けられる。
図1Aおよび図1Bに示す例では、ステンシルによる表示、刻印による表示、およびラベル103、113による表示の少なくとも1つに基づいて、現品管理(各厚板の位置の管理)が行われる。
尚、厚板に対する表示領域および表示形態は、図1Aおよび図1Bに示すものに限定されない。例えば、ステンシルによる表示領域と刻印による表示領域とが離れていたり、刻印による表示がなかったりしてもよい。
図2Aおよび図2Bに示す例では、ステンシルによる表示には、マーク201、211、需要家名202、212、規格203、213、サイズ204、214、ID205、215、需要家コード206、216、注文番号207、217、および識別用情報208、218が含まれる。刻印による表示には、ID209、219が含まれる。
図3に示す例では、ラベルによる表示には、規格301、ID302、サイズ303、納期304、需要家コード305、および識別用情報306が含まれる。納期304は、厚板の納期を示す情報である。規格301、ID302、サイズ303、需要家コード305、識別用情報306は、それぞれ、規格203、213、サイズ204、214、ID205、215、209、219、需要家コード206、216、識別用情報208、218と同じものである。尚、ID302以外の情報は、ラベルによる表示に含まれていなくてもよい。また、前述した情報以外の情報が、ラベルによる表示に含まれていてもよい。ラベルによる表示の内容、位置、および大きさも、ステンシルおよび刻印による表示と同様に、厚板を製造する製鉄所および需要家等によって異なる。
図5において、同一の列における情報が同一の厚板に対する情報になる(同一のNo.の下の欄は、同一の厚板に対する情報が記憶される欄になる)。
図5において、現品表示の欄には、ステンシルによる表示、刻印による表示、およびラベルによる表示の各表示項目に関する情報が記憶される。非現品表示の欄には、ステンシルによる表示、刻印による表示、およびラベルによる表示の各表示項目に関する情報以外の情報が記憶される。
現品表示の欄において、ステンシルの欄には、ステンシルに関する記憶情報が記憶される。
ステンシルの欄のIDの欄には、ステンシルによる表示に含まれるID205、215の構成要素の内容および位置を示す記憶情報と、当該構成要素のその他の属性を示す記憶情報とが記憶される。尚、ステンシルによる表示に含まれるID205、215の構成要素とは、文字、数字、記号、マーク等、表示項目を構成する個々の情報を指す。また、構成要素のその他の属性を示す記憶情報は、識別装置400(記憶部403)または識別装置400と通信可能な外部装置において、当該構成要素の内容および位置と関連付けられて記憶されていてもよい。
ステンシルの欄の需要家名の欄には、ステンシルによる表示に含まれる需要家名202、212の構成要素の内容および位置を示す記憶情報が記憶される。
ステンシルの欄の規格の欄には、ステンシルによる表示に含まれる規格203、213の構成要素の内容および位置を示す記憶情報が記憶される。
ステンシルの欄の需要家コードの欄には、ステンシルによる表示に含まれる需要家コード206、216の構成要素の内容および位置を示す記憶情報が記憶される。
ステンシルの欄の識別用情報の欄には、ステンシルによる表示に含まれる識別用情報208、218の構成要素の内容および位置を示す記憶情報が記憶される。
以上のステンシルによる表示における表示項目の他に、ステンシルによる表示の表示項目として表示される可能性のある表示項目の内容も、管理テーブル500に記憶される。図5のステンシルの欄の識別用情報の欄の下の「・・・」は、このことを示す。また、表示項目自体は追加および/または削除されてもよい。
刻印の欄のIDの欄には、刻印による表示に含まれるID209、219の構成要素の内容および位置を示す記憶情報と、当該構成要素のその他の属性を示す記憶情報とが記憶される。尚、構成要素のその他の属性を示す記憶情報は、識別装置400(記憶部403)または識別装置400と通信可能な外部装置に、当該構成要素の内容および位置と関連付けられていてもよい。
以上の刻印による表示における表示項目の他に、刻印による表示の表示項目として表示される可能性のある表示項目の内容も、管理テーブル500に記憶される。図5の刻印の欄のIDの欄の下の「・・・」は、このことを示す。また、表示項目自体は追加および/または削除されてもよい。
ラベルの欄のIDの欄には、ラベルによる表示に含まれるID302の構成要素の内容および位置を示す記憶情報と、当該構成要素のその他の属性を示す記憶情報とが記憶される。尚、構成要素のその他の属性を示す記憶情報は、識別装置400(記憶部403)または識別装置400と通信可能な外部装置において、当該構成要素の内容および位置と関連付けられて記憶されていてもよい。
ラベルの欄のサイズの欄には、ラベルによる表示に含まれるサイズ303の構成要素の内容および位置を示す記憶情報が記憶される。
ラベルの欄の納期の欄には、ラベルによる表示に含まれる納期304の構成要素の内容および位置を示す記憶情報が記憶される。
ラベルの欄の需要家コードの欄には、ラベルによる表示に含まれる需要家コード305の構成要素の内容および位置を示す記憶情報が記憶される。
ラベルの欄の識別用情報の欄には、ラベルによる表示に含まれる識別用情報306の構成要素の内容および位置を示す記憶情報が記憶される。
物品内位置の欄には、厚板における所定の位置を原点(基準)とした場合の表示領域の位置を示す記憶情報が記憶される。
物品内位置の欄のステンシルの欄には、厚板における所定の位置を原点(基準)とした場合の、ステンシルによる表示領域の位置を示す記憶情報が記憶される。
物品内位置の欄の刻印の欄には、厚板における所定の位置を原点(基準)とした場合の、刻印による表示領域の位置を示す記憶情報が記憶される。
物品内位置の欄のラベルの欄には、厚板における所定の位置を原点(基準)とした場合の、ラベルによる表示領域の位置を示す記憶情報が記憶される。
サイズの欄には、厚板のサイズ(例えば、厚み×幅×長さ)を示す記憶情報が記憶される。現品表示の欄のサイズの欄に記憶されるサイズは、後述するようにして文字認識処理により認識されるサイズ204、214、303との照合のために用いられる。これに対し、非現品表示の欄のサイズの欄に記憶されるサイズは、厚板の重量等の測定値との照合のために用いられる。具体的には、非現品表示の欄のサイズの欄に記憶されるサイズと実寸法との比較が実施されることもある。
登録時刻の欄には、厚板が現在の置場位置に置かれた日時(日付と時刻とから定まるタイミング)を示す記憶情報が記憶される。
図7は、ステンシルおよび刻印の物品内位置と、ステンシルおよび刻印による表示における各表示項目の構成要素の位置の一例を示す図である。図7では、図1Aに示す表示位置および図2Aに示す内容で、ステンシルおよび刻印による表示がなされている場合を例示する。
図7では、直方体の厚板の8つの頂点のうち、図1Aに示す頂点104を原点とし、当該頂点104から、厚板の幅方向に沿う方向をx軸の正の方向、厚板の長さ方向に沿う方向をy軸の正の方向とするx-y座標で、ステンシルおよび刻印の物品内位置と、ステンシルおよび刻印による各表示項目の構成要素の位置とを表す。
以上のようにしてステンシルによる表示の各表示項目の各構成要素の位置がx-y座標で表される。
図8では、直方体の厚板の8つの頂点のうち、図1Aに示す頂点105を原点とし、当該頂点105から、厚板の幅方向に沿う方向をx軸の正の方向、厚板の板厚方向に沿う方向をz軸の正の方向とするx-z座標で、ラベルの物品内位置と、ラベルによる各表示項目の構成要素の位置とを表す。
物品内位置の欄の刻印の欄およびラベルの欄にも、物品内位置の欄のステンシルの欄と同様に、刻印の物品内位置を示す情報およびラベルの物品内位置を示す情報がそれぞれ記憶される。このため、ステンシルによる表示、刻印による表示、およびラベルによる表示のうちの1つまたは2つにおいて文字等の構成要素が欠落した場合であっても、残りの表示により厚板の識別が可能になる。
尚、前述したように、刻印の物品内位置を示す情報は、ステンシルの物品内位置を示す情報と同様に、x-y座標である。これに対し、ラベルの物品内位置を示す情報は、x-y座標ではなく、x-z座標となる。
以上のように図10のフローチャートによる処理は、図11のフローチャートが実行中であっても実行されるものとする。
表示項目の構成要素の内容を認識する処理は、例えば、公知のOCR(Optical character recognition)を用いた技術で実現することができるので、ここでは、その詳細な説明を省略する。尚、NN(Neural Network)等のAI(Artificial Intelligence)を用いた技術や、AIとOCRとを組み合わせた技術(いわゆるAI OCR)を用いて、ステップS1102の処理を実現してもよい。NNは、例えば、NNの入力層に撮像画像を入力すると、NNの出力層から構成要素を示す情報が出力されるように構成される。尚、本実施形態では、認識部412は、表示項目の構成要素の内容を認識することができない場合(構成要素が、予め定められている、文字、数字、記号、およびマークの何れでもないと認識された場合)、当該構成要素については認識できないことを認識結果とする。また、認識部412は、認識結果の信頼度を算出してもよい。
まず、情報取得部401は、表示項目の位置を導出する。情報取得部401が表示項目の位置を導出する手法の一例を説明する。
まず、情報取得部401は、ステップS1101で取得された撮像画像に基づいてエッジ検出処理を行い、厚板のエッジを検出し、検出した結果に基づいて、厚板の領域を特定する。そして、情報取得部401は、特定した領域が、厚板の板面部分と厚板の側面(板厚)部分との何れであるかを判定する。この判定は、例えば、特定した領域の縦横比に基づいて実現される。この判定の結果、特定した領域が、厚板の板面部分である場合、情報取得部401は、ステップS1101で取得された撮像画像が第1の撮像画像であると判定する。一方、特定した領域が、厚板の側面(板厚)部分である場合、情報取得部401は、ステップS1101で取得された撮像画像が第2の撮像画像であると判定する。
情報取得部401は、例えば、直方体の厚板の8つの頂点のうち、ステンシルによる表示領域と物品内位置の原点との位置関係として予め設定された位置関係に基づいて、第1の撮像画像における物品内位置の原点(厚板における所定の位置)を導出する。ステンシルによる表示領域と物品内位置の原点との位置関係として、例えば、以下のような情報が識別装置400に予め設定されていてもよい。即ち、ステンシルによる表示の表示項目の構成要素を、当該構成要素の頂部が上側に位置するように見た場合に、ステンシルによる表示と同一面において、ステンシルによる表示の左下側にある頂点が、物品内位置の原点であるという情報が識別装置400に予め設定されていてもよい。情報取得部401は、ステンシルによる表示における表示項目の構成要素の位置および刻印による表示における表示項目の構成要素の位置として、第1の撮像画像における物品内位置の原点を基準とする位置を導出する。
情報取得部401は、厚板のIDおよび当該IDの厚板の重量の実測値を、厚板の重量の認識情報として取得する。
情報取得部401は、厚板のIDおよび当該IDの厚板のサイズの実測値を、厚板のサイズの認識情報として取得する。
情報取得部401は、ステップS1101で取得された撮像画像(第1の撮像画像または第2の撮像画像)を撮像した撮像装置の位置を示す情報を、置場位置の認識情報として取得する。
図6に示すように、元の厚板600が切断されて別の厚板610~640が製造される場合、切断後の厚板610~640の親IDは、元の厚板600のIDであることが加工条件から自動的に特定される。インクジェットやレーザーマーキングなどで、切断後の厚板610~640のIDを含む表示が表示領域611~641になされる。IDを含む表示は手書きによる表示でもよい。また、情報取得部401は、表示領域611~641の撮像画像を画像取得部411が取得して、撮像画像を認識部412が認識することで元の厚板600と同様に厚板610~640のID等を取得してもよい。厚板610~640のID等と、元の厚板600のIDである親IDとの紐づけが、自動または手動で行われてもよい。さらに、元の厚板600に対する表示が切断後の厚板610、620に残ることがある。情報取得部401は、このような元の厚板600に対する表示に含まれるIDを、親IDの認識情報として取得することもできる。尚、このようなIDは、例えば、ステップS1102で認識された構成要素のうち、管理テーブル500の非現品表示の欄の物品内位置の欄(ステンシルの欄および刻印の欄)に記憶されている情報により特定される矩形領域の何れの矩形領域にも含まれない構成要素に基づいて特定される。
情報取得部401は、ステップS1101で取得された撮像画像(第1の撮像画像または第2の撮像画像)のIDを画像IDの認識情報として取得する。情報取得部401は、例えば、画像取得部411により取得された撮像画像に付加されたIDを当該撮像画像の画像IDの認識情報として取得する。
ステップS1103の処理が終了すると、ステップS1104の処理が実行される。尚、ステップS1103の処理が開始してから所定の時間が経過しても、情報取得部401において非表示情報が取得されない場合、ステップS1103の処理が実行されることなくステップS1104の処理が実行される。
次に、ステップS1105において、照合部413は、ステップS1104で選択された照合対象の認識情報のうち、正確性が保証されている情報を取得する。正確性が保証されている情報は、図9Aに示す識別対象除外区分および識別限界画素数によって照合の対象から除外されていない構成要素の情報等である。
照合対象がIDである場合、一致とは、照合対象の認識情報の構成要素と、照合対象の記憶情報の構成要素との、内容および並び順が完全に一致している部分があることを指す。ただし、照合対象がIDの一部である場合には、その照合対象の認識情報の構成要素と、照合対象の記憶情報の構成要素との、内容および並び順が完全に一致している部分があれば、一致しているものとする。
<<照合対象が表示情報である場合>>の項で説明した内容は、照合対象がID以外の表示情報である場合も同様である。
置場位置の認識情報は、ステップS1101で取得された撮像画像(第1の撮像画像または第2の撮像画像)を撮像した撮像装置の位置を示す情報である。置場位置の記憶情報は、厚板の位置を示す情報である。そこで、照合部413は、非現品表示の欄の置場位置の欄に記憶されている厚板の位置を示す情報から特定される厚板の位置と、ステップS1101で取得された撮像画像を撮像した撮像装置の位置との間の距離が閾値以下であるか否かを判定する。照合部413は、当該距離が閾値以下である場合に、置場位置の認識情報と記憶情報は一致していると判定し、そうでない場合、置場位置の認識情報と記憶情報は一致していないと判定する。
前述したように、照合対象が登録時刻である場合には、登録時刻の認識情報はない。本実施形態では、以下のようにして登録時刻の照合が実行される。
図1Cに示すように複数の厚板が積み重ねられる場合、x-y座標の位置が同じである厚板のうち経過時間が最も短い厚板が1番上に積まれているため、ステンシルによる表示領域101、111の撮像が可能であると見なせる。そこで、照合部413は、ステップS1101で取得された撮像画像が第1の撮像画像である場合(即ち、当該撮像画像がステンシルによる表示領域101、111を含む場合)、以下の照合を実行する。即ち、照合部413は、ステップS1106が開始する時点で特定されている厚板の候補のうち、非現品表示の欄の置場位置の欄に記憶されている厚板の位置を示す情報(x-y座標)が同じである複数の厚板の候補に対する非現品表示の欄の登録時刻の欄に記憶されている登録時刻同士を照合する。このようにすれば、登録時刻が最も遅い厚板が、ステップS1101で取得された第1の撮像画像で撮像されている厚板であると特定される。このようにする場合、非現品表示の欄の置場位置の欄に記憶されている厚板の位置を示す情報(x-y座標)が同じである複数の厚板の候補のうち、登録時刻が最も遅い厚板の候補以外は、厚板の候補から除外される。尚、厚板の候補の特定の方法の具体例については、ステップS1107の処理の説明の際に示す。
照合部413は、ステップS1103で取得された画像IDの認識情報により特定されるIDと同じIDを管理テーブル500の画像IDの欄から抽出し、抽出したIDに関連付けられて記憶されている撮像画像を取得する。照合部413は、このようにして取得した撮像画像と、ステップS1101で取得された撮像画像とを照合する。例えば、照合部413は、それぞれの撮像画像から、1もしくは2以上の特徴点を抽出し、抽出した特徴点として共通する特徴点があるか否か、またはどの程度の割合で特徴点が共通しているか(近似しているか)等に基づいて、それぞれの撮像画像の一致、不一致を判別する。このような判別は、公知の顔認証、指紋認証等の画像識別処理技術によって実施することができる。
特定部414は、本ステップの直前のステップS1106において出力された情報により特定される列の数が1つである場合、管理テーブル500において管理されている厚板から1つの厚板のみが特定されたと判定してもよい。この場合に特定される厚板は、当該列に対応する厚板である。
以上のような識別すべき厚板の候補を特定する手法の2つ以上を組み合わせてもよい。
尚、管理テーブル500の更新の欄は、画像IDの欄に限定されない。例えば、ステップS1107において1つの厚板のみが特定されたと判定されたときの照合対象が重量であるものとする。この場合、更新部402は、管理テーブル500の列(No.)のうち、ステップS1107において特定された厚板に対応する列の重量の記憶情報を、ステップS1103で取得された重量の測定値に更新してもよい。
ステップS1110の処理が終了すると、図11のフローチャートによる処理は終了する。尚、ステップS1110の処理において更新すべき情報がない場合、ステップS1110の処理は省略される。
以上のように本実施形態では、識別装置400は、厚板に対して表示されている表示情報を含む領域の撮像画像を取得し、取得した撮像画像に基づいて、少なくとも1つの表示情報を認識する。識別装置400は、当該認識した情報である認識情報の少なくとも一部の情報と、当該認識情報に対応して管理テーブル500に記憶されている記憶情報とを照合する。識別装置400は、当該照合の結果に基づいて、厚板の少なくとも1つの候補を特定する。この際、識別装置400は、認識情報と一部が異なる認識情報と、当該認識情報に対応する情報として管理テーブル500に記憶されている記憶情報とを照合する。従って、厚板に表示されている情報を撮像した撮像画像に基づいて当該厚板を識別する際、当該厚板に示されている情報の全てを正しく抽出できなくても、当該厚板の識別が可能となる。
<<第1の変形例>>
本実施形態のように、需要家名202、212、規格203、213、サイズ204、214、ID205、215、209、219、需要家コード206、216、注文番号207、217、識別用情報208、218、規格301、ID302、サイズ303、納期304、および需要家コード305を、人が識別可能な情報とすれば、識別装置400による現品管理だけでなく、オペレータ(作業員)による現品管理も容易になるので好ましい。しかしながら、需要家名202、212、規格203、213、サイズ204、214、ID205、215、209、219、需要家コード206、216、注文番号207、217、識別用情報208、218、規格301、ID302、サイズ303、納期304、および需要家コード305の少なくとも1つを、バーコードや2次元コードのように、人が識別可能でない情報に変換(エンコード)された情報としてもよい。
本実施形態では、文字認識処理による識別率が高い情報を用いて識別用情報208、218を構成する場合を例示した。しかしながら、識別用情報は、文字認識処理による識別率が高い情報を用いる場合に限定されない。
例えば、厚板のIDの構成要素が数字を含む場合、厚板のIDを構成する各桁の数字と、当該数字と同じ桁の数字と、を加算した値が、所定値の倍数のうち最小の値になるように、識別用情報を構成する数字を決定してもよい。例えば、ステンシルにより表示されるID205、215は、「563497-01」である。所定値を5とする場合、識別用情報は「042113-54」となる(5+0=5、6+4=10、3+2=5、4+1=5、9+1=10、7+3=10、0+5=5、1+4=5)。
この他、識別用情報を、他の情報と異なる形態で表示してもよい。例えば、識別用情報の、色、文字の種類、文字のサイズ、および文字のドット数のうち、少なくとも一つを他の情報と異ならせてもよい。また、このようにすることに代えてまたは加えて、識別用情報を近接撮影することにより、識別用情報の撮像画素数を他の情報の撮像画素数と異ならせてもよい。例えば、厚板のIDと色違いの情報を識別用情報とてもよい。また、厚板のIDの文字の種類を変更したものを識別用情報としてもよい。例えば、厚板のIDが数字である場合、当該数字をアルファベットに変更したものを識別用情報としてもよい。
本実施形態では、図2A、図2B、図3に示すように、ステンシルにより表示されるID205と、刻印により表示されるID209と、ラベルにより表示されるID302と、が同じである場合を例示した。しかしながら、これらのIDの表現および記載内容が異なる場合がある。例えば、IDにおいて“ハイフン”がない形式もある。このような場合、これらのID(ステンシルにより表示されるID、刻印により表示されるID、ラベルにより表示されるID)が同一の厚板に対するものであることを示す情報を管理テーブル500に記憶させる。ID以外の表示項目についても、同一の表示項目の表現および記載内容が、ステンシルによる表示、刻印による表示、およびラベルによる表示で異なる場合がある。例えば、ステンシルおよびラベルの双方に規格が表示される場合、例えば、ラベルには規格の略称が表示される場合がある。また、ステンシルによる表示とラベルによる表示とで需要者コードの桁数が異なる場合があるが、需要者コードは製造メーカで管理されている。また、サイズについても、寸法の全ての桁を示さない場合がある。このような場合にも、それら異なる表現および記載内容が同等の意味であることを示す情報を管理テーブル500に記憶させる。
本実施形態のように、非表示情報を用いれば、厚板の識別をより確実に行うことができるので好ましい。しかしながら、厚板の識別に際し、必ずしも非表示情報を用いる必要はない。このようにする場合には、図5に示す管理テーブル500の非現品表示の各欄は不要にあると共に、図11のステップS1103の処理は不要になる。
本実施形態では、工場において需要家に向けて厚板が出荷される前までの間の任意のタイミングで、当該厚板を識別する場合を例示した。しかしながら、厚板の識別は、厚板の出荷後に実行されてもよい。また、厚板の識別のために厚板に対して表示される情報は、厚板が需要家に対して出荷された後に付与されてもよい。
本実施形態では、ステップS1104において選択された照合対象が、管理テーブル500の現品表示の各欄(各項目)の情報である場合には、ステップS1106において、ステップS1104で選択された照合対象の認識情報のうち、正確性が保証されている情報のみを用いて照合が実行される場合を例示した。しかしながら、必ずしもこのようにする必要はない。
照合対象の認識情報のうち、正確性が保証されている情報の数が所定数未満である場合、ステップS1104において、照合部413は、正確性が保証されている情報の数と、正確性が保証されていない情報との数との和が前記所定数になるように、照合対象の認識情報から正確性が保証されていない情報を抽出する。照合部413は、正確性が保証されている情報が保証されている情報と、当該抽出した正確性が保証されていない情報とを用いて照合を実行する。例えば、前記所定数として10が設定されているとする。また、照合対象の認識情報のうち、正確性が保証されている情報の数が6であるとする。この場合、正確性が保証されている情報の数と、正確性が保証されていない情報との数との和が10になるように、照合対象の認識情報から正確性が保証されていない情報が4つ抽出される。なお、照合対象の認識情報のうち、正確性が保証されている情報の数が10以上である場合、当該正確性が保証されている情報の全て(すなわち、10以上の情報)を用いて照合が行われる。
管理テーブル500の現品表示の各欄(各項目)の情報については、同一の項目の情報(照合対象)を連続して2回選択してもよい。このようにする場合、照合部413は、照合対象のうち未選択の照合対象を1つ選択する。その後、ステップS1106において、照合部413は、当該照合対象の認識情報の全てを用いて照合を実行する。その後、ステップS1107およびステップS1108においてNOと判定された場合、ステップS1104において、照合部413は、前回のステップS1104で選択した照合対象と同一の照合対象を選択する。その後、ステップS1106において、照合部413は、当該照合対象の認識情報のうち、正確性が保証されている情報のみを用いて照合を実行する。
本実施形態では、管理テーブル500が識別装置400に記憶されている場合を例示した。しかしながら、管理テーブル500は識別装置400の外部にあってもよい。
本実施形態では、物品が厚板である場合を例示した。しかしながら、物品は、厚板に限定されない。例えば、物品は、厚板以外の製造物であってもよい。物品は、製造者等の管理者によって管理されている情報が表示されている製造物であってもよい。製造物は、例えば、スラブ、ビレット、薄板コイル、または鋼管であってもよい。また、製造物以外の物品であってもよい。物品は、例えば、コンテナであってもよい。
尚、以上説明した本発明の実施形態は、コンピュータがプログラムを実行することによって実現することができる。また、前記プログラムを記録したコンピュータ読み取り可能な記録媒体及び前記プログラム等のコンピュータプログラムプロダクトも本発明の実施形態として適用することができる。記録媒体としては、例えば、フレキシブルディスク、ハードディスク、光ディスク、光磁気ディスク、CD-ROM、磁気テープ、不揮発性のメモリカード、ROM等を用いることができる。また、本発明の実施形態は、PLC(Programmable Logic Controller)により実現されてもよいし、ASIC(Application Specific Integrated Circuit)等の専用のハードウェアにより実現されてもよい。
また、以上説明した本発明の実施形態は、何れも本発明を実施するにあたっての具体化の例を示したものに過ぎず、これらによって本発明の技術的範囲が限定的に解釈されてはならないものである。すなわち、本発明はその技術思想、またはその主要な特徴から逸脱することなく、様々な形で実施することができる。
識別装置400のハードウェアの一例について説明する。図12において、識別装置400は、CPU1201、主記憶装置1202、補助記憶装置1203、通信回路1204、信号処理回路1205、画像処理回路1206、I/F回路1207、ユーザインターフェース1208、ディスプレイ1209、およびバス1210を有する。
画像処理回路1206は、CPU1201による制御に従って入力した信号に対し、各種の画像処理を行う。この画像処理が行われた信号は、例えば、ディスプレイ1209に出力される。
ユーザインターフェース1208は、オペレータが識別装置400に対して指示を行う部分である。ユーザインターフェース1208は、例えば、ボタン、スイッチ、およびダイヤル等を有する。また、ユーザインターフェース1208は、ディスプレイ1209を用いたグラフィカルユーザインターフェースを有していてもよい。
出力部415は、例えば、通信回路1204および信号処理回路1205と、画像処理回路1206、I/F回路1207、およびディスプレイ1209との少なくとも何れか一方を用いることにより実現される。
Claims (8)
- 物品を識別する識別装置であって、
前記物品に表示されている情報である第1の情報を含む領域の1または2以上の撮像画像を取得する画像取得部と、
前記画像取得部により取得された撮像画像に基づいて、少なくとも1つの前記第1の情報を認識する認識部と、
前記認識部により認識された前記第1の情報である第1の認識情報の少なくとも一部の情報と、記憶情報の1つとして記憶媒体に予め記憶されている第1の情報である第1の記憶情報とを照合する照合部と、
前記照合部による照合の結果に基づいて、前記物品の少なくとも1つの候補を特定する特定部と、を有し、
前記照合部は、前記第1の認識情報と一部が異なる認識情報と、当該認識情報に対応する情報として記憶媒体に予め記憶されている記憶情報とを照合し得ることを特徴とする識別装置。 - 前記照合部は、前記第1の認識情報のうち、認識の正確性についての条件を満たす情報と、前記第1の記憶情報のうち、前記認識の正確性についての条件を満たす情報に対応する情報とを照合することを特徴とする請求項1に記載の識別装置。
- 前記物品に表示されていない情報である第2の情報を第2の認識情報として取得する情報取得部を有し、
前記第2の情報である第2の記憶情報が、記憶情報として前記第1の記憶情報と関連付けられて記憶媒体に予め記憶されており、
前記照合部は、前記情報取得部により取得された第2の認識情報と、前記第2の記憶情報とを照合することを特徴とする請求項1または2に記載の識別装置。 - 前記第2の情報は、前記物品に表示されている情報の物品の所定の位置を基準とした位置である物品内位置と、前記物品の重量と、前記物品のサイズと、前記物品が置かれている位置である置場位置と、前記物品が現在の位置に置かれた時刻である登録時刻と、のうち少なくとも1つを含むことを特徴とする請求項3に記載の識別装置。
- 前記第1の情報を含む領域の撮像画像が、記憶情報として前記第1の記憶情報と関連付けられて記憶媒体に予め記憶されており、
前記照合部は、前記画像取得部により取得された前記撮像画像の少なくとも一部の領域と、前記記憶情報として記憶されている撮像画像の少なくとも一部の領域とを照合することを特徴とする請求項1~4の何れか1項に記載の識別装置。 - 前記第1の情報は、複数あり、
前記照合部は、前記認識部により認識された前記第1の情報のうち、未照合の前記第1の情報である第1の認識情報の少なくとも一部の情報と、記憶情報の1つとして記憶媒体に予め記憶されている前記未照合の第1の情報である第1の記憶情報とを照合することを特徴とする請求項1~5の何れか1項に記載の識別装置。 - 物品を識別する識別方法であって、
前記物品に表示されている情報である第1の情報を含む領域の1または2以上の撮像画像を取得する画像取得工程と、
前記画像取得工程により取得された撮像画像に基づいて、少なくとも1つの前記第1の情報を認識する認識工程と、
前記認識工程により認識された前記第1の情報である第1の認識情報の少なくとも一部の情報と、記憶情報の1つとして記憶媒体に予め記憶されている前記第1の情報である第1の記憶情報とを照合する照合工程と、
前記照合工程による照合の結果に基づいて、前記物品の少なくとも1つの候補を特定する特定工程と、を有し、
前記照合工程は、前記第1の認識情報と一部が異なる認識情報と、当該認識情報に対応する情報として記憶媒体に予め記憶されている記憶情報とを照合し得ることを特徴とする識別方法。 - 物品を識別するための処理をコンピュータに実行させるためのプログラムであって、
前記物品に表示されている情報である第1の情報を含む領域の1または2以上の撮像画像を取得する画像取得工程と、
前記画像取得工程により取得された撮像画像に基づいて、少なくとも1つの前記第1の情報を認識する認識工程と、
前記認識工程により認識された前記第1の情報である第1の認識情報の少なくとも一部の情報と、記憶情報の1つとして記憶媒体に予め記憶されている前記第1の情報である第1の記憶情報とを照合する照合工程と、
前記照合工程による照合の結果に基づいて、前記物品の少なくとも1つの候補を特定する特定工程と、をコンピュータに実行させ、
前記照合工程は、前記第1の認識情報と一部が異なる認識情報と、当該認識情報に対応する情報として記憶媒体に予め記憶されている記憶情報とを照合し得ることを特徴とするプログラム。
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020237012807A KR102643324B1 (ko) | 2020-10-29 | 2021-10-27 | 식별 장치, 식별 방법 및 프로그램 |
JP2022559196A JP7235183B2 (ja) | 2020-10-29 | 2021-10-27 | 識別装置、識別方法、およびプログラム |
CN202180071458.4A CN116547702A (zh) | 2020-10-29 | 2021-10-27 | 识别装置、识别方法及程序 |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2020-181789 | 2020-10-29 | ||
JP2020181789 | 2020-10-29 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2022092147A1 true WO2022092147A1 (ja) | 2022-05-05 |
Family
ID=81381464
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2021/039642 WO2022092147A1 (ja) | 2020-10-29 | 2021-10-27 | 識別装置、識別方法、およびプログラム |
Country Status (4)
Country | Link |
---|---|
JP (1) | JP7235183B2 (ja) |
KR (1) | KR102643324B1 (ja) |
CN (1) | CN116547702A (ja) |
WO (1) | WO2022092147A1 (ja) |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2014044479A (ja) * | 2012-08-24 | 2014-03-13 | Fujifilm Corp | 物品照合装置および物品照合方法並びに物品照合プログラム |
Family Cites Families (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS5869987U (ja) | 1981-11-04 | 1983-05-12 | 三洋電機株式会社 | 充電式機器 |
JPS5869989U (ja) | 1981-11-06 | 1983-05-12 | 松下電器産業株式会社 | 回転パネルの保持装置 |
JPS5869988U (ja) | 1981-11-06 | 1983-05-12 | 松下電器産業株式会社 | 電気機器キヤビネツト |
JPS5891143U (ja) | 1981-12-15 | 1983-06-20 | トヨタ自動車株式会社 | デイ−ゼルエンジンの背圧検出用ポ−ト |
JPS603918U (ja) | 1983-06-17 | 1985-01-12 | ソニー株式会社 | 多チヤンネル薄膜磁気ヘツド |
GB2250492A (en) | 1990-12-03 | 1992-06-10 | Parnell King Michael | Roof rack |
JP2004334288A (ja) | 2003-04-30 | 2004-11-25 | Mitsubishi Heavy Ind Ltd | 刻印文字認識装置及び認識方法 |
JP4733577B2 (ja) * | 2006-07-12 | 2011-07-27 | 日立コンピュータ機器株式会社 | 帳票認識装置及び帳票認識プログラム |
CN101373517B (zh) * | 2007-08-22 | 2011-03-16 | 北京万集科技有限责任公司 | 一种车牌识别方法及系统 |
CN101930725A (zh) * | 2009-12-09 | 2010-12-29 | 杭州华三通信技术有限公司 | 一种字符显示方法和装置 |
JP6080586B2 (ja) * | 2013-02-13 | 2017-02-15 | 株式会社ファインデックス | 文字認識システム、文字認識プログラム及び文字認識方法 |
JP2017138975A (ja) | 2016-02-04 | 2017-08-10 | アスクル株式会社 | 電子商取引装置、電子商取引方法および電子商取引プログラム |
JP6528723B2 (ja) * | 2016-05-25 | 2019-06-12 | トヨタ自動車株式会社 | 物体認識装置、物体認識方法及びプログラム |
CN107329977B (zh) * | 2017-05-27 | 2019-08-16 | 银江股份有限公司 | 一种基于概率分布的假牌车二次筛选方法 |
CN111767908B (zh) * | 2019-04-02 | 2024-07-02 | 顺丰科技有限公司 | 字符检测方法、装置、检测设备及存储介质 |
-
2021
- 2021-10-27 WO PCT/JP2021/039642 patent/WO2022092147A1/ja active Application Filing
- 2021-10-27 JP JP2022559196A patent/JP7235183B2/ja active Active
- 2021-10-27 CN CN202180071458.4A patent/CN116547702A/zh active Pending
- 2021-10-27 KR KR1020237012807A patent/KR102643324B1/ko active IP Right Grant
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2014044479A (ja) * | 2012-08-24 | 2014-03-13 | Fujifilm Corp | 物品照合装置および物品照合方法並びに物品照合プログラム |
Also Published As
Publication number | Publication date |
---|---|
JP7235183B2 (ja) | 2023-03-08 |
JPWO2022092147A1 (ja) | 2022-05-05 |
KR102643324B1 (ko) | 2024-03-07 |
CN116547702A (zh) | 2023-08-04 |
KR20230074182A (ko) | 2023-05-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6569532B2 (ja) | 管理システム、リスト作成装置、リスト作成方法、管理方法及び管理用プログラム | |
EP3229169B1 (en) | Code recognition device | |
US10127196B2 (en) | Systems and methods for managing notes | |
US20120070086A1 (en) | Information reading apparatus and storage medium | |
CN108364005A (zh) | 价格标签的自动识别方法、系统、设备及存储介质 | |
CN108416403A (zh) | 商品与标签的自动关联方法、系统、设备及存储介质 | |
JP5879725B2 (ja) | 板金工程作業支援システム | |
JP6472218B2 (ja) | 文字認識システム及び文字認識方法 | |
JP6458239B1 (ja) | 画像認識システム | |
JP6831951B2 (ja) | 画像認識システム | |
EP3561729B1 (en) | Method for detecting and recognising long-range high-density visual markers | |
JP6150675B2 (ja) | 位置情報表示システム及び方法 | |
WO2022092147A1 (ja) | 識別装置、識別方法、およびプログラム | |
JP2008247574A (ja) | 出荷時照合システムおよび方法 | |
JP5117060B2 (ja) | 物品の出入管理システム | |
Morikawa et al. | Reduction of piping management person-hours through use of AR technology at shipbuilding sites | |
WO2017179543A1 (ja) | 情報処理装置、情報処理方法及びプログラム記録媒体 | |
WO2022114173A1 (ja) | トラッキング装置、トラッキング方法、トラッキングデータのデータ構造、およびプログラム | |
JP5994394B2 (ja) | 鋼板の識別装置及び識別方法 | |
JP2010039683A (ja) | 光学式自動認識コード及びそれを用いた管理システム | |
JP6618793B2 (ja) | 入出荷管理装置 | |
EP2741236A1 (en) | Design code pattern comprising information deciphered by digital device and operating system for same | |
JP2004145654A (ja) | ユーザーカード | |
US20150030304A1 (en) | Systems and Methods for Recording Information on a Mobile Computing Device | |
JP2022122201A (ja) | ピッキング作業支援システム |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21886264 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2022559196 Country of ref document: JP Kind code of ref document: A |
|
ENP | Entry into the national phase |
Ref document number: 20237012807 Country of ref document: KR Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 202180071458.4 Country of ref document: CN |
|
WWE | Wipo information: entry into national phase |
Ref document number: 202317029091 Country of ref document: IN |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 21886264 Country of ref document: EP Kind code of ref document: A1 |