WO2017170260A1 - 検品処理装置、検品システム、商品マスタ登録装置、検品処理方法及びプログラム - Google Patents

検品処理装置、検品システム、商品マスタ登録装置、検品処理方法及びプログラム Download PDF

Info

Publication number
WO2017170260A1
WO2017170260A1 PCT/JP2017/012121 JP2017012121W WO2017170260A1 WO 2017170260 A1 WO2017170260 A1 WO 2017170260A1 JP 2017012121 W JP2017012121 W JP 2017012121W WO 2017170260 A1 WO2017170260 A1 WO 2017170260A1
Authority
WO
WIPO (PCT)
Prior art keywords
inspection
product
image
unit
data
Prior art date
Application number
PCT/JP2017/012121
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
康 日高
克彦 近藤
友宏 小南
Original Assignee
日本電気株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 日本電気株式会社 filed Critical 日本電気株式会社
Priority to SG11201807007PA priority Critical patent/SG11201807007PA/en
Publication of WO2017170260A1 publication Critical patent/WO2017170260A1/ja

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65G—TRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
    • B65G1/00—Storing articles, individually or in orderly arrangement, in warehouses or magazines
    • B65G1/02—Storage devices
    • B65G1/04—Storage devices mechanical
    • B65G1/137—Storage devices mechanical with arrangements or automatic control means for selecting which articles are to be removed
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01G—WEIGHING
    • G01G19/00—Weighing apparatus or methods adapted for special purposes not provided for in the preceding groups
    • G01G19/52—Weighing apparatus combined with other objects, e.g. furniture
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis

Definitions

  • the present invention relates to an inspection processing apparatus, an inspection system, a product master registration apparatus, an inspection processing method, and a program.
  • inspection work In the process of shipping distribution products handled by logistics companies such as warehousing and wholesalers, before shipping products, work to confirm whether the products to be shipped are products listed in the shipping slips There is.
  • This work is called inspection work.
  • inspection operations there is an inspection operation for inspecting a plurality of the same products, such as “100 parts of the same catalog” and “60 parts of the same box”.
  • there is a technology for identifying the product by capturing the surface of the product placed at the top of the bundle of products with a camera and comparing it with a master image of the product registered in advance.
  • An example of an object of the present invention is to provide an inspection processing apparatus, an inspection system, a product master registration apparatus, an inspection processing method, and a program that solve the above-described problems.
  • the inspection processing apparatus includes at least one inspection product to be inspected and first inspection data including at least one inspection quantity each indicating the quantity of the at least one inspection product.
  • a product image determination unit for specifying an image for each of the at least one inspection product based on a first inspection target image indicating a product group that matches the first inspection data, and a storage unit for storing the specified image
  • the product data registration unit to be registered in the storage unit and the image stored in the storage unit, the product of the at least one inspection product among the products included in the second inspection target image corresponding to the second inspection data
  • a matching unit that identifies a product of the same type as any one of the items.
  • the inspection system includes an imaging device that images the product group to obtain the first inspection target image, a weight measuring device that measures the weight of the product group, and the imaging device. And the above inspection processing device for acquiring the weight of the commodity group measured by the weight measuring instrument.
  • the product master registration apparatus includes at least one inspection product to be inspected and inspection data including at least one inspection quantity each indicating a quantity of the at least one inspection product, A product image determination unit for specifying an image for each of the at least one inspection product based on an inspection target image indicating a product group that matches the inspection data; and a product data registration unit for registering the specified image in a product master; .
  • the inspection processing method includes at least one inspection product to be inspected and first inspection data including at least one inspection quantity each indicating the quantity of the at least one inspection product; , Based on a first inspection target image indicating a product group that matches the first inspection data, specifying an image for each of the at least one inspection product, registering the specified image in a storage unit, Based on the image stored in the storage unit, the product of the same type as any one of the at least one inspection product among the products included in the second inspection target image corresponding to the second inspection data is specified. Including that.
  • the program according to the fifth embodiment of the present invention includes: first inspection data including at least one inspection product to be inspected and at least one inspection quantity each indicating a quantity of the at least one inspection product; Based on a first inspection target image indicating a product group that matches the first inspection data, an image for each of the at least one inspection product is specified, the specified image is registered in a storage unit, and the storage unit Identifying a product of the same type as any one of the at least one inspection product among the products included in the second inspection object image corresponding to the second inspection data based on the image stored in Let the computer run.
  • the registration work of the master image of the product used for the inspection work can be made efficient.
  • FIG. 1 is a diagram showing a minimum configuration of an inspection processing apparatus according to the first embodiment.
  • the inspection processing apparatus 100 includes at least a product data registration unit 109, a product image determination unit 110, and a collation unit 115.
  • the inspection processing apparatus 100 is, for example, a computer including a CPU (Central Processing Unit).
  • the product image determination unit 110 includes inspection data (slip data) including identification information of a product to be inspected (inspection product) and a quantity to be inspected for the product (inspection quantity), and the inspection data.
  • An image for each inspection target product is specified based on an inspection target image obtained by imaging a product group that matches the inspection product and the inspection quantity.
  • the product data registration unit 109 registers the image specified by the product image determination unit 110 in the storage unit.
  • the storage unit is a product data storage unit 117 described later, and corresponds to a product master.
  • the matching unit 115 identifies a product included in the inspection target image corresponding to the new inspection data based on the image stored in the storage unit (product master) in which the product image specified by the product image determination unit 110 is registered. To do.
  • FIG. 2 is a block diagram showing an example of the configuration of the inspection processing apparatus according to the first embodiment.
  • the inspection processing apparatus 100 includes a control determination unit 101, a weight acquisition unit 102, a product image acquisition unit 103, an input reception unit 104, a display information output unit 105, and a feature amount calculation unit 106.
  • Inspection data storage unit 107 Target total weight calculation unit 108, product data registration unit 109, product image determination unit 110, product weight calculation unit 114, verification unit 115, inspection data storage unit 116, product A data storage unit 117.
  • a product to be inspected included in the inspection data is called an inspection product.
  • the quantity to be inspected is called the inspection quantity.
  • a product taken out from the product shelf by the worker who performs the inspection work as a candidate for the inspection product is called an inspection target product.
  • an image obtained by capturing an inspection target product group is referred to as an inspection target image.
  • product images are referred to as product images.
  • the control determination unit 101 instructs information transmission and processing to other functional units.
  • the weight acquisition unit 102 acquires the weight of the inspection target product measured by the weight measuring instrument from the weight measuring instrument.
  • the product image acquisition unit 103 instructs the imaging device to capture an inspection target product, and acquires an inspection target image captured by the imaging device from the imaging device.
  • the input receiving unit 104 receives an input operation of a worker.
  • the input receiving unit 104 acquires inspection data based on an inspection data input operation by a worker.
  • the display information output unit 105 generates various information necessary for the inspection work and outputs it to a display device connected to the inspection processing apparatus 100.
  • the feature amount calculation unit 106 calculates the feature amount of the inspection target image acquired by the product image acquisition unit 103 by, for example, a general feature amount calculation method such as calculating a graphic feature amount.
  • the inspection data storage unit 107 records the inspection data to be inspected by the worker in the inspection data storage unit 116.
  • the target total weight calculator 108 calculates the total weight (target total weight) of the inspection products included in the inspection data.
  • the target total weight calculation unit 108 compares the calculated target total weight with the weight of the inspection target product acquired by the weight acquisition unit 102, and calculates a difference.
  • the product data registration unit 109 registers an image obtained by capturing an inspection product, unit weight, and the like in the product data storage unit 117.
  • the product data registration unit 109 includes a product image determination unit 110 and a product weight calculation unit 114.
  • the product image determination unit 110 includes an image extraction unit 111, an image analysis unit 112, and a product identification unit 113.
  • the image extraction unit 111 cuts out a group of images (product images) that are candidates for the inspection target product from the inspection target image. A group of images may be images in different areas.
  • the image analysis unit 112 compares the extracted product images with each other, and calculates the quantity of each product image included in the inspection target image.
  • the product specifying unit 113 compares the quantity for each type of product image with the inspection quantity for each inspection product included in the inspection data, and specifies the product indicated by each product image.
  • the product image determination unit 110 records the product image specified by the product specification unit 113 and the inspection product in the product data storage unit 117 (product master) in association with each other.
  • the product weight calculation unit 114 includes weight data obtained by measuring the unit weight for each inspection product included in the inspection data and the inspection quantity for each inspection product, and the weight of the inspection product included in the inspection data and the product group that matches the inspection quantity. Based on the equation indicating the relationship, the unit weight for each inspection product is calculated.
  • the matching unit 115 uses the product master image stored in the product data storage unit 117 to match the inspection target image obtained by capturing the inspection product, identifies the product that appears in the inspection target image, and the identified product becomes the inspection data. It is determined whether or not it matches the inspection product included.
  • the inspection data storage unit 116 is a database that stores the product name, inspection quantity, etc. of the inspection products included in the inspection data to be inspected.
  • the product data storage unit 117 is a database that stores product names, product images (master images), product image feature quantities, unit weights, and the like for each product.
  • control determination unit 101 the weight acquisition unit 102, the product image acquisition unit 103, the input reception unit 104, the display information output unit 105, the feature amount calculation unit 106, the inspection data storage unit 107, the product data registration unit 109, and the product image determination
  • the control determination unit 101 the weight acquisition unit 102, the product image acquisition unit 103, the input reception unit 104, the display information output unit 105, the feature amount calculation unit 106, the inspection data storage unit 107, the product data registration unit 109, and the product image determination
  • At least a part of the unit 110, the image extraction unit 111, the image analysis unit 112, the product identification unit 113, the product weight calculation unit 114, and the verification unit 115 is read and executed by a CPU included in the inspection processing apparatus 100 from a storage unit such as a hard disk It is a function provided by doing.
  • FIG. 3 is a diagram showing an example of an inspection system according to the first embodiment of the present invention.
  • the inspection system 1 includes an inspection processing apparatus 100, an imaging apparatus 200, a weight measuring instrument 300, a display apparatus 400, and an input apparatus 500. Further, one or more inspection target products (inspection target products 600) are placed on the weight measuring device 300. It should be noted that a known pattern having a characteristic such as a lattice shape is drawn on the surface of the weight measuring device 300 (the surface on which the inspection target product is placed).
  • the imaging device 200 is, for example, a camera that images a product to be inspected.
  • the weight measuring device 300 is a device that measures the weight of a product to be inspected.
  • the imaging device 200 is attached to the support column 302 with the lens facing the ground so that an inspection target product placed on the weight measuring device 300 can be imaged from directly above.
  • the support column 302 is fixed by a base 301.
  • the weight measuring device 300 is installed on the base 301.
  • the attachment position of the imaging device 200 is not limited to the example of FIG.
  • the inspection processing apparatus 100 is connected to the imaging apparatus 200 and acquires an image of the inspection target product captured by the imaging apparatus 200.
  • the inspection processing apparatus 100 is connected to the weight measuring device 300 and acquires the weight of the inspection target product measured by the weight measuring device 300.
  • the display device 400 is a display, for example.
  • the display device 400 is connected to the inspection processing device 100 and displays information necessary for the inspection work generated by the inspection processing device 100.
  • the input device 500 is a keyboard, a mouse, or arbitrary data reading means (such as a storage medium reading device). The worker operates the inspection processing apparatus 100 using the input device 500 while referring to information displayed on the display device 400 to perform inspection work.
  • the worker takes out one or a plurality of inspection product candidates described in one slip to be inspected from a product shelf and puts them on the weight measuring device 300.
  • the worker may select a similar product by mistake.
  • a single slip includes a plurality of types of products.
  • the inspection target product 600 includes a plurality of types of products.
  • the weight measuring device 300 measures the weight of the inspection target product 600 and transmits the measured weight data to the inspection processing apparatus 100.
  • the inspection processing apparatus 100 transmits an imaging instruction signal to the imaging apparatus 200 at the timing when the weight data is received.
  • the imaging apparatus 200 When the imaging apparatus 200 receives the imaging instruction signal, the imaging apparatus 200 captures the inspection target product 600 from above and transmits the captured inspection target image to the inspection processing apparatus 100.
  • the worker inputs inspection data (name of inspection product, inspection quantity, etc.) included in one slip using the input device 500.
  • the slip data is an electronic file, and the worker inputs the file stored in the storage medium to the inspection processing apparatus 100 via the storage medium reader.
  • Each detail included in the inspection data is called detail information.
  • the inspection processing apparatus 100 When the inspection target image is acquired, the inspection processing apparatus 100 performs a collation process with the master image of the product stored in the product data storage unit 117 to identify the product included in the inspection target image. Moreover, the inspection processing apparatus 100 determines whether the product identified as being reflected in the image as a result of the collation processing matches the inspection product included in the inspection data. The inspection processing apparatus 100 performs this collation processing and determination processing for all inspection products included in the inspection data. Further, the inspection processing apparatus 100 calculates the total weight of all inspection products included in the inspection data, and compares it with the weight data measured by the weight measuring device 300. Then, the inspection processing apparatus 100 displays the comparison processing result for all the inspection target products and the comparison result of the weight data on the display device 400. Further, the inspection processing apparatus 100 displays a list of inspection data on the display device 400.
  • the worker visually confirms the list of inspection data displayed on the display device 400, the verification processing result, and the weight data comparison result, and grasps the inspection result.
  • the worker adjusts the quantity by placing or removing a quantity 600 of the inspection target product 600 on or off the weight measuring instrument 300.
  • information on the result of visual inspection is recorded for products that are not registered in the product data storage unit 117 such as new products, and the master of unregistered products is automatically based on the recorded information.
  • a method of registering images and unit weights in the product data storage unit 117 is provided. Next, a registration process of product images and unit weights of unregistered products in the present embodiment will be described.
  • FIG. 4 is a flowchart showing an example of inspection processing using the inspection processing apparatus according to the first embodiment of the present invention.
  • FIG. 5 is a first diagram showing an example of an inspection confirmation screen according to the first embodiment of the present invention.
  • the worker inputs one inspection data to the inspection processing apparatus 100.
  • the input receiving unit 104 acquires the inspection data and outputs it to the control determination unit 101.
  • the target total weight calculation unit 108 calculates the target total weight based on an instruction from the control determination unit 101 (step S11). Specifically, the target total weight calculation unit 108 multiplies the unit weight of the inspection product stored in the product data storage unit 117 for each inspection product and the inspection quantity of the inspection product for the input inspection data.
  • the target total weight calculation unit 108 calculates the target total weight by adding all the inspection weights, and records the target total weight in the memory. Note that when the inspection product included in the inspection data is not registered, the unit weight information cannot be obtained, and therefore the inspection weight for the inspection product is zero (0).
  • the worker refers to the inspection data input to the inspection processing apparatus 100 and takes out the inspection target product 600 from the product shelf or the like and places it on the weight measuring device 300.
  • the weight acquisition unit 102 acquires the weight data of the inspection target product 600 measured by the weight measuring device 300 (step S12).
  • the weight acquisition unit 102 outputs the acquired weight data to the control determination unit 101.
  • the control determination unit 101 records weight data in a memory.
  • the control determination unit 101 outputs an imaging instruction signal to the product image acquisition unit 103 when the weight data is acquired.
  • the product image acquisition unit 103 instructs the imaging device 200 to capture an image, and the imaging device 200 captures an inspection target image of the inspection target product 600.
  • the product image acquisition unit 103 acquires the inspection target image captured by the imaging device 200 (step S13) and stores it in the memory.
  • the control determination unit 101 instructs the feature amount calculation unit 106 to calculate the feature amount of the stored image.
  • the feature amount calculation unit 106 reads the inspection target image from the memory, calculates the feature amount by a predetermined known feature calculation method (step S14), and outputs the calculation result to the control determination unit 101.
  • This calculation result includes the distribution of the feature amount on the inspection target image. Further, the feature amount distribution includes the feature amounts of all the products to be inspected 600 placed on the weight measuring device 300.
  • the control determination unit 101 records the feature amount in the memory.
  • the collation unit 115 searches for products included in the inspection target image based on the master image recorded in the product data storage unit 117 (step S15). Specifically, the collation unit 115 reads out the master image of the inspection product included in the inspection data from the master images of all the products registered in the product data storage unit 117, and extracts the master image and the inspection target image. Are compared, and the product shown in the inspection object image is specified. For example, the collation unit 115 reads the feature amount of the product from the product data storage unit 117 based on the product name included in the inspection data.
  • the product specifying unit 113 compares the feature quantity of the read verification product with the feature quantity distribution of the inspection target image, and checks whether the feature quantity of the inspection product is included in the feature quantity distribution of the inspection target image. Perform search processing. If the similarity between the feature quantity of the inspection product and the feature quantity included in the inspection target image is equal to or greater than a predetermined threshold, the matching unit 115 determines that the inspection product is reflected in the inspection target image. The collation unit 115 performs a search process for each inspection product included in the inspection data, and outputs the search result (a quantity that can be searched) to the control determination unit 101.
  • the control determination unit 101 When the search result is acquired from the collation unit 115, the control determination unit 101 outputs the search result to the display information output unit 105, and instructs to display the inspection confirmation screen.
  • the display information output unit 105 reads “detail number”, “product code”, “inspection quantity” recorded in the inspection data storage unit 116, and “unit weight” recorded in the product data storage unit 117.
  • the display information output unit 105 requests the control determination unit 101 for information on the target total weight, the weight data acquired by the weight acquisition unit 102, and the total weight error.
  • the total weight error is a difference between the target total weight calculated by the target total weight calculation unit 108 and the weight data acquired by the weight acquisition unit 102.
  • the control determination unit 101 instructs the target total weight calculation unit 108 to calculate the total weight error.
  • the target total weight calculation unit 108 reads the target total weight calculated previously and the weight data acquired by the weight acquisition unit 102 from the memory, and calculates a total weight error.
  • the target total weight calculation unit 108 outputs the target total weight, the weight data, and the calculated total weight error to the control determination unit 101.
  • the control determination unit 101 outputs such information to the display information output unit 105.
  • the display information output unit 105 acquires an inspection target image from the memory.
  • the display information output unit 105 uses the determination result of the verification unit 115, the inspection data acquired from the inspection data storage unit 116, the data such as the total weight error output from the target total weight calculation unit 108, and the inspection target image. Generates an image of the inspection confirmation screen used for the inspection work, and displays the image on the display device 400 (step S16).
  • FIG. 5 is a diagram illustrating an example of an inspection confirmation screen.
  • the inspection confirmation screen includes an inspection data display field 61, an inspection object image display field 62, an image comparison result display field 63, a weight comparison result display field 64, and an OK button 65.
  • the display information output unit 105 displays the inspection data (“detail number”, “product code”, “inspection quantity”, and “unit weight” fields) acquired from the inspection data storage unit 116 and the like in the inspection data display field 61 and collation.
  • the search result (“inspection result” column) acquired from the section 115 is displayed.
  • the display information output unit 105 displays the acquired inspection target image in the inspection target image display field 62.
  • the display information output unit 105 displays the determination result by the product specifying unit 113 in the image matching result display field 63. For example, when the search result acquired from the collating unit 115 indicates that all the products included in the inspection data match, the display information output unit 105 displays “image OK” or the like to display the inspection data. If there is at least one determination result that does not match the product included in the item, “image NG” or the like is displayed.
  • the display information output unit 105 displays the weight comparison result display column 64 based on data such as the total weight error acquired from the target total weight calculation unit 108. For example, when the total weight error is 0, the display information output unit 105 displays “weight OK” or the like in the weight comparison result display field 64.
  • the display information output unit 105 displays “weight NG” or the like in the weight comparison result display field 64.
  • the display information output unit 105 also displays the target total weight, weight data, and total weight error in the weight comparison result display field 64. Further, the display information output unit 105 displays an OK button 65.
  • the OK button 65 is a button to be pressed when the inspection work for the inspection data currently displayed by the worker is completed.
  • the worker confirms whether or not all the products have been identified (step S17). For example, the worker can confirm whether or not all the products have been specified based on whether or not “image OK” is displayed in the image matching result display field 63.
  • the display information output part 105 produces
  • the visual inspection screen is a screen for visually confirming each inspection target product 600 placed on the weight measuring device 300. On the visual inspection screen, each inspection target product may be further enlarged and displayed. The operator looks at the inspection confirmation screen, and visually confirms the displayed product image and product name.
  • the worker adjusts the deficiency of the product.
  • the inspection ends.
  • the imaging device 200 captures a new inspection target image, and the product image acquisition unit 103 acquires the image.
  • the weight measuring device 300 remeasures the weight, and the weight acquisition unit 102 acquires new weight data that has been remeasured.
  • the layout of the visual confirmation screen may be arbitrary as long as the inspection target product can be visually confirmed, but may be the same as the inspection confirmation screen illustrated in FIG.
  • step S17 Yes
  • step S19 the worker next checks whether the total weight error is within an allowable range. If the total weight error is not within the allowable range (step S19: No), the worker adjusts the excess or deficiency of the product.
  • the weight acquisition unit 102 acquires new weight data.
  • the target total weight calculation unit 108 recalculates the total weight error.
  • the display information output unit 105 updates the display in the weight comparison result display field 64.
  • the inspection data storage unit 107 records the inspection target image, the weight data, and the inspection data in association with each other in the inspection data storage unit 116 (step S20).
  • the inspection target image and the weight data are those at the end of inspection (that is, the inspection target image and weight data of the inspection target product group that matches the contents of the inspection data).
  • the inspection data storage unit 107 also associates inspection data or the like with information indicating that inspection has been performed visually when the inspection data of this time includes detailed inspection information that has been visually inspected.
  • the inspection processing apparatus 100 performs a master registration process (step S21). This master registration process is not necessary when all the products can be identified in step S17, that is, when the product master image is recorded in the product data storage unit 117. Next, the master registration process will be described with reference to FIGS.
  • FIG. 6 is a second diagram showing an example of an inspection confirmation screen according to the first embodiment of the present invention.
  • FIG. 7 is a third diagram showing an example of an inspection confirmation screen according to the first embodiment of the present invention.
  • inspection data including products with product codes “A”, “B”, and “C” that are products that are not recorded in the product data storage unit 117 (FIGS. 5 to 7).
  • FIG. 5 to 7 Inspection data including products with product codes “A”, “B”, and “C” that are products that are not recorded in the product data storage unit 117 (FIGS. 5 to 7).
  • the inspection object images and the like recorded in step S20 are only for the three inspection data illustrated in FIGS. Specifically, first, inspection processing is performed on the inspection data “shipment slip 1” illustrated in FIG.
  • the inspection data storage unit 116 stores the inspection target image confirmed on the visual inspection screen corresponding to the inspection data of “shipment slip 1” and the inspection target image. The weight data measured in the state indicated by is recorded.
  • the “shipping slip 2” includes detailed information on the inspection quantity of the product A being “2” and the inspection quantity of the product B being “2”.
  • the inspection data storage unit 116 stores the inspection target image confirmed on the visual inspection screen and the corresponding weight data corresponding to the inspection data of “shipment slip 2”. Is recorded.
  • the inspection process is performed for “shipment slip 2”, the inspection target image is recorded in step S20, and then the master registration process is performed. The explanation will be made assuming that there is.
  • inspection processing is performed on the inspection data “shipment slip 3” illustrated in FIG.
  • the “shipping slip 3” includes detailed information with the inspection quantity of the product B being “2” and the inspection quantity of the product C being “1”.
  • the inspection data storage unit 116 corresponds to the inspection data of the “shipment slip 3”, and corresponds to the inspection target image confirmed on the visual inspection screen.
  • the weight data to be recorded is recorded.
  • an inspection process is performed on the “shipment slip 3”
  • an inspection target image is recorded in step S20, and then a master registration process is performed. The description will be made assuming that
  • FIG. 8 is a flowchart showing an example of a master registration process of the inspection processing apparatus according to the first embodiment of the present invention.
  • 9A and 9B are first diagrams for explaining inspection processing according to the first embodiment of the present invention.
  • 10A and 10B are second diagrams for explaining inspection processing according to the first embodiment of the present invention.
  • 11A to 11C are third diagrams for explaining inspection processing according to the first embodiment of the present invention.
  • 12A and 12B are fourth diagrams illustrating the inspection processing according to the first embodiment of the present invention.
  • FIG. 8 is a diagram for explaining the master registration process in step S21 in detail.
  • the product data registration unit 109 initializes a variable N for counting inspection data, and sets “1” to “N” (step S31).
  • the product data registration unit 109 determines whether or not the first inspection data includes at least one inspection result by visual inspection (step S33). Whether or not even one inspection result by visual inspection is included is whether or not a product that has been inspected on the visual inspection screen by the processing shown in FIG. 4 is included. For example, when the product data registration unit 109 records the inspection data and the information indicating that the visual inspection has been performed in association with each other and is recorded in the inspection data storage unit 116, even one visual inspection result is included. (At least one visual inspection result is included). If the N-th inspection data does not include visual inspection (no visual inspection result is included) (step S33: No), the process proceeds to the determination of step S37.
  • the product data registration unit 109 instructs the image extraction unit 111 to cut out an image.
  • the image extraction unit 111 cuts out a product image in the read inspection target image (step S34).
  • a lattice pattern is drawn on the weight measuring device 300.
  • the image extraction unit 111 cuts out an image (product image) of a part in which a group of objects that are candidates for a product is captured by image processing such as a background subtraction method.
  • 9A shows that the product images numbered 11, 12, 13, and 14 have been cut out after being cut out by the image extraction unit 111.
  • the product image differs depending on which side of the product A is placed upward, such as when the product A has a three-dimensional shape. In the description of, it is assumed that the same surface is photographed for the same inspection target product.
  • the product data registration unit 109 instructs the feature amount calculation unit 106 to calculate the feature amount of each product image cut out by the image extraction unit 111.
  • the feature amount calculation unit 106 calculates a feature amount for each extracted product image (step S35), and outputs the value to the product data registration unit 109.
  • the product data registration unit 109 records the feature amount in the memory in association with each product image. For example, if the feature amount of the cutout image “11” in FIG. 9A is “AAA”, the product data registration unit 109 records “11” and “AAA” in association with each other in the memory.
  • FIG. 11A is a diagram showing the first inspection data and weight data.
  • Wa unit weight of product A
  • Wb unit weight of product B
  • Wc unit of product C
  • Weight ⁇ 1 (pieces)
  • the product data registration unit 109 instructs the image analysis unit 112 to collate the cut images.
  • the image analysis unit 112 collates the product images cut out by the image extraction unit 111 (step S39). Specifically, the image analysis unit 112 performs a collation process for comparing feature values with other product images for each of all product images obtained in steps S32 to S37.
  • the image analysis unit 112 collates the product image 11 and the product images 12, 13, 14, 21, 22, 23, and 24 with respect to the product image 11 of FIG. 9A.
  • the image analysis unit 112 collates the product image 12 with each of the product images 11, 13, 14, 21, 22, 23, and 24. The same applies to the other product images 13, 14, 21, 22, 23, 24.
  • the image analysis unit 112 determines whether there is an image of a product having a matching feature amount among all the cutout images (step S40). For example, if the similarity between the feature amount of the product image 11 and the feature amount of the product image 14 is within a predetermined range, the image analysis unit 112 determines that both are images of the matching product.
  • FIG. 10A shows an example of a collation result by the image analysis unit 112. 10A shows that as a result of the collation processing, the image analysis unit 112 determines that the product image 11, the product image 14, the product image 22, and the product image 23 are images of matching products.
  • the image analysis unit 112 determines that the product image 12, the product image 21, and the product image 24 match the product image (product image of the same type), the product image 14, the product image 22, and the product image 23 match The product image 21, the product image 21, and the product image 24 indicate that the matching product image, the product image 22, and the product image 23 are determined to be images of the matching product.
  • the image analysis unit 112 calculates the quantity for each type of product image included in the verified image to be inspected by inspection object image (inspection data). Separately). In the example of FIG.
  • the image analysis unit 112 since the product image 11 and the product image 14 match, the image analysis unit 112 has two product images of the same type as the product image 11 in the inspection target image of the shipping slip 1 (product image 11). 11 and product image 14) are included. The image analysis unit 112 calculates that one product image of the same type as the product image 12 (product image 12 itself) and one product image of the same type as the product image 13 (product image 13 itself) are included. To do. Similarly, the image analysis unit 112 calculates that the shipping slip 2 includes two product images of the same type as the product image 11 (the product image 22 and the product image 23).
  • step S40 calculates that two product images of the same type as the product image 12 (product image 21 and product image 24) and 0 product images of the same type as the product image 13 are included.
  • step S40 determines that there is no product image having the same feature quantity.
  • the product specifying unit 113 determines whether there is a product with the number of images with the matched feature quantity and the inspection quantity on the slip (step S41). Specifically, the product specifying unit 113 compares the quantity of each product image for each inspection target image (by inspection data) by the image analysis unit 112 with the inspection quantity of the inspection product included in the inspection data. The inspection product indicated by each of the product images is specified. This will be described in more detail with reference to FIG. 10B.
  • the “coincidence image” column, “shipment slip 1” column, and “shipment slip 2” column in FIG. 10B summarize the calculation results by the image analysis unit 112 in a table.
  • the product specifying unit 113 compares the quantity for each type of product image for each inspection target image (FIG. 10B) with the shipping slip 1 (right diagram in FIG. 9A) and the shipping slip 2 (right diagram in FIG. 9B). . 10B, for example, it can be seen that the product images 11, 14, 22, and 23 are of the same type and are included in the shipping slip 1 and two in the shipping slip 2. Since such a product is only the product A, the product specifying unit 113 specifies that the product image 11 or the like indicates the product A. In addition, regarding the product images 12, 21, and 24, the product included in the shipping slip 1 and the product included in the shipping slip 2 is the product C when compared with the inspection data. 12 etc. specify that it is the goods C.
  • the product included in the shipping slip 1 and 0 in the shipping slip 2 is the product B in comparison with the inspection data.
  • the captured image is specified. If there is a product that can be identified, the product identification unit 113 determines that there is a product whose number of images with the same feature quantity matches the inspection quantity of the slip. When it is determined that there is a matching product (step S41), the product identification unit 113 outputs the identified result to the product data registration unit 109. Subsequently, the product data registration unit 109 registers a product image in which the quantity of the product image included in the inspection target image and the inspection quantity included in the inspection data match with the product in the product data storage unit 117 ( Step S42).
  • an image of a product can be automatically registered as a master in the inspection work flow without registering the image as a master in advance. If it is determined that there is no matching product (step S41: No), the process proceeds to step S43.
  • FIG. 12A shows an equation generated by the product weight calculation unit 114.
  • Wa represents the unit weight of the product A
  • Wb represents the unit weight of the product B
  • Wc represents the unit weight of the product C.
  • Wa, Wb, Wc can be obtained by solving the simultaneous equations.
  • FIG. 12B shows the unit weight of each product A to C obtained by solving the simultaneous equations.
  • the product weight calculation unit 114 associates the solution of simultaneous equations (unit weight) with the product and outputs the product to the product data registration unit 109. If the simultaneous equations cannot be solved, the product weight calculation unit 114 outputs information such as no solution to the product data registration unit 109.
  • the product data registration unit 109 determines whether there is a solution to the simultaneous equations based on the information acquired from the product weight calculation unit 114 (step S44). When there is a solution of the simultaneous equations (step S44: Yes), the product data registration unit 109 registers the unit weight acquired from the product weight calculation unit 114 in the product data storage unit 117 in association with the product (step S45). . When there is no solution of simultaneous equations (step S44: No), the master registration process is terminated. As described above, according to the present embodiment, the unit weight can be automatically registered as a master in the inspection work flow without the unit weight being registered as a master in advance.
  • the product image can be registered in the master registration process after the inspection process of the shipping slip 2.
  • the unit weight can be registered in the master registration process after the inspection process of the shipping slip 3. That is, the product image master registration process and the unit weight master registration process may be performed at independent timings.
  • step S32 all inspection data stored in the inspection data storage unit 116 is read and processed, but the present invention is not limited to such a case. Only the inspection data including the inspection target product included in the inspection data used in the inspection processing performed last in the detailed information may be read.
  • the inspection processing apparatus of the present embodiment even when the collation unit 115 cannot identify the product shown in the image obtained by capturing the target product using the master image recorded in the product data storage unit 117, the inspection work is performed.
  • the inspection product and the master image of the inspection product can be automatically registered in the product data storage unit 117 in association with each other based on the inspection data and the inspection target image that are recorded several times. Further, based on the inspection data and the weight data recorded while repeating the inspection work several times, the inspection product and the unit weight of the inspection product are automatically registered in the product data storage unit 117 in association with each other. Can do. Therefore, it is not necessary to previously register the master image and unit weight of the product, and the labor for master registration can be reduced.
  • FIG. 13 is a block diagram showing an example of the configuration of the inspection processing apparatus according to the second embodiment of the present invention. As shown in FIG.
  • the inspection processing apparatus 100A replaces the display information output unit 105 and the product data registration unit 109 in the first embodiment with a display information output unit 105A and a product data registration unit. It differs from 1st embodiment by the point provided with 109A.
  • the display information output unit 105A provides an input means for associating an inspection product by an operator with a portion of the inspection target image in which the inspection product is reflected.
  • the product data registration unit 109A includes a product image determination unit 110A and a product weight calculation unit 114.
  • 110 A of product image determination parts are provided with the image extraction part 111, the image analysis part 112, and the product specific
  • Other configurations of the inspection processing apparatus 100A according to the second embodiment are the same as those of the first embodiment.
  • the partial image selection unit 118 performs the following processing when the number of cut out images (product images) in the inspection target image is smaller than the total inspection quantity included in the inspection data. That is, the partial image selection unit 118 is an image including a plurality of products in a group of images based on an operation of associating the inspection product included in the inspection data with the portion of the image in which the inspection product is captured, An image including one inspection product (for example, product A) is collated with another group of images including the same inspection product (product A). The partial image selection unit 118 selects, as a partial image of the inspection product (product A), an image in the range where the feature amounts match as a result of the collation.
  • the product data registration unit 109A registers the image in the range selected by the partial image selection unit 118 in the product data storage unit 117 in association with the associated product and information indicating that the image is incomplete. To do. Further, the product data registration unit 109A obtains a group of images (product images of product A alone) in which the outline of the product is cut out for one product (for example, product A) in which the partial image is registered. In this case, the image is registered instead of the partial image.
  • FIG. 14 is a diagram showing an example of an inspection confirmation screen according to the second embodiment of the present invention.
  • FIG. 14 shows an example of an inspection confirmation screen displayed when inspection processing is performed for “shipment slip 4”.
  • “Shipping slip 4” includes two products A, one product B, and three products C. Further, it is assumed that the product A, the product B, and the product C are not registered in the product data storage unit 117. Therefore, “image NG” is displayed in the image comparison result display field 63, and “weight NG” is displayed in the weight comparison result display field 64.
  • the products A to C are placed on the weight measuring device 300 as shown in the inspection object image display column 62. That is, a part of one product A is placed so as to overlap the product C, and another part of the product A is placed so as to overlap the product B.
  • the image extraction unit 111 cuts out the product images
  • the product A and the product C placed so as to overlap each other are cut out as a single product image (broken line) Product image 41) surrounded by.
  • the product A and the product B placed so as to overlap each other are cut out as a single product image (a product image 44 surrounded by a broken line).
  • the partial image selection unit 118 divides the product images placed in an overlapping manner for each product, thereby realizing a semi-automatic master registration process. More specifically, on the visual inspection screen (step S18 in FIG. 4), the input receiving unit 104 associates the inspection product included in the inspection data by the worker with the image portion in which the inspection product is reflected in the inspection target image. Accept the operation. The partial image selection unit 118 divides the product image based on this operation.
  • the visual inspection screen displays an inspection target image, and may have any operation input means for associating the product with an image portion showing a certain product in the inspection target image.
  • the image may be
  • the following description will be given on the assumption that the visual inspection screen is the same as the inspection confirmation screen illustrated in FIG.
  • FIG. 15 is a first diagram illustrating a master registration process according to the second embodiment of the present invention.
  • the left figure of FIG. 15 is an example of the inspection object image display column 62 after the operator performs an operation of associating the product with the image portion showing the product.
  • the right figure of FIG. 15 shows detailed data of “shipment slip 4”.
  • the operator performs an operation of selecting the first line of the inspection data display column 61 with a mouse or the like, and further the product shown in the inspection target image display column 62
  • An operation of selecting A with a mouse or the like points 41A and 44A in FIG. 15
  • the worker then presses the pointing confirmation button 66.
  • the input receiving unit 104 receives this operation, and the product data is sent to the identification information of the product A and the coordinate information of the image portion selected by the worker via the control determination unit 101.
  • the data is output to the registration unit 109A.
  • the partial image selection unit 118 acquires these pieces of information.
  • the partial image selection unit 118 acquires the product image 41 and the product image 44 after being cut out by the image extraction unit 111.
  • the partial image selection unit 118 acquires the feature amounts of the product image 41 and the product image 44 calculated by the feature amount calculation unit 106.
  • the partial image selection unit 118 performs processing for dividing the images of the overlapping products using these pieces of information.
  • the worker may perform an operation for associating the product with an image portion in which the product is shown. In that case, the partial image selection unit 118 acquires the identification information of the product B, the coordinate information of the product B, the identification information of the product C, and the coordinate information of the product C.
  • FIGS. 16A and 16B are second diagrams for explaining the master registration processing according to the second embodiment of the present invention.
  • the clipping process of the partial image selection unit 118 will be described with reference to FIGS. 16A and 16B.
  • the partial image selection unit 118 collates both images while performing image processing such as movement and rotation on the product image 41 and the product image 44, and searches for a positional relationship in which the feature amounts of both images overlap. Then, as shown in FIG. 16A, a positional relationship is found in which the areas where the product A is shown partially match.
  • the partial image selection unit 118 cuts out only the region in the range where the feature amounts match from the image superimposed in the positional relationship such that the feature amounts exemplified in FIG. 16A match.
  • the partial image selection unit 118 obtains a partial image of the product A illustrated in FIG. 16B.
  • the product A when the product A is partially hidden under the other product as shown in FIG. 16A, the other product may be reflected in the image of the product A. Therefore, the partial image selection unit 118 may not be able to recognize the exact contour of the product A from the image illustrated in FIG. 16A and may only obtain a partial image.
  • the feature amount of the product A is sufficiently included in the cut out partial image, the matching process of the product A can be performed in the inspection process. Therefore, in the second embodiment, a partial image (partial image) cut out by the partial image selection unit 118 is registered in the product data storage unit 117 as an image of the product A.
  • the input reception unit 104 checks the inspection product by the worker and the inspection product. An operation for associating an image portion with a mark is accepted.
  • the input reception unit 104 outputs the identification information of the associated inspection product and the coordinate information of the image portion selected by the worker to the control determination unit 101.
  • the control determination unit 101 records this information in the memory.
  • the control determination unit 101 associates the inspection target image, the weight data, the inspection data, the product identification information, and the coordinate information of the image portion selected by the worker with the inspection data storage unit.
  • the display information output unit 105A outputs the visual inspection screen
  • the image extraction unit 111 performs a product clipping process from the inspection target image.
  • the product data registration unit 109A compares the sum of the inspection quantities included in the inspection data with the number of extracted product images. If the quantity does not match, the product data registration unit 109A will display the output information 105A on the display information output unit 105A. “As there is a product placed on top of each other, please perform an operation to associate the product to be inspected with the image of the product inspected. "Is displayed. The display prompts the worker to perform the association operation.
  • FIG. 17 is a flowchart showing an example of a master registration process of the inspection processing apparatus according to the second embodiment of the present invention.
  • the product data registration unit 109A sets “1” to the variable N (step S31).
  • the product data registration unit 109A reads and acquires the inspection data and the inspection object image / weight data registered for the Nth time from the inspection data storage unit 116 (step S32).
  • the product data registration unit 109A determines whether at least one inspection result by visual inspection is included in the N-th inspection data (step S33). If the N-th inspection data does not include visual inspection (step S33: No), the process proceeds to step S37.
  • step S33 When a visual inspection result is included (step S33: Yes), the image extraction unit 111 cuts out a product image for the inspection target image (step S34). Next, the feature amount calculation unit 106 calculates a feature amount for each extracted product image (step S35). The product data registration unit 109A acquires the product image cut out by the image extraction unit 111 and the feature amount of the product image. Next, the product data registration unit 109A determines whether or not the number of the cut product images matches the number of all the inspection products included in the Nth inspection data (step S351). If they match (step S351: Yes), the process proceeds to step S36.
  • step S351 If they do not match (step S351: No), the control determination unit 101 reads the product identification information and the coordinate information of the image portion of the product recorded in the inspection data storage unit 116 (step S352), These pieces of information are output to the product data registration unit 109A.
  • the partial image selection unit 118 performs a process of cutting out the partial image (step S353). Specifically, as described with reference to FIGS. 16A and 16B, the partial image selection unit 118 superimposes a plurality of images including the same product so that the distributions of the feature amounts included in the images match. Process. Then, the partial image selection unit 118 cuts out only the range of the portion with the matching feature amount (product A in the examples of FIGS.
  • the partial image selection unit 118 When there are a plurality of types of products such as the product A that are overlapped, the partial image selection unit 118 performs a partial image cut-out process for each of the plurality of types of products.
  • the partial image selection unit 118 also includes a plurality of image portions other than the clipped image (in the example of FIG. 15, a portion where the product C of the product image 41 is shown and a portion where the product B of the product image 44 is shown). Cut out from the product image including the product.
  • the partial image selection unit 118 determines two images including the feature amount of the product A, one image including the feature amount of the product B after the product A is cut out, and the feature amount of the product C. One image containing is obtained.
  • the product weight calculation unit 114 formulates the relationship between the weight data and the inspection data using the Nth inspection data and the corresponding weight data (step S36).
  • the product data registration unit 109A determines whether or not the variable N is equal to the number of recorded inspection data (step S37). When the variable N is not equal to the number of recorded inspection data (step S37: No), the product data registration unit 109A adds “1” to the variable N (step S38), and repeats the processing from step S32.
  • the image analysis unit 112 causes the image extraction unit 111 and the partial image selection unit 118 to extract images (a product image in which one product is shown) , A partial image cut out from a product image showing a plurality of products is included) (step S39).
  • the image analysis unit 112 includes two images of the product C cut out by the image extraction unit 111, two images of the product A cut out by the partial image selection unit 118, and a portion.
  • the image selection unit 118 uses one image of the remaining product B, one image of the product C, and product images cut out from the inspection target images of other shipping slips, and the feature amounts match among them.
  • step S40 the image analysis unit 112 determines whether there is an image of a matching product among all the cut-out images. If there is no matching product image (step S40: No), the process proceeds to step S43.
  • step S40 If there is an image of the matching product (step S40: Yes), the image analysis unit 112 calculates the quantity of the product image and the partial image included in the verified inspection target image for each inspection target image.
  • the product specifying unit 113 determines whether there is a product in which the number of images having the same feature amount matches the inspection quantity of the inspection data (step S41). If there is a matching product (step S41: Yes), the product data registration unit 109A displays a product image or partial image of a product in which the quantity of the product image included in the inspection target image and the inspection quantity included in the inspection data match. The product is registered in the product data storage unit 117 in association with the product (step S42).
  • the product data registration unit 109A registers the product in association with information indicating that the image is incomplete. If there is no product in which the number of images having the same feature quantity matches the inspection quantity of the inspection data (step S41: No), the process proceeds to step S43.
  • step S43 the product weight calculation unit 114 solves all the equations generated in step S36 by simultaneous (step S43).
  • step S44: Yes the product data registration unit 109A registers the unit weight calculated by the product weight calculation unit 114 in the product data storage unit 117 in association with the product (step S45).
  • step S44: No the process proceeds to step S46.
  • step S46 the product data registration unit 109A determines whether or not an image including an outline is obtained for the product for which the partial image is registered (step S46).
  • the product for which the partial image is registered is a product such as the product A of the “shipping slip 4” described above.
  • the product data registration unit 109A searches the product data storage unit 117 for the product included in the inspection data of the shipping slip 5, and the master image registered in association with the information indicating that the product is an incomplete image. Check if is registered. For example, if the product A is included in the inspection data of the “shipping slip 5”, the product data registration unit 109A searches the product data storage unit 117, and the product in which the partial image is registered is included in the inspection data. It is determined that Subsequently, the product data registration unit 109A determines whether or not the inspection target image of the “shipping slip 5” shows the outline of the product A.
  • the image extraction unit 111 cuts out all products from the inspection target image, and the product data registration unit 109A determines whether the total number of product images extracted and the inspection quantity included in the inspection data match. If they match, the image analysis unit 112 compares each of the images cut out by the image extraction unit 111 with the partial image of the product A registered in the product data storage unit 117. As a result of the collation, if an image whose feature quantity matches the partial image of the product A is found in the product image, the product image is considered to be an image in which the outline of the product A including the feature quantity of the product A can be understood. It is done. In this case, the product data registration unit 109A determines that an image including a contour is obtained.
  • step S46: Yes the image analysis unit 112 outputs the product image including the contour to the product data registration unit 109A.
  • the product data registration unit 109A updates the partial image of the product A that has been registered with the product image (step S47). For example, the product data registration unit 109A registers the product image of the product A determined by the image analysis unit 112 as a result of the matching in the product data storage unit 117 in association with the product A. In addition, the registered partial image of the product A and information indicating that the image is an incomplete image associated with the product A are deleted from the product data storage unit 117.
  • step S46: No the master registration process is terminated.
  • the master image in addition to obtaining the advantageous effect of the first embodiment, even in a situation where the products are placed so as to overlap each other, without registering the image as a master in advance,
  • the master image can be registered in the product data storage unit 117 semi-automatically in the inspection work flow.
  • the inspection target image includes a product image captured in a state where there is no overlap, a process of replacing the master image with the product image,
  • the master image registered in a state where it overlaps with other products can be corrected, and the accuracy of verification can be further improved.
  • the third embodiment when an image of a product is not registered in the product data storage unit 117, the product image of the product can be registered in the product data storage unit 117 by an operator's pointing confirmation operation.
  • the pointing confirmation operation is an operation for associating an inspection product with an image portion showing the product.
  • the configuration of the third embodiment is the same as that of the inspection processing apparatus 100A of the second embodiment, for example.
  • FIG. 18 is a flowchart showing an example of inspection processing using the inspection processing apparatus according to the third embodiment of the present invention.
  • FIG. 19 is a diagram showing an example of an inspection confirmation screen according to the third embodiment of the present invention.
  • the target total weight calculation unit 108 calculates the target total weight using the unit weight and the inspection quantity of the inspection product included in the inspection data (Step S11).
  • the worker places the inspection target product 600 on the weight measuring device 300.
  • the weight measuring device 300 measures the weight, and the weight acquisition unit 102 acquires weight data (step S12).
  • the imaging device 200 captures an inspection target image of the inspection target product 600, and the product image acquisition unit 103 acquires the inspection target image (step S13).
  • the feature amount calculation unit 106 calculates the feature amount of the inspection target image (step S14).
  • the collation unit 115 searches for an inspection product in the inspection target image using the master image registered in the product data storage unit 117 (step S15).
  • the display information output unit 105A generates an image of the inspection confirmation screen illustrated in FIG. 19 and displays it on the display device 400 (step S16).
  • step S17 the worker confirms whether or not all the products have been specified. For example, when any product cannot be identified (step S17: No), the display information output unit 105A displays a visual confirmation screen (for example, the same as the inspection confirmation screen illustrated in FIG. 19) ( Step S18).
  • the worker adjusts the product placed on the weight measuring device 300 on the visual confirmation screen until the visual inspection is completed.
  • the worker performs an operation for registering unregistered products. The registration operation will be described on the assumption that the visual confirmation screen is the same as the screen illustrated in FIG. First, the worker performs an operation of associating an inspection product with an image portion showing the inspection product.
  • the worker performs an operation of selecting the first line of the inspection data display column 61, and further performs an operation of selecting two portions where the product A in the inspection target image display column 62 is reflected.
  • the worker then presses the pointing confirmation button 66.
  • the worker performs the same operation for the products B and C.
  • the input receiving unit 104 receives an operation for associating an inspection product with an image portion showing the inspection product by the worker (step S22).
  • the input receiving unit 104 outputs the identification information of the associated inspection product and the coordinate information of the image portion selected by the worker to the product data registration unit 109A via the control determination unit 101.
  • the product data registration unit 109A registers the product image in the product data storage unit 117 (step S23).
  • the image extraction unit 111 performs a process of cutting out each product image from the inspection target image
  • the product data registration unit 109A includes the coordinate information of the portion selected by the worker from the cut out product image.
  • the image is registered in the product data storage unit 117 in association with the inspection product associated with the product image by the worker. As a result, the inspection ends.
  • step S17 Yes
  • step S17 Yes
  • step S17 the worker checks whether the total weight error is within an allowable range. When it is not within the allowable range (step S19: No), the worker adjusts the excess or deficiency of the product. When the total weight error falls within the allowable range due to the adjustment work by the worker (step S19), the inspection is finished.
  • the control determination unit 101 records the inspection target image, the weight data, and the inspection data in association with each other in the inspection data storage unit 116 (step S20).
  • step S24 the inspection processing apparatus 100 performs a master registration process.
  • the product weight calculation unit 114 calculates the unit weight
  • the product data registration unit 109A performs each product. Are registered in the product data storage unit 117.
  • the worker when there is an inspection product whose master image is not registered in the product data storage unit 117, the worker performs an operation of associating the inspection product with the image of the inspection product during the inspection work.
  • the master image can be registered simply by performing the above. This eliminates the need for pre-registration of the master image and saves labor.
  • the operator can expect an effect of reducing errors in the inspection work by pointing and checking each product image shown in the inspection target image and the inspection product included in the inspection data on the visual confirmation screen.
  • FIG. 20 is a block diagram showing an example of the configuration of the product master registration apparatus according to the embodiment of the present invention.
  • the product master registration device 150 includes a control determination unit 101, an input reception unit 104, and a product data registration unit 109.
  • the input receiving unit 104 acquires a plurality of inspection data, and inspection target images and weight data that have already been inspected for the inspection data.
  • the product data registration unit 109 uses, for example, data acquired by the input reception unit 104 based on a worker's master registration instruction operation or the like, and the product included in the inspection data by the process described with reference to FIG.
  • the master image and unit weight are obtained, and the information is registered in the product master 151.
  • the product master registration device 150 it is possible to register a master image or the like in the product master 151 using the inspection data, the inspection target image, and the weight data obtained in the inspection work.
  • FIG. 21 is a block diagram illustrating an example of a hardware configuration of the inspection processing apparatus and the commodity data registration apparatus according to the embodiment of the present invention.
  • the inspection processing apparatuses 100 and 100A are realized by a computer apparatus including a CPU 901, a memory 902, a storage device 903 such as a hard disk, and a communication IF 904 (communication interface) for network connection.
  • the configuration of the inspection processing apparatuses 100 and 100A is not limited to the computer apparatus shown in FIG.
  • the inspection processing apparatuses 100 and 100A may transmit images or weight data to the outside via the communication IF 904, collate products to be inspected outside, and receive the results. The same applies to the product master registration device 150.
  • the block diagram used in each embodiment shows a functional unit block, not a hardware unit configuration. These functional blocks are realized by any combination of hardware and software. Further, the inspection processing devices 100 and 100A and the product master registration device 150 may be realized by one physically coupled device, or two or more physically separated devices are connected by wire or wirelessly, You may implement
  • the inspection processing devices 100 and 100A and the product master registration device 150 described above have a computer inside.
  • the processes of the inspection processing devices 100 and 100A and the product master registration device 150 described above are stored in a computer-readable recording medium in the form of a program, and the computer reads and executes the program.
  • the above processing is performed.
  • the computer-readable recording medium means a magnetic disk, a magneto-optical disk, a CD-ROM, a DVD-ROM, a semiconductor memory, or the like.
  • the computer program may be distributed to the computer via a communication line, and the computer that has received the distribution may execute the program.
  • the program may be for realizing a part of the functions described above. Further, the program may be a so-called difference file (difference program) that can realize the above-described functions in combination with a program already recorded in the computer system.
  • difference file difference program
  • a first inspection data including at least one inspection product to be inspected and at least one inspection quantity each indicating a quantity of the at least one inspection product, and a product group that matches the first inspection data
  • a product image determination unit that identifies an image for each of the at least one inspection product based on a first inspection target image;
  • a product data registration unit for registering the identified image in a storage unit; Based on the image stored in the storage unit, the product of the same type as any one of the at least one inspection product among the products included in the second inspection target image corresponding to the second inspection data is specified.
  • a collation unit; Inspection processing apparatus comprising:
  • the product image determination unit An image extraction unit that cuts out a plurality of batches of images as candidates for any one of the at least one inspection product from the first inspection target image; An image analysis unit that compares the plurality of cut-out images with each other, and calculates a quantity for each type of the plurality of cut-out images; A product specifying unit that compares the quantity of each of the plurality of cut out images with the at least one inspection quantity, and specifies the product indicated by each of the plurality of cut out images,
  • the inspection processing apparatus according to Supplementary Note 1, comprising:
  • the product image determination unit An image extraction unit that cuts out a plurality of batches of images as candidates for any one of the at least one inspection product from the first inspection target image; When the plurality of cut-out images include a first set of images indicating an image in which another product overlaps a part of one product, the first product is based on at least a feature amount of the other product.
  • a partial image selection unit that selects a portion indicated by the one product among a group of images as a partial image of the one product; Comprising The inspection processing apparatus according to any one of appendices 1 and 3 to 5, further comprising:
  • the product data registration unit registers the partial image in the storage unit in association with information indicating that the partial image is an incomplete image.
  • the inspection processing apparatus according to appendix 6.
  • the product data registration unit replaces the partial image with an image obtained by photographing a product of the same type as the one product without overlapping another product,
  • the inspection processing apparatus according to appendix 7.
  • Appendix 10 An imaging device that images the product group and obtains the first inspection target image; A weight measuring instrument for measuring the weight of the product group; The inspection processing apparatus according to any one of appendix 1 to appendix 9, wherein the inspection object image obtained by the imaging device and the weight of the commodity group measured by the weight measuring instrument are acquired. Inspection system with
  • a product image determination unit for specifying an image for each of the at least one inspection product
  • a product data registration unit for registering the identified image in a product master
  • a product master registration device comprising:
  • a first inspection data including at least one inspection product to be inspected and at least one inspection quantity each indicating a quantity of the at least one inspection product, and a product group that matches the first inspection data
  • an image for each of the at least one inspection product is specified, Register the identified image in the storage unit;
  • the product of the same type as any one of the at least one inspection product among the products included in the second inspection target image corresponding to the second inspection data is specified.
  • an image for each of the at least one inspection product is specified, Register the identified image in the storage unit;
  • the product of the same type as any one of the at least one inspection product among the products included in the second inspection target image corresponding to the second inspection data is specified.
  • the present invention may be applied to an inspection processing apparatus, an inspection system, a product master registration apparatus, an inspection processing method, and a program.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Mechanical Engineering (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Theoretical Computer Science (AREA)
  • Image Analysis (AREA)
  • Image Processing (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
PCT/JP2017/012121 2016-03-31 2017-03-24 検品処理装置、検品システム、商品マスタ登録装置、検品処理方法及びプログラム WO2017170260A1 (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
SG11201807007PA SG11201807007PA (en) 2016-03-31 2017-03-24 Inspection processing device, inspection system, commodity master registration device, inspection processing method, and program

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2016069899A JP6724484B2 (ja) 2016-03-31 2016-03-31 検品処理装置、検品システム、商品マスタ登録装置、検品処理方法及びプログラム
JP2016-069899 2016-03-31

Publications (1)

Publication Number Publication Date
WO2017170260A1 true WO2017170260A1 (ja) 2017-10-05

Family

ID=59964579

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2017/012121 WO2017170260A1 (ja) 2016-03-31 2017-03-24 検品処理装置、検品システム、商品マスタ登録装置、検品処理方法及びプログラム

Country Status (4)

Country Link
JP (1) JP6724484B2 (zh)
SG (1) SG11201807007PA (zh)
TW (1) TWI770015B (zh)
WO (1) WO2017170260A1 (zh)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7291264B2 (ja) * 2017-11-02 2023-06-14 株式会社オービック 計算処理装置、計算処理方法および計算処理プログラム
US11966435B2 (en) 2018-03-20 2024-04-23 Nec Corporation Information processing apparatus, control method, and program
CN110443553B (zh) * 2019-08-15 2022-08-23 深圳市海思睿科技有限公司 一种基于物品存储箱的无人值守物品管理方法
JP7388871B2 (ja) * 2019-10-18 2023-11-29 株式会社キッツ 判定装置、判定方法および判定プログラム

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0891543A (ja) * 1994-09-28 1996-04-09 Omron Corp 画像処理方法およびその装置
JP2004318488A (ja) * 2003-04-16 2004-11-11 Konica Minolta Photo Imaging Inc 製品検査方法及び製品検査装置
JP2011039872A (ja) * 2009-08-13 2011-02-24 Komatsu Denshi Kk 物品計数装置及び物品計数方法

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8131055B2 (en) * 2008-01-31 2012-03-06 Caterpillar Inc. System and method for assembly inspection
BRPI0800754A2 (pt) * 2008-03-25 2020-09-24 Sicpa Holding S.A. Sistema de controle de produção integrado por meio de processamento de imagem e codificação automatizada
CN103901489B (zh) * 2012-12-27 2017-07-21 清华大学 检查物体的方法、显示方法和设备

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0891543A (ja) * 1994-09-28 1996-04-09 Omron Corp 画像処理方法およびその装置
JP2004318488A (ja) * 2003-04-16 2004-11-11 Konica Minolta Photo Imaging Inc 製品検査方法及び製品検査装置
JP2011039872A (ja) * 2009-08-13 2011-02-24 Komatsu Denshi Kk 物品計数装置及び物品計数方法

Also Published As

Publication number Publication date
SG11201807007PA (en) 2018-09-27
JP6724484B2 (ja) 2020-07-15
TW201804381A (zh) 2018-02-01
TWI770015B (zh) 2022-07-11
JP2017178574A (ja) 2017-10-05

Similar Documents

Publication Publication Date Title
WO2017170260A1 (ja) 検品処理装置、検品システム、商品マスタ登録装置、検品処理方法及びプログラム
US10657637B2 (en) System for inspecting objects using augmented reality
JP6143111B2 (ja) 物体識別装置、物体識別方法、及びプログラム
JP6354589B2 (ja) 物体識別装置、方法及びプログラム
JP6679891B2 (ja) 検品処理装置、検品システム、検品処理方法及びプログラム
JP6278276B2 (ja) 物体識別装置、物体識別方法、及びプログラム
WO2016158438A1 (ja) 検品処理装置及び方法、及びプログラム
JP6458239B1 (ja) 画像認識システム
JP7485140B2 (ja) 情報処理装置、情報処理方法、およびプログラム
JP6236825B2 (ja) 自動販売機の販売商品認識装置及び販売商品認識方法、並びにコンピュータ・プログラム
JP5888358B2 (ja) 検品処理装置、検品システム、検品処理方法及びプログラム
JP6052448B2 (ja) 検品処理装置、検品システム、検品処理方法及びプログラム
JP6651169B2 (ja) 陳列状況判定システム
JP6769554B2 (ja) 物体識別装置、物体識別方法、計算装置、システムおよび記録媒体
US9045283B2 (en) Object information management system and program
JP2020009466A (ja) 陳列状況判定システム
JP6981495B2 (ja) 検品処理装置
US11462004B2 (en) Object identification device, object identification method, calculation device, system, and recording medium
JP6582875B2 (ja) 検品処理装置、検品システム、検品処理方法及びプログラム
JP2016018403A (ja) 画像処理装置、画像処理システム、画像処理方法及び画像処理プログラム
JP2015141696A (ja) 提供商品確認システム、提供商品確認方法、並びに提供商品確認プログラム
US11263760B2 (en) Information processing apparatus, information processing method, and non-transitory computer-readable storage medium for obtaining a position/orientation of an object
JP2013182428A (ja) 画像識別方法、画像識別装置および画像識別プログラム
JP2024034614A (ja) 書類確認装置及びプログラム
JP2020161196A (ja) 画像認識システム

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 11201807007P

Country of ref document: SG

NENP Non-entry into the national phase

Ref country code: DE

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17774797

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 17774797

Country of ref document: EP

Kind code of ref document: A1