JP2022135328A - Determination device, determination method, and determination program - Google Patents

Abstract

To determine presence or absence of an attachment attached to a container, while eliminating an influence of reflection on the container.SOLUTION: A determination device 1 can determine presence or absence of an attachment L attached to a bottle-like container B, and comprises: a three-dimensional imaging apparatus 2 that can pick up an image of the container B from a top face Bm side of the container B; and an arithmetic unit 3. The arithmetic unit 3 can execute: acquisition processing of acquiring three-dimensional image data picked up by the three-dimensional imaging apparatus; top face area specification processing of specifying a top face area, in the three-dimensional image data, which is an area corresponding to the top face Bm; inspection area specification processing of specifying an area, in the three-dimensional image data, which is extracted according to a predetermined condition with reference to the top face area as an inspection area; and determination processing of determining presence or absence of a portion corresponding to the attachment L in the inspection area.SELECTED DRAWING: Figure 1

Description

TECHNICAL FIELD The present invention relates to a determination device, a determination method, and a determination program capable of determining the presence or absence of an attachment attached to a bottle-shaped container.

When selling liquid products, the laws and regulations of each country may require the labeling of information related to the liquid product. For example, when selling a beverage product, which is an example of a liquid product, in Japan, the name, storage method, expiration date or expiration date, raw material name, additives, content amount, etc. It is obligatory to label the quantity and calorific value of nutritional components, the name and address of the business operator, and the location of the manufacturing plant, etc. (Cabinet Office Ordinance No. 10, Food Labeling Standards, Article 3). In addition, when beverage products are sold in polyethylene terephthalate beverage bottles, it is obligatory to label the materials to facilitate sorted collection (Act on Promotion of Effective Utilization of Resources No. 2 Article 14). In addition, labeling may be required in accordance with guidelines set by industry groups (for example, the Japan Soft Drink Industry Association).

As a means for making such indications (hereinafter referred to as "obligation indications, etc."), it is generally used to attach a label in a manner surrounding the container, and roll labels and shrink labels are typical labels used for this purpose. For example. Some of the matters indicated on the label are legally stipulated to be indicated, so it is not permitted to distribute products with defective labels on the market.

Therefore, in the manufacture of liquid products, an inspection device is used to inspect whether or not the label is securely attached. For example, Japanese Patent Application Laid-Open No. 2020-27085 (Patent Document 1) discloses a label inspection device that determines whether a label is attached based on an image of a container transported by a transport means, which is photographed from above. Japanese Patent No. 6359364 (Patent Literature 2) discloses a container inspection device that determines the quality of a label based on an image of the container photographed from the side.

Japanese Patent Application Laid-Open No. 2020-27085 Japanese Patent No. 6359364

In recent years, with the intention of appealing to consumers the design of the container itself and the appearance of the liquid product as the uniqueness of the product, attachments with a smaller area than conventional labels are attached to the shoulders of containers, etc. Attempts have been made to display obligatory indications, etc. on objects. In this case, most of the container is exposed without being covered by the label. will be more exposed. For a liquid product with such a configuration, when trying to determine whether the label is attached using, for example, the label inspection apparatus of Patent Document 1, the attachment correctly attached to the container to be inspected and the surface of the container to be inspected There have been cases where it is not possible to distinguish between the object reflected in the image and the quality of the attachment of the label is erroneously determined.

Therefore, it is desired to realize a determination device, a determination method, and a determination program capable of determining the presence or absence of an attachment attached to a container while eliminating the influence of reflection on the container.

A determination device according to the present invention is a determination device capable of determining the presence or absence of an attachment attached to a bottle-shaped container, comprising: a three-dimensional imaging device capable of imaging the container from the top side of the container; a device, wherein the computing device performs an acquisition process of acquiring three-dimensional image data captured by the three-dimensional imaging device; an inspection area specifying process for specifying, as an inspection area, an area extracted according to a predetermined condition based on the upper surface area in the three-dimensional image data; and determination processing for determining whether or not there is a portion corresponding to the attachment.

Further, a determination method according to the present invention is a determination method in which a determination device including a three-dimensional imaging device and an arithmetic device determines the presence or absence of an attachment attached to a bottle-shaped container, wherein the container is an acquisition step of acquiring three-dimensional image data captured from the upper surface side; an upper surface region specifying step of specifying an upper surface region corresponding to the upper surface in the three-dimensional image data; Of these, an inspection area specifying step of specifying an area extracted according to a predetermined condition based on the upper surface area as an inspection area, and a determination step of determining the presence or absence of a portion corresponding to the attachment in the inspection area. , is characterized by including

Further, a determination program according to the present invention is a determination program capable of determining the presence or absence of an attachment attached to a bottle-shaped container based on three-dimensional image data obtained by imaging the container from the upper surface side, A top surface region identifying process for identifying a top surface region corresponding to the top surface in the original image data, and a region extracted according to a predetermined condition based on the top surface region in the three-dimensional image data. as an inspection area, and a determination process for determining whether or not there is a portion corresponding to the attachment in the inspection area.

According to these configurations, it is possible to determine the presence or absence of an attachment attached to the container while eliminating the influence of reflection on the container. This is because, by making a determination based on the presence or absence of a portion corresponding to the attachment in the three-dimensional image, it is possible to clearly distinguish between the attachment having substance and the reflected image having no substance.

Preferred embodiments of the present invention are described below. However, the scope of the present invention is not limited by the preferred embodiments described below.

As one aspect of the determination device according to the present invention, the predetermined condition in the inspection area specifying process is a condition including that a distance in the height direction from the upper surface area is within a predetermined reference value. is preferred.

According to this configuration, when the attachment portion is attached to the periphery of the mouth portion or the shoulder portion of the container, an appropriate inspection area can be set, so that the determination accuracy can be improved.

As one aspect of the determination device according to the present invention, in the upper surface area identification process, when a surface extending in the horizontal direction exists in a preset height range of the three-dimensional image data, , the surface is preferably specified as the upper surface region.

According to this configuration, since the upper surface region is specified based on the real object detected in the three-dimensional image, it is easy to correctly specify the upper surface region, and therefore the determination accuracy can be improved.

As one aspect of the determination device according to the present invention, the three-dimensional imaging device can simultaneously image a plurality of the containers, and the computing device performs the above-mentioned An upper surface area is specified, and in the inspection area specifying process, the inspection area is specified for each of the plurality of containers, wherein the predetermined condition is that the inspection areas of two adjacent containers overlap. It is preferable that the presence or absence of a portion corresponding to the attachment is determined for each of the plurality of containers in the determination processing.

According to this configuration, even when a plurality of containers are judged at the same time, an appropriate judgment result can be obtained for each container. In particular, it is possible to accurately determine the presence or absence of an attached object even when reflection due to an adjacent container may occur.

As one aspect of the determination device according to the present invention, when it is determined in the determination processing that there is a portion corresponding to the attachment, it is preferable that the quantity of the portion corresponding to the attachment is further determined.

According to this configuration, it is possible to detect an abnormality in which an excessive attachment is attached to the container, in addition to an abnormality in which no attachment is attached to the container.

Further features and advantages of the invention will become clearer from the following description of exemplary and non-limiting embodiments described with reference to the drawings.

It is a schematic diagram which shows the use condition of the determination apparatus which concerns on embodiment. 3 is a schematic diagram of three-dimensional image data according to the embodiment; FIG. FIG. 4 is a diagram partially extracting three-dimensional image data according to the embodiment;

Embodiments of a determination device, a determination method, and a determination program according to the present invention will be described with reference to the drawings. Below, an example in which the determination device according to the present invention is applied to a determination device 1 capable of determining the presence or absence of an adhesive label L (an example of an attachment) attached to a PET bottle B (an example of a bottle-shaped container) will be described. do.

[Configuration of determination device]
A determination device 1 includes a three-dimensional imaging device 2 and an arithmetic device 3 (FIG. 1). The three-dimensional imaging device 2 is a known three-dimensional imaging device configured to be capable of outputting three-dimensional image data, and the arithmetic device 3 is implemented as a computer. The determination device 1 is installed in a shipping line for packaging PET bottles B in corrugated cardboard boxes and shipping them.

In the shipping line for PET bottles B, a row (example of multiple containers) of 24 PET bottles B (6 × 4) is formed, and after the row is slid over the blank sheet, the blank sheet are assembled into a box body, a packed product containing 24 PET bottles B is completed. In this embodiment, the three-dimensional imaging device 2 is provided above the path along which the row of 24 PET bottles B is slid onto the blank sheet. The three-dimensional imaging device 2 images a row of PET bottles B that are being slid onto the blank sheet to generate three-dimensional image data 4 (FIG. 2). Thus, the three-dimensional imaging device 2 can image the PET bottle B from above the PET bottle B (upper surface Bm side).

〔Determination process〕
The computing device 3 is a computer capable of acquiring the three-dimensional image data 4 captured by the three-dimensional imaging device 2 and executing a series of processes for determining the presence or absence of the adhesive label L based on the three-dimensional image data 4. Implemented. Below, a series of processes for determining the presence or absence of the adhesive label L will be described in order. Each process is performed for each portion of the three-dimensional image data 4 corresponding to each of the 24 PET bottles B. In the following description, the portion corresponding to one PET bottle B is extracted. Description will be made with reference to the drawing (FIG. 3).

First, the computing device 3 executes an upper surface area identification process for identifying an upper surface area 41 corresponding to the upper surface Bm of the PET bottle B in the three-dimensional image data 4 . Specifically, the three-dimensional image data 4 is scanned from top to bottom in the Z-axis direction (height direction), and the Z-coordinate is the largest among the areas where the real object (PET bottle B) is detected. A face is identified as a top surface region 41 . As the range in the Z-axis direction (height direction) to be scanned at this time, the range in the Z-axis direction (height direction) that is assumed to be the range in which the upper surface Bm exists when considering the dimensions of the PET bottle B is set in advance. It is In this embodiment, the upper surface Bm of the PET bottle B exists as the upper surface of the lid that seals the mouth of the PET bottle B. Therefore, a circular and planar area corresponding to the shape of the upper surface of the lid is the upper surface area. 41.

Secondly, the computing device 3 executes an inspection area specifying process for specifying an inspection area 42 in which the presence or absence of the adhesive label L is to be determined in the three-dimensional image data 4 . Specifically, the distance Dv in the Z-axis direction (height direction) from the upper surface region 41 specified by the upper surface region specifying process is within 30 mm downward (an example of a reference value), and , the distance Dh in the XY plane direction (horizontal direction) from the center of the top surface region 41 is 50 to 120 mm (an example of a predetermined condition based on the top surface region). . Here, the separation distance Dh that defines the size of the inspection area 42 in the XY plane direction is set to a value smaller than half the axial distance Dx (FIG. 2) between adjacent PET bottles B in the row of PET bottles B. be. As a result, the inspection areas 42 associated with a plurality of PET bottles B do not overlap each other.

Thirdly, the computing device 3 executes determination processing for determining the presence/absence of the label portion 43 corresponding to the adhesive label L in the inspection area 42 . In this embodiment, the adhesive label L is affixed to the PET bottle B in such a manner that it rises upward from the shoulder (attachment example). Therefore, when an actual object is detected within the inspection area 42, it can be said that the label portion 43 exists, so it is determined that the adhesive label L is attached. Conversely, if no physical object is detected within the inspection area 42, it is determined that the adhesive label L is not attached because the label portion 43 does not exist. This makes it possible to detect an abnormality in which the adhesive label L is not attached to the PET bottle B. FIG.

As described above, in the present embodiment, the presence or absence of the adhesive label L is determined based on the presence or absence of the portion corresponding to the actual object in the three-dimensional image data 4 acquired using the three-dimensional imaging device 2. Therefore, the determination result is not affected by the object reflected on the shoulder of the PET bottle B.

Also, when the label portion 43 exists within the inspection area 42, the quantity of the label portion 43 within the inspection area 42 is detected at the same time. Since the number of label portions 43 corresponds to the number of adhesive labels L attached to PET bottles B, for example, an abnormality in which a plurality of adhesive labels L are attached to one PET bottle B can be detected. sell.

The arithmetic device 3 performs the series of processes described above for each portion corresponding to each of the 24 PET bottles B in the three-dimensional image data 4 . When one adhesive label L is attached to each of the 24 PET bottles B, it is determined that the 24 PET bottles B are normal. Conversely, when an abnormality is detected in which at least one of the 24 PET bottles B is not attached with the adhesive label L, or in which a plurality of adhesive labels L are attached, the abnormality is detected. 24 PET bottles B including the detected PET bottle B are determined to be abnormal. At this time, the arithmetic unit 3 generates a signal for issuing an alarm to notify the administrator of the occurrence of an abnormality, and an operation for rejecting the package containing the PET bottle B determined to be abnormal from the product to be shipped. , a signal for causing the devices constituting the shipping line to operate, and a signal for stopping the operation of each device constituting the shipping line.

[Other embodiments]
Finally, other embodiments of the determination device, determination method, and determination program according to the present invention will be described. It should be noted that the configurations disclosed in the respective embodiments below can also be applied in combination with configurations disclosed in other embodiments unless there is a contradiction.

In the above embodiment, an example in which the determination device 1 is configured to be able to determine the presence or absence of the adhesive label L attached to the PET bottle B has been described. However, the attached item to be determined in the present invention is not limited as long as it can be attached to a bottle-like container, and may be, for example, a tag fitted to the mouth of the container.

In the above-described embodiment, in the upper surface area identification process, the three-dimensional image data 4 is scanned from top to bottom in the Z-axis direction, and the surface with the largest Z coordinate among the areas in which real objects are detected is the upper surface. The configuration specified as the area 41 has been described as an example. However, in the present invention, the method for specifying the upper surface region is not particularly limited, and for example, a method for specifying the upper surface region based on the difference in color between the upper surface of the container and other portions may be used.

In the above-described embodiment, in the inspection area specifying process, a configuration has been described as an example in which a space of predetermined dimensions (separation distances Dv, Dh) that spreads three-dimensionally around the upper surface area 41 is specified as the inspection area 42 . However, the method of specifying the inspection area in the present invention is not particularly limited. For example, a method of recognizing the outer edge of the shoulder portion of the container and specifying the area surrounded by the upper surface area and the outer edge as the inspection area. good.

In the above-described embodiment, in the determination processing, the configuration for determining the presence or absence of the label portion 43 based on the presence or absence of a physical object detected within the inspection area 42 has been described as an example. However, a specific algorithm in the determination processing of the present invention can be appropriately set according to the shape of the container and the attachment, the method of attachment of the attachment, and the like. Also, for example, if teacher data is prepared for both or one of the case where the container and attachments exist and the case where only the container exists, and the computing device builds a trained model based on the teacher data. , the presence or absence of a portion corresponding to the attachment can be determined based on the learned model.

In the above-described embodiment, an example has been described in which a row in which 24 PET bottles B are arranged is imaged collectively, and the presence or absence of the adhesive label L in each of the 24 PET bottles B is determined collectively. However, in the present invention, the number of containers to be determined at one time may be singular or plural.

Regarding other configurations, it should be understood that the embodiments disclosed in this specification are examples in all respects, and that the scope of the present invention is not limited by them. Those skilled in the art will easily understand that modifications can be made as appropriate without departing from the scope of the present invention. Therefore, other embodiments modified without departing from the gist of the present invention are naturally included in the scope of the present invention.

INDUSTRIAL APPLICABILITY The present invention can be used, for example, to determine whether or not there is an adhesive label attached to a PET bottle.

1: determination device 2: three-dimensional imaging device 3: arithmetic device 4: three-dimensional image data 41: upper surface area 42: inspection area 43: label portion B: PET bottle Bm: upper surface of PET bottle L: adhesive label

Claims (7)

A determination device capable of determining the presence or absence of an attachment attached to a bottle-shaped container,
A three-dimensional imaging device capable of imaging the container from the upper surface side of the container;
a computing device;
The computing device is
Acquisition processing for acquiring three-dimensional image data captured by the three-dimensional imaging device;
a top surface region identifying process for identifying a top surface region corresponding to the top surface in the three-dimensional image data;
inspection area specifying processing for specifying an area extracted according to a predetermined condition based on the upper surface area in the three-dimensional image data as an inspection area;
and a determination process for determining whether or not there is a portion corresponding to the attachment in the inspection area. 2. The determination apparatus according to claim 1, wherein said predetermined condition in said inspection area identifying process is a condition including that a distance in a height direction from said upper surface area is within a predetermined reference value. 3. In the upper surface area identification processing, when a surface extending in a horizontal direction exists within a preset height range of the three-dimensional image data, the surface is identified as the upper surface area. 3. The determination device according to 1 or 2. The three-dimensional imaging device can simultaneously image a plurality of the containers,
The computing device is
In the upper surface region identification process, the upper surface region is identified for each of the plurality of containers;
In the inspection area specifying process, the inspection areas are specified for each of the plurality of containers, and the predetermined condition is set so that the inspection areas for two adjacent containers do not overlap. is,
4. The determination device according to any one of claims 1 to 3, wherein in the determination process, it is determined whether or not there is a portion corresponding to the attachment for each of the plurality of containers. The determination device according to any one of claims 1 to 4, further determining the quantity of the portion corresponding to the attachment when it is determined that the portion corresponding to the attachment exists in the determination processing. A determination method in which a determination device comprising a three-dimensional imaging device and an arithmetic device determines the presence or absence of an attachment attached to a bottle-shaped container,
an acquisition step of acquiring three-dimensional image data obtained by imaging the container from the top side;
a top surface region identifying step of identifying a top surface region corresponding to the top surface in the three-dimensional image data;
an inspection area specifying step of specifying, as an inspection area, an area of the three-dimensional image data extracted according to a predetermined condition based on the upper surface area;
and a determination step of determining whether or not there is a portion corresponding to the attachment in the inspection area. A determination program capable of determining the presence or absence of an attachment attached to a bottle-shaped container based on three-dimensional image data obtained by imaging the container from the upper surface side,
a top surface region identifying process for identifying a top surface region corresponding to the top surface in the three-dimensional image data;
inspection area specifying processing for specifying an area extracted according to a predetermined condition based on the upper surface area in the three-dimensional image data as an inspection area;
A determination program for causing a computer to execute determination processing for determining whether or not there is a portion corresponding to the attachment in the inspection area.

Images