KR20220067559A - Apparatus for checking defect of pouch - Google Patents

Abstract

According to an embodiment of the present invention, an apparatus for checking a defect in the exterior of a pouch comprises: a conveyor for transporting a fed pouch, overturning the front and rear surfaces of the pouch if the pouch is transported by a first distance, transporting the pouch by a second distance, and discharging the same; a first camera installed at an upper end of an area, in which the pouch is transported by the first distance, of a conveyor area to photograph the pouch; a second camera installed at an upper end of an area, in which the pouch is transported by the second distance, of the conveyor area to photograph the pouch; and a defect checking unit for detecting a defect in the pouch through images captured by the first camera and the second camera. Therefore, the apparatus can automatically, simultaneously, and accurately check a defect in both the surfaces of the pouch.

Description

Pouch appearance defect inspection device {APPARATUS FOR CHECKING DEFECT OF POUCH}

The present invention relates to a pouch appearance defect inspection apparatus, and more particularly, by acquiring images of all sides of the pouch through a plurality of cameras while turning the pouch in front and back according to the reverse transfer process of the conveyor, the obtained image It relates to a pouch appearance defect inspection device that can more accurately inspect various defects related to rotation of the pouch through deep learning inspection.

In general, a vision inspection apparatus is a device capable of determining and sorting whether a product is defective by photographing or sensing an object to be inspected by a camera or a sensor and inspecting the shape or size of a product, or a foreign object or scratch. As such a vision inspection device can automatically inspect for defects by continuously supplying inspection objects, it is usefully used to thoroughly inspect various products such as mobile phones and automobile parts.

The conventional vision inspection method detects and classifies defects by detecting simple gray changes in 2D images. Visual inspection is not possible, so visual inspection is relied on. Pouch products have different creases on the outside, and since the material is also good for reflecting light, accurate inspection is inevitably difficult.

Such a conventional inspection method inevitably causes a difference in defect detection due to a limitation in the method of grasping each inspector by eye, and also has an unreasonable problem in that the inspection speed is divided into a fast person and a slow person. Also, there is a problem that even the same inspector may have different inspection standards for each day or time. As described above, in the conventional inspection method, due to the external characteristics of pouch products, inspection by computer vision is impossible, and thus, it has no choice but to rely on visual inspection, and thus it is not possible to accurately detect product defects. Accordingly, there is a demand for the development of a device capable of more accurately and rapidly detecting defects on the appearance of pouch products.

Republic of Korea Patent Registration No. 10-1595708 (published on February 18, 2016)

The present invention has been devised to improve the prior art as described above, and obtains an image of all sides of the pouch through a plurality of cameras while flipping the pouch to the front and back according to the reverse transfer process of the conveyor, An object of the present invention is to provide a pouch appearance defect inspection device that can more accurately inspect various defects related to rotation of the pouch by deep learning inspection through images.

In order to achieve the above object and solve the problems of the prior art, an apparatus for inspecting a defective appearance of a pouch according to an embodiment of the present invention transports an input pouch, and when the pouch is transported by a first distance, the front of the pouch and the Conveyor (conveyor) for discharging by transferring the second distance after turning over; a first camera installed at an upper end of an area in which the pouch is transported by the first distance among the conveyor areas to photograph the pouch; a second camera installed at an upper end of an area in which the pouch is transported by the second distance among the conveyor areas to photograph the pouch; and a defect inspection unit configured to detect a defect in the pouch through images captured by the first camera and the second camera.

In addition, the conveyor of the pouch appearance defect inspection apparatus according to an embodiment of the present invention, a first conveyor for transferring the input pouch by a first distance; Both sides of the first and second conveyors are connected to each other in a cogwheel shape having a sawtooth groove of a size in which the pouch is accommodated, and when the pouch input from the first conveyor is accommodated in the toothed groove, rotate 180 degrees. a reverse transfer unit for transferring the pouch to the second conveyor through; and a second conveyor connected to the reversing transfer unit and transferring the pouch input from the reversing transfer unit by a second distance.

In addition, in the pouch appearance defect inspection apparatus according to an embodiment of the present invention, the sawtooth groove is characterized in that the shape has a width sufficient to fit the pouch in the lateral direction.

In addition, the pouch appearance defect inspection apparatus according to an embodiment of the present invention is installed in the left and right side areas adjacent to the first camera, respectively, 1-1 parallel light illumination and 1 - 2 collimated light illumination; 1-1 diffused light illumination and 1-2 diffused light illumination which are respectively installed in the lower region of the 1-1 parallel light illumination and the lower region of the 1-2 parallel light illumination to irradiate the diffused light to the pouch ; 2-1 parallel light illumination and 2-2 parallel light illumination which are respectively installed in the left and right side areas adjacent to the second camera to irradiate the diffused light to the pouch; and 2-1 diffused light illumination and 2-2 diffused light respectively installed in a lower region of the 2-1 parallel light illumination and a lower region of the 2-2 parallel light illumination to irradiate the diffused light to the pouch. It further includes lighting.

In addition, in the pouch appearance defect inspection apparatus according to an embodiment of the present invention, the defect inspection unit is a computing device equipped with artificial intelligence having a CNN (Convolution Neural Network) neural network, and deep learning image learning using the CNN neural network. Inspects the appearance defect of the pouch through model generation through The inspection unit compares the images received from the first camera and the second camera with a model generated through the deep learning to inspect the appearance of the pouch.

According to the pouch appearance defect inspection apparatus of the present invention, it is possible to obtain the effect of automatically and accurately inspecting defects on both sides of the pouch at the same time.

In addition, according to the pouch appearance defect inspection apparatus of the present invention, by using diffused light and parallel light at the same time to irradiate and inspect the pouch with light, it is possible to more accurately inspect defects with a uniform amount of light for a pouch product made of vinyl material. can get

In addition, according to the apparatus for inspecting defective appearance of a pouch of the present invention, by deep learning inspection of images with multiple inspection models and multiple threads according to various types of defects, it is possible to more accurately inspect various types of defects within a shorter time. can get

1 is a view showing the configuration of a pouch appearance defect inspection apparatus according to an embodiment of the present invention.
2 is a view showing the configuration of the pouch input unit of the pouch external defect inspection apparatus according to an embodiment of the present invention.
3 is a view showing a conveyor of the pouch appearance defect inspection apparatus according to an embodiment of the present invention.
Figure 4 is a view showing a portion of the cogwheel of the conveyor reversing transfer unit of the pouch appearance defect inspection device according to an embodiment of the present invention.
5 is a view showing a pouch discharge unit of the apparatus for inspecting defective pouch appearance according to an embodiment of the present invention.
6 is a diagram illustrating a configuration of lighting according to an embodiment of the present invention.

In order to clarify the characteristics and advantages of the problem solving means of the present invention, the present invention will be described in more detail with reference to specific embodiments of the present invention shown in the accompanying drawings. However, detailed descriptions of well-known functions or configurations that may obscure the gist of the present invention in the following description and accompanying drawings will be omitted. Also, it should be noted that, throughout the drawings, the same components are denoted by the same reference numerals as much as possible.

The terms or words used in the following description and drawings should not be construed as being limited to conventional or dictionary meanings, and the inventor may appropriately define the concept of terms for describing his invention in the best way. Based on the principle that there is, it should be interpreted as meaning and concept consistent with the technical idea of the present invention. Therefore, the embodiments described in this specification and the configurations shown in the drawings are only the most preferred embodiment of the present invention, and do not represent all of the technical spirit of the present invention. It should be understood that there may be equivalents and variations.

In addition, terms including ordinal numbers such as 1st, 2nd, etc. are used to describe various components, and are used only for the purpose of distinguishing one component from other components, and to limit the components. not used For example, without departing from the scope of the present invention, the second component may be referred to as the first component, and similarly, the first component may also be referred to as the second component. In addition, when an element is referred to as being “connected” or “connected” to another element, it means that it is logically or physically connected or can be connected.

In other words, it should be understood that a component may be directly connected or connected to another component, but another component may exist in between, and may be indirectly connected or connected. In addition, terms such as "comprises" or "have" as used herein are intended to designate that the features, numbers, steps, operations, components, parts, or combinations thereof described in the specification exist, but one or the It should be understood that the above does not preclude the possibility of the existence or addition of other features or numbers, steps, operations, components, parts, or combinations thereof.

In addition, terms such as “…unit”, “…group”, and “module” described in the specification mean a unit that processes at least one function or operation, which may be implemented as hardware or software or a combination of hardware and software. have. Also, "a or an", "one", "the" and similar terms are otherwise indicated herein in the context of describing the invention (especially in the context of the following claims). or may be used in a sense including both the singular and the plural unless clearly contradicted by context.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a view showing the configuration of a pouch appearance defect inspection apparatus according to an embodiment of the present invention, Figure 2 is a view showing the configuration of the pouch input part of the pouch appearance defect inspection apparatus according to an embodiment of the present invention. , Figure 3 is a view showing a conveyor of the pouch appearance defect inspection apparatus according to an embodiment of the present invention, Figure 4 shows a part of the gear wheel of the conveyor reversing transfer unit for the pouch appearance defect inspection apparatus according to an embodiment of the present invention It is a view, and FIG. 5 is a view showing the pouch discharge part of the apparatus for inspecting defective appearance of a pouch according to an embodiment of the present invention, and FIG. 6 is a view showing the configuration of lighting according to an embodiment of the present invention.

A pouch appearance defect inspection apparatus according to an embodiment of the present invention includes a conveyor 110 , a first conveyor 111 , a second conveyor 112 , a reverse transfer unit 113 , a first camera 121 , and a second camera ( 122), 1-1 parallel light illumination 141, 1-2 parallel light illumination 142, 1-1 diffused light illumination 143, 1-2 diffused light illumination 144, 2-th A first parallel light illumination 151 , a 2-2 parallel light illumination 152 , a 2-1 diffused light illumination 153 , a 2-2 diffused light illumination 154 , and a defect inspection unit 130 are included.

As shown in FIG. 2 , the pouch input unit randomly loads the pouches into the straight feeding unit, and the fed pouches are aligned in a line through a guide in the form of a cascade, one by one on the conveyor 110 . can be loaded A laser displacement sensor is installed on the upper side to detect a pouch, so that several sheets overlap and are transferred or a pouch that is not loaded on the conveyor 110 can be detected.

The conveyor 110 transports the input pouch 101, and when the pouch 101 is transported by a first distance, the front and back sides of the pouch are turned over and then transported and discharged by a second distance. For this purpose, as shown in FIGS. 1 and 3 , the conveyor 110 includes a first pouch 111 , a second pouch 112 , and a reverse transfer unit 113 . The first conveyor 111 transports the input pouch by a first distance. The first conveyor 111 may be implemented as a length as long as a first distance, and the first distance may be implemented as a length from the left end of the first conveyor 111 to the right end in contact with the inversion transfer unit 113 . .

The reversing transfer unit 113 has a cogwheel shape having a cog groove having a size in which the pouch 101 is accommodated, and both sides are connected to the first conveyor and the second conveyor. The reverse transfer unit 113 transfers the pouch 101 to the second conveyor 112 through 180 degree rotation when the pouch 101 transferred and input by the first conveyor 111 is accommodated in the toothed groove. Accordingly, the reversal receiving unit 113 may be implemented in the shape of a semi-circular toothed wheel connecting each other between the first conveyor 111 and the second conveyor 112 .

The tooth groove of the reversing transfer unit 113 means a space between both teeth as shown in FIG. 4 . For example, it means a kind of space formed between the first tooth 211 and the second tooth 212 . When the pouch 101 transferred through the first conveyor 111 reaches the reverse transfer unit 113, it is accommodated in the toothed groove. At this time, the pouch 101 may be accommodated in the serrated groove in a state of being fitted in the lateral direction, that is, in a lying state, as shown in FIG. 4 . Therefore, as the cog wheel rotates 180 degrees, the front side of the pouch 101 that was transported while looking upward when transported on the first conveyor 111 is transported while looking downward on the second conveyor 112, and the first conveyor 111 ), the rear surface of the pouch 101 that was transported when looking at the lower side may be transferred while looking at the upper side on the second conveyor 112 . To this end, the sawtooth groove of the reversing transfer unit 113 may be implemented in a shape having a width sufficient to fit the pouch 101 in the lateral direction.

The first camera 121 is installed on the upper end of the first conveyor 111 to photograph the pouch 101 . The second camera 122 is installed on the upper end of the second conveyor 112 to photograph the pouch 101 . The pouch 101 of the first camera 121 and the second camera 122 may photograph both the front and the back according to the operation of turning over the pouch 101 of the reversing transfer unit 113 . The number or direction of installation of the cameras may be implemented so that the administrator may set them in various ways in consideration of the appearance of the pouch product to be inspected.

The 1-1 parallel light illumination 141 and the 1-2 parallel light illumination 142 are respectively installed in the left and right side regions adjacent to the first camera 121 to irradiate the parallel light to the pouch 101 . The 1-1 diffused light illumination 143 and the 1-2 diffused light illumination 144 are respectively installed in the lower region of the 1-1 parallel light illumination 141 and the 1-2 parallel light illumination 142, The diffused light is irradiated to the pouch 101 . The 2-1 parallel light illumination 151 and the 2-2 parallel light illumination 152 are respectively installed in both left and right areas adjacent to the second camera to irradiate the diffused light to the pouch 101 . The 2-1 diffused light illumination 153 and the 2-2 diffused light illumination 154 are respectively installed in the lower area of the 2-1 parallel light illumination 151 and the 2-2 parallel light illumination 152, The diffused light is irradiated to the pouch 101 . Diffuse light illumination and collimated light illumination can be adjusted by the administrator according to inspection specifications to set the required optical conditions. When both parallel light lights are activated, defects located in the center of the product may not be visible due to light interference. .

The collimated light illumination makes it possible to more accurately detect side creases, dents, scratches, cross-section creases, and point dents on the pouch. Diffuse light illumination enables more accurate detection of defects in the sealing end, sealing joint, contamination, leakage, overlapping seal, smearing, silver foil wrapping paper, wrapping wrapping, embossing (short at one end), and various information seals. . In this way, the plurality of lights is disposed corresponding to each camera in each area in which the plurality of cameras are disposed to irradiate the pouch with light. The diffuse light illumination may be implemented as a diffuse C-shaped illumination. In the case of general direct light type lighting, due to the diffuse reflection of light irradiated to the curved surface of the product, saturation occurs, resulting in appearance inspection dead area. Therefore, in the present invention, it is possible to create a certain condition to the extent that the appearance inspection is possible even on a curved surface by applying special diffuse lighting.

The defect inspection unit 130 detects a defect in the pouch 101 through the images captured by the first camera 121 and the second camera 122 . The bad inspection unit 130 may be implemented as a computing device equipped with artificial intelligence having a CNN (Convolution Neural Network) neural network. The defect inspection unit 130 inspects the defect of the atypical product through model generation through deep learning image learning using the CNN neural network. Deep learning image learning using the CNN neural network can be implemented through a sample image input step, a learning data labeling step, a deep learning learning progress step, and a model generation step. The defect inspection unit 130 may compare the images received from the first camera 121 and the second camera 122 with the model generated through the deep learning to inspect the appearance defect of the atypical product.

In the present invention, learning about image defects is performed using a CNN neural network using Tensorflow. In this case, since it is difficult to detect a defect in an image, the depth of the neural network is applied as 101 layers to increase the amount of learning and optimize the defect detection. Since the algorithm and model were developed based on Python, it may take a long time to configure the inspection device because the image acquisition application and the Python deep learning inspection model must communicate with each other to exchange images and statuses when applying the actual inspection. In the present invention, the required time can be shortened and the configuration can be simplified by making the 8 inspection models dll and making the function call directly from the image acquisition application so that the Python application does not run. To increase inspection reliability, each defect (scratches, dents, burrs, pressed, etc.) is labeled in more than 1,000 products with defective metal, and tens of thousands of data sets are generated and inspected by amplifying them by angle and size. accuracy can be increased.

Because it is necessary to inspect the front of the pouch product, learning is carried out with 8 inspection models, and high-speed inspection speed is required to set the tact time of the inspection device, so a single-thread sequential inspection method It can be implemented in such a way that 88 images can be inspected in 6 seconds by applying the inspection Boost Algorithm and performing inspection with 8 Multi Threads. Inspection by deep learning learning is inspected through the shape of the defect. have.

Noise can be removed from the original image, and filtering (LOG) and binarization algorithm processing (Adaptive) can be performed. After finding an approximate circle with the Circle Fitting algorithm, separating the region of interest based on the circle, and dividing the separated images by 1/4, deep learning learning can be performed, which is to test with one model. Finally, by checking the reliability of the inspection, it is possible to inspect the defects that occur in the appearance of atypical products more accurately and quickly.

As described above, although the present invention has been described with reference to limited embodiments and drawings, the present invention is not limited to the above embodiments, and various modifications and variations from these descriptions are provided by those skilled in the art to which the present invention pertains. This is possible.

Therefore, the scope of the present invention should not be limited to the described embodiments, but should be defined by the following claims as well as the claims and equivalents.

110: conveyor
111: first conveyor
112: second conveyor
113: reverse transfer unit
121: first camera
122: second camera
130: defective inspection unit
141: 1-1 parallel light illumination
142: first 1-2 parallel light illumination
143: 1-1 diffuse light illumination
144: 1-2 diffuse light illumination
151: 2-1 parallel light illumination
152: second 2-2 parallel light illumination
153: 2-1 diffused light illumination
154: 2-2 diffused light illumination

Claims (5)

In the device for inspecting the appearance of the pouch,
a conveyor that transports the input pouch, and when the pouch is transported by a first distance, turns over the front and back sides of the pouch, and then transports and discharges the pouch by a second distance;
a first camera installed at an upper end of an area in which the pouch is transported by the first distance among the conveyor areas to photograph the pouch;
a second camera installed at an upper end of an area in which the pouch is transported by the second distance among the conveyor areas to photograph the pouch; and
A defect inspection unit that detects a defect in the pouch through images captured by the first camera and the second camera
A pouch appearance defect inspection device comprising a. The method of claim 1,
The conveyor is
a first conveyor for transferring the input pouch by a first distance;
Both sides of the first and second conveyors are connected to each other in the shape of a cogwheel having a serrated groove of a size in which the pouch is accommodated, and when the pouch input from the first conveyor is accommodated in the serrated groove, the pouch rotates 180 degrees. a reverse transfer unit for transferring the pouch to the second conveyor through; and
A second conveyor connected to the reversing transfer unit and transporting the pouch input from the reversing transfer unit by a second distance
A pouch appearance defect inspection device comprising a. 3. The method of claim 2,
The serrated groove is a pouch appearance defect inspection device, characterized in that the shape having a width enough to fit the pouch in the lateral direction. The method of claim 1,
1-1 parallel light illumination and 1-2 parallel light illumination which are respectively installed in the left and right side areas adjacent to the first camera to irradiate parallel light to the pouch;
1-1 diffused light illumination and 1-2 diffused light illumination which are respectively installed in the lower region of the 1-1 parallel light illumination and the lower region of the 1-2 parallel light illumination to irradiate the diffused light to the pouch ;
2-1 parallel light illumination and 2-2 parallel light illumination which are respectively installed in the left and right side areas adjacent to the second camera to irradiate the diffused light to the pouch; and
2-1 diffused light illumination and 2-2 diffused light illumination which are respectively installed in the lower area of the 2-1 parallel light illumination and the 2-2 parallel light illumination area to irradiate the diffused light to the pouch
Pouch appearance defect inspection device, characterized in that it further comprises. The method of claim 1,
The defect inspection unit is a computing device equipped with artificial intelligence having a Convolution Neural Network (CNN) neural network, and inspects the appearance defect of the pouch through model generation through deep learning image learning using the CNN neural network,
Deep learning image learning using the CNN neural network is implemented through a sample image input step, a learning data labeling step, a deep learning learning progress step, and a model generation step, and the defect inspection unit is received from the first camera and the second camera. A pouch appearance defect inspection apparatus, characterized in that the image is compared with the model generated through the deep learning to inspect the appearance defect of the pouch.

Images